2024-03-27T08:07:29.000 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-27T08:07:29.000 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706 --verbose --owner scheduled_rishabh@teuthology --name rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} -- /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/orig.config.yaml 2024-03-27T08:07:29.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T08:07:29.157 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706 branch: wip-rishabh-testing-20240326.131558 description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} email: null first_in_suite: false job_id: '7625706' kernel: flavor: default kdb: true sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-rishabh-testing-20240326.131558 ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - slow metadata IO - SLOW_OPS - slow request sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 subvols: create: 2 subvol_options: --namespace-isolated --size 25000000000 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt install: ceph: flavor: default sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-rishabh-testing-20240326.131558 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 owner: scheduled_rishabh@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6931 sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 sleep_before_teardown: 0 subset: 80/512 suite: fs suite_branch: wip-rishabh-testing-20240326.131558 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi164.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFHxk/686kWc8nSjJ/jw0+u1G8h2gVjiuIitZBQyO3nlZDiPoKrQzcChFkFrEXGHDVHT3dhUZks7XJoWBTtWJo= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2KjcoRtPDIsq/FV0jcma9Ur+ZkIk9tt3Y+yt+CZ4FEwFEeDo9FfKAuplxQNI80RgNbPiedurHNJ/q4NIjvU/Q= smithi173.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDET7FpT/zOyGXaKpHQXGWRwGH02BZOUZfIL38eBuoXcdblRvQtmV1av2Fy3GdKPT6ZJggNhReoMMXFyVHumi4= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-27_05:27:11 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-27T08:07:29.158 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa; will attempt to use it 2024-03-27T08:07:29.159 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks 2024-03-27T08:07:29.159 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-27T08:07:29.160 INFO:teuthology.task.internal:Checking packages... 2024-03-27T08:07:29.184 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '155268c4e432a12433aa833f174f9fe3b1016ae0' 2024-03-27T08:07:29.184 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-27T08:07:29.184 INFO:teuthology.packaging:ref: None 2024-03-27T08:07:29.184 INFO:teuthology.packaging:tag: None 2024-03-27T08:07:29.184 INFO:teuthology.packaging:branch: wip-rishabh-testing-20240326.131558 2024-03-27T08:07:29.184 INFO:teuthology.packaging:sha1: 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:07:29.185 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-rishabh-testing-20240326.131558 2024-03-27T08:07:29.507 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2478.g155268c4 2024-03-27T08:07:29.508 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-27T08:07:29.516 INFO:teuthology.task.internal:no buildpackages task found 2024-03-27T08:07:29.516 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-27T08:07:29.525 INFO:teuthology.task.internal:Saving configuration 2024-03-27T08:07:29.546 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-27T08:07:29.553 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:07:29.580 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.546988', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFHxk/686kWc8nSjJ/jw0+u1G8h2gVjiuIitZBQyO3nlZDiPoKrQzcChFkFrEXGHDVHT3dhUZks7XJoWBTtWJo='} 2024-03-27T08:07:29.602 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.544731', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2KjcoRtPDIsq/FV0jcma9Ur+ZkIk9tt3Y+yt+CZ4FEwFEeDo9FfKAuplxQNI80RgNbPiedurHNJ/q4NIjvU/Q='} 2024-03-27T08:07:29.624 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.546025', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDET7FpT/zOyGXaKpHQXGWRwGH02BZOUZfIL38eBuoXcdblRvQtmV1av2Fy3GdKPT6ZJggNhReoMMXFyVHumi4='} 2024-03-27T08:07:29.624 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-27T08:07:29.638 INFO:teuthology.task.internal:roles: ubuntu@smithi164.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-03-27T08:07:29.638 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-03-27T08:07:29.638 INFO:teuthology.task.internal:roles: ubuntu@smithi173.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-03-27T08:07:29.638 INFO:teuthology.run_tasks:Running task console_log... 2024-03-27T08:07:29.749 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8f81a5a160>, signals=[15]) 2024-03-27T08:07:29.749 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-27T08:07:29.755 INFO:teuthology.task.internal:Opening connections... 2024-03-27T08:07:29.755 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:07:29.757 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:07:29.850 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-03-27T08:07:29.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:07:29.938 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi173.front.sepia.ceph.com 2024-03-27T08:07:29.939 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:07:30.026 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-27T08:07:30.034 DEBUG:teuthology.orchestra.run.smithi164:> uname -m 2024-03-27T08:07:30.052 INFO:teuthology.orchestra.run.smithi164.stdout:x86_64 2024-03-27T08:07:30.053 DEBUG:teuthology.orchestra.run.smithi164:> cat /etc/os-release 2024-03-27T08:07:30.113 INFO:teuthology.orchestra.run.smithi164.stdout:NAME="CentOS Stream" 2024-03-27T08:07:30.113 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION="9" 2024-03-27T08:07:30.113 INFO:teuthology.orchestra.run.smithi164.stdout:ID="centos" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:ID_LIKE="rhel fedora" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:VERSION_ID="9" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:PLATFORM_ID="platform:el9" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:ANSI_COLOR="0;31" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:LOGO="fedora-logo-icon" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:HOME_URL="https://centos.org/" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T08:07:30.114 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T08:07:30.115 INFO:teuthology.orchestra.run.smithi164.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T08:07:30.115 INFO:teuthology.lock.ops:Updating smithi164.front.sepia.ceph.com on lock server 2024-03-27T08:07:30.133 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-03-27T08:07:30.151 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-03-27T08:07:30.151 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-03-27T08:07:30.208 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-03-27T08:07:30.208 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-03-27T08:07:30.208 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T08:07:30.209 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T08:07:30.210 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-03-27T08:07:30.233 DEBUG:teuthology.orchestra.run.smithi173:> uname -m 2024-03-27T08:07:30.250 INFO:teuthology.orchestra.run.smithi173.stdout:x86_64 2024-03-27T08:07:30.251 DEBUG:teuthology.orchestra.run.smithi173:> cat /etc/os-release 2024-03-27T08:07:30.307 INFO:teuthology.orchestra.run.smithi173.stdout:NAME="CentOS Stream" 2024-03-27T08:07:30.307 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION="9" 2024-03-27T08:07:30.307 INFO:teuthology.orchestra.run.smithi173.stdout:ID="centos" 2024-03-27T08:07:30.307 INFO:teuthology.orchestra.run.smithi173.stdout:ID_LIKE="rhel fedora" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:VERSION_ID="9" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:PLATFORM_ID="platform:el9" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:ANSI_COLOR="0;31" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:LOGO="fedora-logo-icon" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:HOME_URL="https://centos.org/" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-27T08:07:30.308 INFO:teuthology.orchestra.run.smithi173.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-27T08:07:30.308 INFO:teuthology.lock.ops:Updating smithi173.front.sepia.ceph.com on lock server 2024-03-27T08:07:30.333 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-27T08:07:30.346 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-27T08:07:30.358 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-27T08:07:30.358 DEBUG:teuthology.orchestra.run.smithi164:> test '!' -e /home/ubuntu/cephtest 2024-03-27T08:07:30.361 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-03-27T08:07:30.363 DEBUG:teuthology.orchestra.run.smithi173:> test '!' -e /home/ubuntu/cephtest 2024-03-27T08:07:30.378 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-27T08:07:30.384 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-27T08:07:30.384 DEBUG:teuthology.orchestra.run.smithi164:> test -z $(ls -A /var/lib/ceph) 2024-03-27T08:07:30.421 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-03-27T08:07:30.426 DEBUG:teuthology.orchestra.run.smithi173:> test -z $(ls -A /var/lib/ceph) 2024-03-27T08:07:30.528 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-27T08:07:30.601 INFO:teuthology.run_tasks:Running task kernel... 2024-03-27T08:07:30.617 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'} 2024-03-27T08:07:30.617 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': '1df0c7e8a2354c42d738e5454ba83ea7332deac2'}}, timeout 300 2024-03-27T08:07:30.618 DEBUG:teuthology.orchestra.run.smithi164:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T08:07:30.618 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T08:07:30.619 DEBUG:teuthology.orchestra.run.smithi173:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-27T08:07:30.635 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:07:30.636 DEBUG:teuthology.task.kernel:sha1 for mon.b is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.636 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-27T08:07:30.636 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-03-27T08:07:30.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:07:30.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:07:30.638 DEBUG:teuthology.task.kernel:sha1 for mon.c is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.638 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-27T08:07:30.638 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-03-27T08:07:30.639 DEBUG:teuthology.task.kernel:sha1 for mon.a is 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.639 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "1df0c7e8a2354c42d738e5454ba83ea7332deac2"... 2024-03-27T08:07:30.639 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-03-27T08:07:30.694 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-361.el9.x86_64 2024-03-27T08:07:30.694 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.695 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-27T08:07:30.695 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.699 INFO:teuthology.orchestra.run.smithi164.stdout:5.14.0-361.el9.x86_64 2024-03-27T08:07:30.699 INFO:teuthology.orchestra.run.smithi173.stdout:5.14.0-361.el9.x86_64 2024-03-27T08:07:30.700 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.700 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-27T08:07:30.700 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.701 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.701 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-03-27T08:07:30.701 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:07:30.843 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum upgrade -y linux-firmware 2024-03-27T08:07:30.849 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum upgrade -y linux-firmware 2024-03-27T08:07:30.854 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum upgrade -y linux-firmware 2024-03-27T08:07:33.238 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 8.5 MB/s | 6.7 MB 00:00 2024-03-27T08:07:33.427 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.7 MB 00:00 2024-03-27T08:07:33.447 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 7.2 MB/s | 6.7 MB 00:00 2024-03-27T08:07:34.633 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 7.1 MB/s | 2.0 MB 00:00 2024-03-27T08:07:35.093 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 3.5 MB/s | 2.0 MB 00:00 2024-03-27T08:07:35.139 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 3.4 MB/s | 2.0 MB 00:00 2024-03-27T08:07:35.781 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 9.9 MB/s | 8.0 MB 00:00 2024-03-27T08:07:36.134 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-27T08:07:36.621 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 7.0 MB/s | 8.0 MB 00:01 2024-03-27T08:07:38.010 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-03-27T08:07:40.798 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 19 MB 00:03 2024-03-27T08:07:41.953 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.1 MB 00:00 2024-03-27T08:07:43.387 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-03-27T08:07:44.321 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 25 MB/s | 21 MB 00:00 2024-03-27T08:07:44.740 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.1 MB 00:00 2024-03-27T08:07:46.082 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 16 kB 00:00 2024-03-27T08:07:47.859 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-27T08:07:49.163 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-27T08:07:51.144 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 19 MB 00:14 2024-03-27T08:07:51.414 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-27T08:07:51.422 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout:================================================================================ 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 1 Package 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 375 M 2024-03-27T08:07:51.423 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-03-27T08:07:52.742 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-27T08:07:55.053 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 1 Package 2024-03-27T08:07:55.062 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:07:55.063 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 375 M 2024-03-27T08:07:55.063 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-03-27T08:07:55.328 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.1 MB 00:00 2024-03-27T08:07:56.763 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 54 kB/s | 16 kB 00:00 2024-03-27T08:07:57.781 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 23 MB/s | 21 MB 00:00 2024-03-27T08:08:02.722 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-03-27T08:08:03.868 INFO:teuthology.orchestra.run.smithi167.stdout:linux-firmware-20240219-143.el9.noarch.rpm 43 MB/s | 375 MB 00:08 2024-03-27T08:08:03.869 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:08:03.869 INFO:teuthology.orchestra.run.smithi167.stdout:Total 43 MB/s | 375 MB 00:08 2024-03-27T08:08:03.869 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-03-27T08:08:03.959 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-03-27T08:08:03.959 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-03-27T08:08:04.977 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-03-27T08:08:04.989 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-03-27T08:08:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-03-27T08:08:04.989 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-03-27T08:08:04.989 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-03-27T08:08:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware noarch 20240219-143.el9 CentOS-BaseOS 375 M 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:================================================================================ 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 1 Package 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 375 M 2024-03-27T08:08:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-03-27T08:08:05.179 INFO:teuthology.orchestra.run.smithi173.stdout:linux-firmware-20240219-143.el9.noarch.rpm 27 MB/s | 375 MB 00:13 2024-03-27T08:08:05.180 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:08:05.181 INFO:teuthology.orchestra.run.smithi173.stdout:Total 27 MB/s | 375 MB 00:13 2024-03-27T08:08:05.181 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-03-27T08:08:05.265 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-03-27T08:08:05.265 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-03-27T08:08:06.488 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-03-27T08:08:06.488 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-03-27T08:08:07.661 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-03-27T08:08:07.661 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-03-27T08:08:12.673 INFO:teuthology.orchestra.run.smithi164.stdout:linux-firmware-20240219-143.el9.noarch.rpm 49 MB/s | 375 MB 00:07 2024-03-27T08:08:12.674 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:08:12.674 INFO:teuthology.orchestra.run.smithi164.stdout:Total 49 MB/s | 375 MB 00:07 2024-03-27T08:08:12.675 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-03-27T08:08:12.770 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-03-27T08:08:12.770 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-03-27T08:08:12.899 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-03-27T08:08:13.137 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:13.227 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:14.217 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-03-27T08:08:14.507 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:14.579 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:14.583 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:14.583 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:08:14.947 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-03-27T08:08:15.233 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-03-27T08:08:15.233 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-03-27T08:08:15.241 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-27T08:08:15.241 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:08:15.587 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-27T08:08:15.588 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-27T08:08:15.590 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi167.front.sepia.ceph.com to complete... 2024-03-27T08:08:15.811 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:15.811 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:08:16.231 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-03-27T08:08:16.540 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.c... 2024-03-27T08:08:16.541 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:08:16.766 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-27T08:08:16.767 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-27T08:08:16.769 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi173.front.sepia.ceph.com to complete... 2024-03-27T08:08:21.582 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-03-27T08:08:21.809 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:21.889 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:23.287 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:23.287 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: linux-firmware-20240219-143.el9.noarch 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:08:23.677 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-03-27T08:08:23.983 INFO:teuthology.task.kernel:Downloading kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-27T08:08:23.984 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=1df0c7e8a2354c42d738e5454ba83ea7332deac2 2024-03-27T08:08:24.124 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ 2024-03-27T08:08:24.125 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/ --input-file=- 2024-03-27T08:08:24.127 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi164.front.sepia.ceph.com to complete... 2024-03-27T08:08:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27 08:08:28 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-27T08:08:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:FINISHED --2024-03-27 08:08:28-- 2024-03-27T08:08:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:Total wall clock time: 13s 2024-03-27T08:08:28.941 INFO:teuthology.orchestra.run.smithi167.stderr:Downloaded: 1 files, 321M in 13s (24.6 MB/s) 2024-03-27T08:08:28.943 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.b... 2024-03-27T08:08:28.944 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-27T08:08:30.883 INFO:teuthology.orchestra.run.smithi167.stdout:Verifying... ######################################## 2024-03-27T08:08:30.970 INFO:teuthology.orchestra.run.smithi167.stdout:Preparing... ######################################## 2024-03-27T08:08:31.051 INFO:teuthology.orchestra.run.smithi167.stdout:Updating / installing... 2024-03-27T08:08:38.638 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-27T08:08:44.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27 08:08:44 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-27T08:08:44.399 INFO:teuthology.orchestra.run.smithi164.stderr:FINISHED --2024-03-27 08:08:44-- 2024-03-27T08:08:44.399 INFO:teuthology.orchestra.run.smithi164.stderr:Total wall clock time: 20s 2024-03-27T08:08:44.399 INFO:teuthology.orchestra.run.smithi164.stderr:Downloaded: 1 files, 321M in 20s (16.3 MB/s) 2024-03-27T08:08:44.402 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.a... 2024-03-27T08:08:44.402 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-27T08:08:46.337 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying... ######################################## 2024-03-27T08:08:46.389 INFO:teuthology.orchestra.run.smithi164.stdout:Preparing... ######################################## 2024-03-27T08:08:46.468 INFO:teuthology.orchestra.run.smithi164.stdout:Updating / installing... 2024-03-27T08:08:49.084 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27 08:08:49 URL:https://3.chacra.ceph.com/r/kernel/testing/1df0c7e8a2354c42d738e5454ba83ea7332deac2/centos/9/flavors/default/x86_64/kernel-6.8.0_g1df0c7e8a235-1.x86_64.rpm [336317861/336317861] -> "/tmp/kernel.x86_64.rpm" [1] 2024-03-27T08:08:49.084 INFO:teuthology.orchestra.run.smithi173.stderr:FINISHED --2024-03-27 08:08:49-- 2024-03-27T08:08:49.084 INFO:teuthology.orchestra.run.smithi173.stderr:Total wall clock time: 32s 2024-03-27T08:08:49.084 INFO:teuthology.orchestra.run.smithi173.stderr:Downloaded: 1 files, 321M in 32s (10.1 MB/s) 2024-03-27T08:08:49.087 INFO:teuthology.task.kernel:Installing kernel 1df0c7e8a2354c42d738e5454ba83ea7332deac2 on mon.c... 2024-03-27T08:08:49.087 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-03-27T08:08:51.055 INFO:teuthology.orchestra.run.smithi173.stdout:Verifying... ######################################## 2024-03-27T08:08:51.199 INFO:teuthology.orchestra.run.smithi173.stdout:Preparing... ######################################## 2024-03-27T08:08:51.278 INFO:teuthology.orchestra.run.smithi173.stdout:Updating / installing... 2024-03-27T08:08:54.043 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-27T08:08:55.147 INFO:teuthology.orchestra.run.smithi167.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T08:08:58.770 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-6.8.0_g1df0c7e8a235-1 ######################################## 2024-03-27T08:09:09.797 INFO:teuthology.orchestra.run.smithi164.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T08:09:13.117 INFO:teuthology.orchestra.run.smithi173.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-27T08:09:17.598 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-27T08:09:17.599 DEBUG:teuthology.orchestra.run.smithi167:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-27T08:09:17.677 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-27T08:09:17.678 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-27T08:09:17.679 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-27T08:09:17.680 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-27T08:09:17.681 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-27T08:09:17.682 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-27T08:09:17.683 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-27T08:09:17.683 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-27T08:09:17.683 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-27T08:09:17.685 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-27T08:09:17.686 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-27T08:09:17.687 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-27T08:09:17.688 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-27T08:09:17.689 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-27T08:09:17.690 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-27T08:09:17.691 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-27T08:09:17.692 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-27T08:09:17.693 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-27T08:09:17.694 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-27T08:09:17.695 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-27T08:09:17.696 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-27T08:09:17.697 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-27T08:09:17.698 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-27T08:09:17.699 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-27T08:09:17.700 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-27T08:09:17.701 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-27T08:09:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-27T08:09:17.703 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-27T08:09:17.704 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-27T08:09:17.705 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-27T08:09:17.706 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-27T08:09:17.707 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-27T08:09:17.708 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-27T08:09:17.709 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-27T08:09:17.710 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-27T08:09:17.711 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-27T08:09:17.712 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-27T08:09:17.713 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-27T08:09:17.714 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-27T08:09:17.715 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-27T08:09:17.716 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-27T08:09:17.717 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-27T08:09:17.718 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-27T08:09:17.719 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-27T08:09:17.720 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-27T08:09:17.721 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-27T08:09:17.722 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-27T08:09:17.723 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-27T08:09:17.724 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-27T08:09:17.725 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-27T08:09:17.726 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-27T08:09:17.727 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-27T08:09:17.728 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-27T08:09:17.729 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-27T08:09:17.730 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-27T08:09:17.731 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-27T08:09:17.732 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-27T08:09:17.733 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-27T08:09:17.734 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-27T08:09:17.735 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-27T08:09:17.736 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-27T08:09:17.737 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-27T08:09:17.738 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-27T08:09:17.739 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-27T08:09:17.740 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-27T08:09:17.741 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-27T08:09:17.742 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-27T08:09:17.743 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-27T08:09:17.744 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-27T08:09:17.745 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-27T08:09:17.746 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-27T08:09:17.747 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-27T08:09:17.748 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-27T08:09:17.749 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-27T08:09:17.750 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-27T08:09:17.751 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-27T08:09:17.752 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-27T08:09:17.753 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-27T08:09:17.754 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-27T08:09:17.755 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-27T08:09:17.756 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-27T08:09:17.757 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-27T08:09:17.758 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-27T08:09:17.759 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-27T08:09:17.760 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-27T08:09:17.761 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-27T08:09:17.762 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-27T08:09:17.763 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-27T08:09:17.764 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-27T08:09:17.765 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-27T08:09:17.766 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-27T08:09:17.767 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-27T08:09:17.768 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-27T08:09:17.769 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-27T08:09:17.770 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-27T08:09:17.771 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-27T08:09:17.772 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-27T08:09:17.773 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-27T08:09:17.774 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-27T08:09:17.775 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-27T08:09:17.776 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-27T08:09:17.777 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-27T08:09:17.778 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-27T08:09:17.779 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-27T08:09:17.780 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-27T08:09:17.781 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-27T08:09:17.782 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-27T08:09:17.783 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-27T08:09:17.784 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-27T08:09:17.785 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-27T08:09:17.786 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-27T08:09:17.787 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-27T08:09:17.788 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-27T08:09:17.789 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-27T08:09:17.790 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-27T08:09:17.791 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-27T08:09:17.792 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-27T08:09:17.793 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-27T08:09:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-27T08:09:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-27T08:09:17.796 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-27T08:09:17.797 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-27T08:09:17.798 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-27T08:09:17.799 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-27T08:09:17.800 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-27T08:09:17.801 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-27T08:09:17.802 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-27T08:09:17.803 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-27T08:09:17.804 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-27T08:09:17.805 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-27T08:09:17.806 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-27T08:09:17.807 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-27T08:09:17.808 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-27T08:09:17.809 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-27T08:09:17.810 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-27T08:09:17.811 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-27T08:09:17.812 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-27T08:09:17.813 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-27T08:09:17.814 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-27T08:09:17.815 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-27T08:09:17.816 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-27T08:09:17.817 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-27T08:09:17.818 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-27T08:09:17.819 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-27T08:09:17.820 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-27T08:09:17.821 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-27T08:09:17.822 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-27T08:09:17.823 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-27T08:09:17.824 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-27T08:09:17.825 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-27T08:09:17.826 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-27T08:09:17.827 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-27T08:09:17.828 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-27T08:09:17.829 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-27T08:09:17.830 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-27T08:09:17.831 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-27T08:09:17.832 INFO:teuthology.orchestra.run.smithi167.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:17.836 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-27T08:09:17.836 DEBUG:teuthology.orchestra.run.smithi167:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout:postinstall scriptlet (using /bin/sh): 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout:for file in vmlinuz System.map config; do 2024-03-27T08:09:17.858 INFO:teuthology.orchestra.run.smithi167.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout: fi 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout:done 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-27T08:09:17.859 INFO:teuthology.orchestra.run.smithi167.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:17.860 INFO:teuthology.orchestra.run.smithi167.stdout:fi 2024-03-27T08:09:17.861 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-03-27T08:09:17.935 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 68.el9 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8264254 2024-03-27T08:09:17.936 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:09:17.937 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T08:09:17.938 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T08:09:17.938 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T08:09:17.938 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-03-27T08:09:17.938 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:09:17.938 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T08:09:17.939 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T08:09:17.940 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 6.8.0-g1df0c7e8a235 2024-03-27T08:09:17.940 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T08:09:18.541 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-03-27T08:09:19.902 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T08:09:19.942 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-03-27T08:09:19.945 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-03-27T08:09:19.960 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.nJOKhxWF5B 2024-03-27T08:09:19.960 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.nJOKhxWF5B 2024-03-27T08:09:20.049 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.nJOKhxWF5B 2024-03-27T08:09:20.154 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.nJOKhxWF5B is 6KB 2024-03-27T08:09:20.202 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.nJOKhxWF5B 2024-03-27T08:09:20.216 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T08:09:20.281 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T08:09:20.281 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T08:09:20.281 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T08:09:20.281 INFO:teuthology.orchestra.run.smithi167.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-27T08:09:20.283 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-27T08:09:20.445 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-03-27T08:09:32.183 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi164.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-27T08:09:32.184 DEBUG:teuthology.orchestra.run.smithi164:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-27T08:09:32.268 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-27T08:09:32.269 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-27T08:09:32.270 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-27T08:09:32.271 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-27T08:09:32.272 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-27T08:09:32.273 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-27T08:09:32.274 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-27T08:09:32.275 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-27T08:09:32.276 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-27T08:09:32.277 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-27T08:09:32.278 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-27T08:09:32.279 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-27T08:09:32.280 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-27T08:09:32.281 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-27T08:09:32.282 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-27T08:09:32.283 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-27T08:09:32.284 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-27T08:09:32.285 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-27T08:09:32.286 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-27T08:09:32.287 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-27T08:09:32.288 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-27T08:09:32.289 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-27T08:09:32.290 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-27T08:09:32.291 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-27T08:09:32.292 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-27T08:09:32.293 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-27T08:09:32.294 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-27T08:09:32.295 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-27T08:09:32.296 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-27T08:09:32.297 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-27T08:09:32.298 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-27T08:09:32.299 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-27T08:09:32.300 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-27T08:09:32.301 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-27T08:09:32.302 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-27T08:09:32.303 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-27T08:09:32.304 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-27T08:09:32.305 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-27T08:09:32.306 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-27T08:09:32.307 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-27T08:09:32.308 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-27T08:09:32.309 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-27T08:09:32.310 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-27T08:09:32.311 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-27T08:09:32.312 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-27T08:09:32.313 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-27T08:09:32.314 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-27T08:09:32.315 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-27T08:09:32.316 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-27T08:09:32.317 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-27T08:09:32.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-27T08:09:32.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-27T08:09:32.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-27T08:09:32.318 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-27T08:09:32.319 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-27T08:09:32.320 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-27T08:09:32.321 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-27T08:09:32.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-27T08:09:32.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-27T08:09:32.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-27T08:09:32.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-27T08:09:32.322 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-27T08:09:32.323 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-27T08:09:32.324 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-27T08:09:32.325 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-27T08:09:32.326 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-27T08:09:32.327 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-27T08:09:32.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-27T08:09:32.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-27T08:09:32.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-27T08:09:32.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-27T08:09:32.328 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-27T08:09:32.329 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-27T08:09:32.330 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-27T08:09:32.331 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-27T08:09:32.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-27T08:09:32.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-27T08:09:32.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-27T08:09:32.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-27T08:09:32.332 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-27T08:09:32.333 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-27T08:09:32.334 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-27T08:09:32.335 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-27T08:09:32.336 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-27T08:09:32.337 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-27T08:09:32.338 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-27T08:09:32.339 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-27T08:09:32.340 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-27T08:09:32.341 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-27T08:09:32.342 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-27T08:09:32.343 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-27T08:09:32.344 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-27T08:09:32.345 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-27T08:09:32.346 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-27T08:09:32.347 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-27T08:09:32.348 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-27T08:09:32.349 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-27T08:09:32.350 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-27T08:09:32.351 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-27T08:09:32.352 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-27T08:09:32.353 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-27T08:09:32.354 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-27T08:09:32.355 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-27T08:09:32.356 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-27T08:09:32.357 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-27T08:09:32.358 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-27T08:09:32.359 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-27T08:09:32.360 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-27T08:09:32.361 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-27T08:09:32.362 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-27T08:09:32.363 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-27T08:09:32.364 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-27T08:09:32.365 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-27T08:09:32.366 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-27T08:09:32.367 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-27T08:09:32.368 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-27T08:09:32.369 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-27T08:09:32.370 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-27T08:09:32.371 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-27T08:09:32.372 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-27T08:09:32.373 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-27T08:09:32.374 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-27T08:09:32.375 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-27T08:09:32.376 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-27T08:09:32.377 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-27T08:09:32.378 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-27T08:09:32.379 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-27T08:09:32.380 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-27T08:09:32.381 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-27T08:09:32.382 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-27T08:09:32.383 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-27T08:09:32.384 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-27T08:09:32.385 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-27T08:09:32.386 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-27T08:09:32.387 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-27T08:09:32.388 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-27T08:09:32.389 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-27T08:09:32.390 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-27T08:09:32.391 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-27T08:09:32.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-27T08:09:32.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-27T08:09:32.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-27T08:09:32.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-27T08:09:32.392 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-27T08:09:32.393 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-27T08:09:32.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-27T08:09:32.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-27T08:09:32.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-27T08:09:32.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-27T08:09:32.394 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-27T08:09:32.395 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-27T08:09:32.396 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-27T08:09:32.397 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-27T08:09:32.398 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-27T08:09:32.399 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-27T08:09:32.400 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-27T08:09:32.401 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-27T08:09:32.402 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-27T08:09:32.403 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-27T08:09:32.404 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-27T08:09:32.405 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-27T08:09:32.406 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-27T08:09:32.407 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-27T08:09:32.408 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-27T08:09:32.409 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-27T08:09:32.410 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-27T08:09:32.411 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-27T08:09:32.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-27T08:09:32.412 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-27T08:09:32.415 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-27T08:09:32.416 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-27T08:09:32.417 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-27T08:09:32.418 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-27T08:09:32.419 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-27T08:09:32.420 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-27T08:09:32.421 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-27T08:09:32.422 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-27T08:09:32.423 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-27T08:09:32.424 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-27T08:09:32.425 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-27T08:09:32.426 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-27T08:09:32.427 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-27T08:09:32.428 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-27T08:09:32.429 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-27T08:09:32.430 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-27T08:09:32.431 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-27T08:09:32.432 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-27T08:09:32.433 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-27T08:09:32.434 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-27T08:09:32.435 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-27T08:09:32.436 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-27T08:09:32.437 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-27T08:09:32.438 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-27T08:09:32.439 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-27T08:09:32.440 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-27T08:09:32.441 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-27T08:09:32.442 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-27T08:09:32.443 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-27T08:09:32.444 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-27T08:09:32.445 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-27T08:09:32.446 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-27T08:09:32.447 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-27T08:09:32.448 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-27T08:09:32.449 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-27T08:09:32.450 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-27T08:09:32.451 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-27T08:09:32.452 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-27T08:09:32.453 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-27T08:09:32.454 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-27T08:09:32.455 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-27T08:09:32.456 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-27T08:09:32.457 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-27T08:09:32.458 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-27T08:09:32.459 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-27T08:09:32.460 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-27T08:09:32.461 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-27T08:09:32.462 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-27T08:09:32.463 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-27T08:09:32.464 INFO:teuthology.orchestra.run.smithi164.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:32.468 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-27T08:09:32.468 DEBUG:teuthology.orchestra.run.smithi164:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:32.490 INFO:teuthology.orchestra.run.smithi164.stdout:postinstall scriptlet (using /bin/sh): 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:for file in vmlinuz System.map config; do 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout: fi 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:done 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-27T08:09:32.491 INFO:teuthology.orchestra.run.smithi164.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:32.492 INFO:teuthology.orchestra.run.smithi164.stdout:fi 2024-03-27T08:09:32.493 DEBUG:teuthology.orchestra.run.smithi164:> sudo rpm -qi grub2-tools 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Name : grub2-tools 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Epoch : 1 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Version : 2.06 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Release : 68.el9 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Architecture: x86_64 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Group : Unspecified 2024-03-27T08:09:32.568 INFO:teuthology.orchestra.run.smithi164.stdout:Size : 8264254 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:License : GPLv3+ 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Packager : builder@centos.org 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Vendor : CentOS 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Summary : Support tools for GRUB. 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:Description : 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T08:09:32.569 INFO:teuthology.orchestra.run.smithi164.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T08:09:32.570 INFO:teuthology.orchestra.run.smithi164.stdout:hardware devices. 2024-03-27T08:09:32.570 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:09:32.570 INFO:teuthology.orchestra.run.smithi164.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T08:09:32.571 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T08:09:32.571 INFO:teuthology.task.kernel:Updating grub on smithi164 to boot 6.8.0-g1df0c7e8a235 2024-03-27T08:09:32.571 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T08:09:33.135 INFO:teuthology.orchestra.run.smithi164.stderr:Generating grub configuration file ... 2024-03-27T08:09:34.590 INFO:teuthology.orchestra.run.smithi164.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T08:09:34.630 INFO:teuthology.orchestra.run.smithi164.stderr:done 2024-03-27T08:09:34.632 DEBUG:teuthology.orchestra.run.smithi164:> mktemp 2024-03-27T08:09:34.647 INFO:teuthology.orchestra.run.smithi164.stdout:/tmp/tmp.Y9lHbmJFqX 2024-03-27T08:09:34.648 DEBUG:teuthology.orchestra.run.smithi164:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Y9lHbmJFqX 2024-03-27T08:09:34.717 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0666 /tmp/tmp.Y9lHbmJFqX 2024-03-27T08:09:34.853 DEBUG:teuthology.orchestra.remote:smithi164:/tmp/tmp.Y9lHbmJFqX is 6KB 2024-03-27T08:09:34.901 DEBUG:teuthology.orchestra.run.smithi164:> rm -fr /tmp/tmp.Y9lHbmJFqX 2024-03-27T08:09:34.915 DEBUG:teuthology.orchestra.run.smithi164:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T08:09:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T08:09:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T08:09:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T08:09:34.980 INFO:teuthology.orchestra.run.smithi164.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-27T08:09:34.981 DEBUG:teuthology.orchestra.run.smithi164:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.129 DEBUG:teuthology.orchestra.run.smithi164:> sudo shutdown -r now 2024-03-27T08:09:35.522 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi173.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-03-27T08:09:35.522 DEBUG:teuthology.orchestra.run.smithi173:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:35.598 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.598 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/System.map 2024-03-27T08:09:35.598 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/config 2024-03-27T08:09:35.598 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crc32c-intel.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-03-27T08:09:35.599 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-avx2.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-03-27T08:09:35.600 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-amd.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm-intel.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/arch/x86/kvm/kvm.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ansi_cprng.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/anubis.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/arc4.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_memcpy.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_pq.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_raid6_recov.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_tx.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/async_xor.ko 2024-03-27T08:09:35.601 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/async_tx/raid6test.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authenc.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/authencesn.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blake2b_generic.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_common.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/blowfish_generic.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/camellia_generic.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast5_generic.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast6_generic.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cast_common.ko 2024-03-27T08:09:35.602 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/ccm.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cmac.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crc32_generic.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_engine.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/crypto_user.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/cts.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/des_generic.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/dh_generic.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/echainiv.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/essiv.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/fcrypt.ko 2024-03-27T08:09:35.603 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/khazad.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/lz4hc.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/md4.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/michael_mic.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcbc.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/pcrypt.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/rmd160.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/seed.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/serpent_generic.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tcrypt.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/tea.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_common.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/twofish_generic.ko 2024-03-27T08:09:35.604 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/vmac.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/wp512.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xcbc.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xor.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/crypto/xxhash_generic.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_ipmi.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/acpi_pad.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/custom_method.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/ec_sys.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/platform_profile.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbs.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/sbshc.ko 2024-03-27T08:09:35.605 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/acpi/video.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/acard-ahci.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ahci_platform.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/ata_generic.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/libahci_platform.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_acpi.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ali.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_amd.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_artop.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atiixp.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_atp867x.ko 2024-03-27T08:09:35.606 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd640.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cmd64x.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_cypress.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_efar.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt366.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt37x.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x2n.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_hpt3x3.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it8213.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_it821x.ko 2024-03-27T08:09:35.607 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_jmicron.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_marvell.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_mpiix.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_netcell.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ninja32.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87410.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_ns87415.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_oldpiix.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_opti.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_optidma.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pcmcia.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc2027x.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_piccolo.ko 2024-03-27T08:09:35.608 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_rdc.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sch.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_serverworks.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sil680.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sis.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_sl82c105.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_triflex.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pata_via.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/pdc_adma.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_inic162x.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_mv.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_nv.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_promise.ko 2024-03-27T08:09:35.609 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_qstor.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sil24.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sis.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_svw.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_sx4.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_uli.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_via.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ata/sata_vsc.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/auxdisplay/ks0108.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-i2c.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/base/regmap/regmap-mmio.ko 2024-03-27T08:09:35.610 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/bcma/bcma.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/aoe/aoe.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/brd.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/drbd/drbd.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/floppy.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/loop.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/nbd.ko 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk 2024-03-27T08:09:35.611 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/null_blk/null_blk.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/pktcdvd.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/rbd.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/virtio_blk.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/xen-blkfront.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/block/zram/zram.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hangcheck-timer.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/amd-rng.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/intel-rng.ko 2024-03-27T08:09:35.612 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-03-27T08:09:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/via-rng.ko 2024-03-27T08:09:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/hw_random/virtio-rng.ko 2024-03-27T08:09:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi 2024-03-27T08:09:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-03-27T08:09:35.613 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-03-27T08:09:35.616 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-03-27T08:09:35.616 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_si.ko 2024-03-27T08:09:35.616 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/lp.ko 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/mwave/mwave.ko 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/ppdev.ko 2024-03-27T08:09:35.617 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tlclk.ko 2024-03-27T08:09:35.618 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm 2024-03-27T08:09:35.618 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm.ko 2024-03-27T08:09:35.618 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_atmel.ko 2024-03-27T08:09:35.618 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_infineon.ko 2024-03-27T08:09:35.618 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_nsc.ko 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis.ko 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/uv_mmtimer.ko 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/char/virtio_console.ko 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq 2024-03-27T08:09:35.619 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-03-27T08:09:35.620 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-03-27T08:09:35.620 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/p4-clockmod.ko 2024-03-27T08:09:35.620 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-03-27T08:09:35.621 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/powernow-k8.ko 2024-03-27T08:09:35.621 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/cpufreq/speedstep-lib.ko 2024-03-27T08:09:35.621 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto 2024-03-27T08:09:35.621 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/ccp/ccp.ko 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common 2024-03-27T08:09:35.622 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-aes.ko 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/padlock-sha.ko 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio 2024-03-27T08:09:35.623 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dca/dca.ko 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma 2024-03-27T08:09:35.624 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw 2024-03-27T08:09:35.625 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/dw/dw_dmac.ko 2024-03-27T08:09:35.625 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat 2024-03-27T08:09:35.625 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/dma/ioat/ioatdma.ko 2024-03-27T08:09:35.625 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac 2024-03-27T08:09:35.625 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/amd64_edac.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/e752x_edac.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/edac_mce_amd.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3000_edac.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i3200_edac.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5100_edac.ko 2024-03-27T08:09:35.626 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i5400_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7300_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i7core_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/i82975x_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/ie31200_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/sb_edac.ko 2024-03-27T08:09:35.627 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/edac/x38_edac.ko 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/edd.ko 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/firmware/iscsi_ibft.ko 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-ich.ko 2024-03-27T08:09:35.628 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/gpio/gpio-viperboard.ko 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-appleir.ko 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-aureal.ko 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-axff.ko 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-dr.ko 2024-03-27T08:09:35.629 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elecom.ko 2024-03-27T08:09:35.630 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-elo.ko 2024-03-27T08:09:35.630 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-emsff.ko 2024-03-27T08:09:35.630 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gaff.ko 2024-03-27T08:09:35.630 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gt683r.ko 2024-03-27T08:09:35.630 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-gyration.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-kbd.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtek-mouse.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-holtekff.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-hyperv.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-icade.ko 2024-03-27T08:09:35.631 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-keytouch.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-kye.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lcpower.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-led.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-lenovo.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-dj.ko 2024-03-27T08:09:35.632 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-multitouch.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-ortek.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-penmount.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-petalynx.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-picolcd.ko 2024-03-27T08:09:35.633 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-pl.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-plantronics.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-primax.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-rmi.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-arvo.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-common.ko 2024-03-27T08:09:35.634 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-isku.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kone.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-konepure.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-lua.ko 2024-03-27T08:09:35.635 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-pyra.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-ryos.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat-savu.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-roccat.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-saitek.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-samsung.ko 2024-03-27T08:09:35.636 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sensor-hub.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sjoy.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sony.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-speedlink.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-steelseries.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-sunplus.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-thrustmaster.ko 2024-03-27T08:09:35.637 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tivo.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-tmff.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-topseed.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-twinhan.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-uclogic.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-waltop.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-wiimote.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-xinmo.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zpff.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/hid-zydacron.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/uhid.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hid/wacom.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_balloon.ko 2024-03-27T08:09:35.638 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_utils.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hv/hv_vmbus.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/abituguru3.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/acpi_power_meter.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7414.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ad7418.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adc128d818.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1025.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1026.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1029.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm1031.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adm9240.ko 2024-03-27T08:09:35.639 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ads7828.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7410.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7411.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7462.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7470.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7475.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/adt7x10.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/amc6821.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/applesmc.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asb100.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asc7621.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/asus_atk0110.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/atxp1.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/coretemp.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-03-27T08:09:35.640 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/dme1737.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds1621.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ds620.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc1403.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/emc6w201.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71805f.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f71882fg.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/f75375s.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fam15h_power.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/fschmd.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g760a.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/g762.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl518sm.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/gl520sm.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/hwmon-vid.ko 2024-03-27T08:09:35.641 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5500_temp.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/i5k_amb.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmaem.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ibmpex.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina209.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ina2xx.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/it87.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k10temp.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/k8temp.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lineage-pem.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm63.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm73.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm75.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm77.ko 2024-03-27T08:09:35.642 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm78.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm80.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm83.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm85.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm87.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm90.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm92.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm93.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95234.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95241.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/lm95245.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc2945.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4151.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4215.ko 2024-03-27T08:09:35.643 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4222.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4245.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4260.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/ltc4261.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max16065.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1619.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max1668.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max197.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6639.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6650.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/max6697.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/mcp3021.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6683.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775-core.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct6775.ko 2024-03-27T08:09:35.644 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/nct7802.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87360.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pc87427.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pcf8591.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max16064.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max34440.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/max8688.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-03-27T08:09:35.645 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/powr1220.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5627.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch5636.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sch56xx-common.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht15.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sht21.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/shtc1.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/sis5595.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47b397.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m1.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/smsc47m192.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/thmc50.ko 2024-03-27T08:09:35.646 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp102.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp103.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp401.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/tmp421.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via-cputemp.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/via686a.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt1211.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/vt8231.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627ehf.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83627hf.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83781d.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83791d.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83792d.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83793.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83795.ko 2024-03-27T08:09:35.647 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l785ts.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/hwmon/w83l786ng.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-03-27T08:09:35.648 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-i801.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-isch.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-parport.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-via.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-03-27T08:09:35.649 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-dev.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-mux.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-smbus.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/i2c/i2c-stub.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_cm.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_core.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_umad.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/iw_cm.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_cm.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-03-27T08:09:35.650 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-03-27T08:09:35.651 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/fm801-gp.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/gameport/gameport.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/joydev.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/keyboard/gpio_keys.ko 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse 2024-03-27T08:09:35.652 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/appletouch.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/bcm5974.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/cyapatp.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/elan_i2c.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/sermouse.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/synaptics_usb.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/mouse/vsxxxaa.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/rmi4/rmi_core.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/altera_ps2.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/arc_ps2.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-03-27T08:09:35.653 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/serio/serio_raw.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/input/sparse-keymap.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-blinkm.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lm3530.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-lp3944.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/leds-ss4200.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-03-27T08:09:35.654 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/bcache/bcache.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-bio-prison.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache-smq.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-cache.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-crypt.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-delay.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-flakey.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-log-userspace.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-multipath.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-queue-length.ko 2024-03-27T08:09:35.655 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-raid.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-round-robin.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-service-time.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-switch.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-thin-pool.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/dm-verity.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid0.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid1.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid10.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/md/raid456.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptbase.ko 2024-03-27T08:09:35.656 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptctl.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptfc.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptlan.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptsas.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptscsih.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/message/fusion/mptspi.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_ich.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/lpc_sch.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/mfd-core.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/sm501.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/viperboard.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/vx855.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/mfd/wl1273-core.ko 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc 2024-03-27T08:09:35.657 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds9802als.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/apds990x.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/bh1770glc.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/cb710/cb710.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/at24.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/eeprom/max6875.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/enclosure.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/hpilo.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29003.ko 2024-03-27T08:09:35.658 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/isl29020.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-me.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei-txe.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/mei/mei.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-gru/gru.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xp.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpc.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-03-27T08:09:35.659 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_7xx1.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tifm_core.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/tsl2550.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_balloon.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/bonding/bonding.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/b53/b53_common.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/bcm-sf2.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6060.ko 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx 2024-03-27T08:09:35.660 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/dummy.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/eql.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/8390.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-03-27T08:09:35.661 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/agere/et131x.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx 2024-03-27T08:09:35.662 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet 2024-03-27T08:09:35.663 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-03-27T08:09:35.664 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-03-27T08:09:35.665 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/dnet.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ethoc.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/fealnx.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e100.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-03-27T08:09:35.666 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/jme.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-03-27T08:09:35.667 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/skge.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi 2024-03-27T08:09:35.668 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-03-27T08:09:35.669 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/atp.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis 2024-03-27T08:09:35.670 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis190.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sis/sis900.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/cassini.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/niu.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sungem.ko 2024-03-27T08:09:35.671 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/ti/tlan.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/geneve.ko 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv 2024-03-27T08:09:35.672 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ieee802154/fakelb.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ifb.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ipvlan/ipvlan.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvlan.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/macvtap.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mdio/mdio-regmap.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/mii.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/net_failover.ko 2024-03-27T08:09:35.673 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/netconsole.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/nlmon.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs-lynx.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/amd.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm7xxx.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/bcm87xx.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/broadcom.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/cicada.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/davicom.ko 2024-03-27T08:09:35.674 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/dp83640.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/et1011c.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/icplus.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/lxt.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/marvell.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/micrel.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/national.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/phylink.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/qsemi.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/realtek.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/smsc.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/ste10Xp.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/phy/vitesse.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/bsd_comp.ko 2024-03-27T08:09:35.675 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_async.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_deflate.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_generic.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_mppe.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/ppp_synctty.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppoe.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pppox.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/ppp/pptp.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slhc.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/slip/slip.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/sungem_phy.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tap.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team.ko 2024-03-27T08:09:35.676 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_activebackup.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_broadcast.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_random.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/tun.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/veth.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/virtio_net.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/vxlan/vxlan.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netback/xen-netback.ko 2024-03-27T08:09:35.677 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/net/xen-netfront.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ntb/ntb.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme-core.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/nvme/host/nvme.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_cs.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_pc.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/parport/parport_serial.ko 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug 2024-03-27T08:09:35.678 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/pcie/aer_inject.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pci/xen-pcifront.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/i82092.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/pd6729.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pcmcia/yenta_socket.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acer-wmi.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/acerhdf.ko 2024-03-27T08:09:35.679 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/apple-gmux.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-laptop.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/asus-wmi.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/classmate-laptop.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/hdaps.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/intel_ips.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/msi-wmi.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/mxm-wmi.ko 2024-03-27T08:09:35.680 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-laptop.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/samsung-q10.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/topstar-laptop.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/toshiba_haps.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi-bmof.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/platform/x86/wmi.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_common.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/powercap/intel_rapl_msr.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-gpio.ko 2024-03-27T08:09:35.681 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps-ldisc.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/clients/pps_parport.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/pps/pps_core.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ptp/ptp_kvm.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-bq32k.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1286.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1307.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1374.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1511.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1553.ko 2024-03-27T08:09:35.682 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1672.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds1742.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds2404.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-ds3232.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-em3027.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-fm3130.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl12022.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-isl1208.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m41t80.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t35.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-m48t59.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-max6900.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-msm6242.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf2127.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf85063.ko 2024-03-27T08:09:35.683 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8523.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8563.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-pcf8583.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rp5c01.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rs5c372.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8025.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-rx8581.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/rtc/rtc-x1205.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-9xxx.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-sas.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/3w-xxxx.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/BusLogic.ko 2024-03-27T08:09:35.684 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/a100u2w.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aacraid/aacraid.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/advansys.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/am53c974.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/atp870u.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa 2024-03-27T08:09:35.685 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bfa/bfa.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ch.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/csiostor/csiostor.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dc395x.ko 2024-03-27T08:09:35.686 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/dmx3191d.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esas2r/esas2r.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/esp_scsi.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/fcoe.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/fnic/fnic.ko 2024-03-27T08:09:35.687 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hpsa.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hptiop.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/hv_storvsc.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/initio.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ipr.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ips.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/isci/isci.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/iscsi_tcp.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libfc/libfc.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libiscsi_tcp.ko 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas 2024-03-27T08:09:35.688 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/libsas/libsas.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/lpfc/lpfc.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvsas/mvsas.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/mvumi.ko 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001 2024-03-27T08:09:35.689 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/pmcraid.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla1280.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/raid_class.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_debug.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_fc.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_sas.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_spi.ko 2024-03-27T08:09:35.690 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/scsi_transport_srp.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/ses.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/st.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/stex.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/virtio_scsi.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/vmw_pvscsi.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/scsi/wd719x.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ssb/ssb.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-03-27T08:09:35.691 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/loopback/tcm_loop.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_file.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_iblock.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_mod.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_pscsi.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/target_core_user.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-03-27T08:09:35.692 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-03-27T08:09:35.693 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_gsm.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/n_hdlc.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/nozomi.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/arc_uart.ko 2024-03-27T08:09:35.694 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/tty/serial/jsm/jsm.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/core/ufshcd-core.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_aec.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_cif.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_pci_generic.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/uio/uio_sercos3.ko 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class 2024-03-27T08:09:35.695 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-acm.ko 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/cdc-wdm.ko 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usblp.ko 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/class/usbtmc.ko 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/host/sl811-hcd.ko 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image 2024-03-27T08:09:35.696 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/mdc800.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/image/microtek.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/adutux.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/appledisplay.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi26.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/emi62.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ezusb.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/idmouse.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/iowarrior.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/isight_firmware.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/ldusb.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/legousbtower.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-03-27T08:09:35.698 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/trancevibrator.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usb3503.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usblcd.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/usbsevseg.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/uss720.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/misc/yurex.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/phy/phy-generic.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/aircable.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ark3116.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/belkin_sa.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ch341.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cp210x.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cyberjack.ko 2024-03-27T08:09:35.699 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/cypress_m8.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/digi_acceleport.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/empeg.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ftdi_sio.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/garmin_gps.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_edgeport.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/io_ti.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipaq.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ipw.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ir-usb.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/keyspan_pda.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kl5kusb105.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/kobil_sct.ko 2024-03-27T08:09:35.700 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mct_u232.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7720.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/mos7840.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/navman.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/omninet.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/opticon.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/option.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/oti6858.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/pl2303.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcaux.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/qcserial.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/quatech2.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/safe_serial.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/sierra.ko 2024-03-27T08:09:35.701 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/spcp8x5.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ssu100.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/symbolserial.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_debug.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/usb_wwan.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/visor.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/whiteheat.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/serial/xsens_mt.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/uas.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-alauda.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-cypress.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-datafab.ko 2024-03-27T08:09:35.702 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-freecom.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-isd200.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-karma.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-onetouch.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-realtek.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr09.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-sddr55.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/ums-usbat.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/storage/usb-storage.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-core.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/usbip-host.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-03-27T08:09:35.703 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/pci/vfio-pci.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_iotlb.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_net.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/vhost/vhost_scsi.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/apple_bl.ko 2024-03-27T08:09:35.704 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/lcd.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/video/backlight/platform_lcd.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_balloon.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_mmio.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/virtio/virtio_ring.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2482.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/masters/ds2490.ko 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves 2024-03-27T08:09:35.705 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_smem.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/slaves/w1_therm.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/w1/wire.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim1535_wdt.ko 2024-03-27T08:09:35.706 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/alim7101_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/f71808e_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/hpwdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/i6300esb.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/iTCO_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ib700wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ibmasr.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it8712f_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/it87_wdt.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/machzwd.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/nv_tco.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_pci.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/pcwd_usb.ko 2024-03-27T08:09:35.707 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sch311x_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/softdog.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/sp5100_tco.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/via_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83877f_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/w83977f_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/wdt_pci.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/watchdog/xen_wdt.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-acpi-processor.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-evtchn.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntalloc.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-gntdev.ko 2024-03-27T08:09:35.708 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xen-privcmd.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/drivers/xen/xenfs/xenfs.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/9p/9p.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/affs/affs.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/befs/befs.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/binfmt_misc.ko 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs 2024-03-27T08:09:35.709 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/btrfs/btrfs.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cachefiles/cachefiles.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ceph/ceph.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/coda/coda.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/cramfs/cramfs.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/dlm/dlm.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ecryptfs/ecryptfs.ko 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs 2024-03-27T08:09:35.710 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/f2fs/f2fs.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/fat.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/msdos.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fat/vfat.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/cuse.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/fuse/fuse.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/gfs2/gfs2.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfs/hfs.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/hfsplus/hfsplus.ko 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs 2024-03-27T08:09:35.711 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/isofs/isofs.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/jfs/jfs.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/lockd/lockd.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/minix/minix.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/netfs/netfs.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-03-27T08:09:35.712 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfs.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv3.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs/nfsv4.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/grace.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfs_common/nfs_acl.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nfsd/nfsd.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nilfs2/nilfs2.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-celtic.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-centeuro.ko 2024-03-27T08:09:35.713 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-croatian.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-cyrillic.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-gaelic.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-greek.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-iceland.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-inuit.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-roman.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-romanian.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/mac-turkish.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1250.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1251.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp1255.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp737.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp775.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp850.ko 2024-03-27T08:09:35.714 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp852.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp855.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp857.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp860.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp861.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp862.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp863.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp864.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp865.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp866.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp869.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp874.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp932.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp936.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp949.ko 2024-03-27T08:09:35.715 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_cp950.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_euc-jp.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-1.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-13.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-14.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-15.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-2.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-3.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-4.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-5.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-6.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-7.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_iso8859-9.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-r.ko 2024-03-27T08:09:35.716 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-ru.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_koi8-u.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_ucs2_utils.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/nls/nls_utf8.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-03-27T08:09:35.717 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/overlayfs/overlay.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/pstore/ramoops.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/reiserfs/reiserfs.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/romfs/romfs.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/client/cifs.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_arc4.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/smb/common/cifs_md4.ko 2024-03-27T08:09:35.718 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/squashfs/squashfs.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/sysv/sysv.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/udf/udf.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/ufs/ufs.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/fs/xfs/xfs.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/rcu/rcutorture.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/torture.ko 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace 2024-03-27T08:09:35.719 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/asn1_encoder.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc-itu-t.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crc8.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libarc4.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/crypto/libdes.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/libcrc32c.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lru_cache.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4_compress.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/lz4/lz4hc_compress.ko 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math 2024-03-27T08:09:35.720 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/math/cordic.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/raid6/raid6_pq.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/reed_solomon/reed_solomon.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_bm.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_fsm.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/ts_kmp.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/lib/zstd/zstd_compress.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/mm/hwpoison-inject.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/6lowpan.ko 2024-03-27T08:09:35.721 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_dest.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_fragment.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_hop.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_ipv6.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_mobility.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_routing.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/6lowpan/nhc_udp.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/garp.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/mrp.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/p8022.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/psnap.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/802/stp.ko 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q 2024-03-27T08:09:35.722 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/8021q/8021q.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_fd.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_rdma.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/9p/9pnet_virtio.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/batman-adv/batman-adv.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/br_netfilter.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/bridge.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_among.ko 2024-03-27T08:09:35.723 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arp.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_limit.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_log.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_snat.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_stp.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-03-27T08:09:35.724 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/ebtables.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ceph/libceph.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/failover.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/core/pktgen.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_diag.ko 2024-03-27T08:09:35.725 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv4.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dccp/dccp_ipv6.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dns_resolver/dns_resolver.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/dsa_core.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_brcm.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_dsa.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_none.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/dsa/tag_trailer.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ieee802154/ieee802154_socket.ko 2024-03-27T08:09:35.726 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ah4.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/esp4.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/fou.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/gre.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/inet_diag.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_gre.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_tunnel.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ip_vti.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipcomp.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/ipip.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arp_tables.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-03-27T08:09:35.727 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/iptable_security.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-03-27T08:09:35.728 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_bic.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_dctcp.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_diag.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_highspeed.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_htcp.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_hybla.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_illinois.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_lp.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_scalable.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_vegas.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_veno.ko 2024-03-27T08:09:35.729 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_westwood.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tcp_yeah.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/tunnel4.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_diag.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/udp_tunnel.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv4/xfrm4_tunnel.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ah6.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/esp6.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/fou6.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_tunnel.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ip6_vti.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/ipcomp6.ko 2024-03-27T08:09:35.730 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-03-27T08:09:35.731 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/sit.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/tunnel6.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/ipv6/xfrm6_tunnel.ko 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key 2024-03-27T08:09:35.732 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/key/af_key.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_core.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_debugfs.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_eth.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ip6.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_netlink.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/l2tp/l2tp_ppp.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/llc/llc.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mac802154/mac802154.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/mpls/mpls_gso.ko 2024-03-27T08:09:35.733 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-03-27T08:09:35.734 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-03-27T08:09:35.735 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conncount.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_h323.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_irc.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sane.ko 2024-03-27T08:09:35.736 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_sip.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_dup_netdev.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_flow_table_inet.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_log_syslog.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_amanda.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_ftp.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_irc.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_sip.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_nat_tftp.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_synproxy_core.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nf_tables.ko 2024-03-27T08:09:35.737 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_acct.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_log.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_osf.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nfnetlink_queue.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_chain_nat.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_compat.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_ct.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_dup_netdev.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fib.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_fwd_netdev.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_hash.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_limit.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_log.ko 2024-03-27T08:09:35.738 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_masq.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_nat.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_numgen.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_queue.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_quota.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_redir.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_reject_inet.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_socket.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/nft_tunnel.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_AUDIT.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CHECKSUM.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CLASSIFY.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_CT.ko 2024-03-27T08:09:35.739 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_DSCP.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HL.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_HMARK.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_IDLETIMER.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LED.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_LOG.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_MASQUERADE.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NETMAP.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFLOG.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_NFQUEUE.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_RATEEST.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_REDIRECT.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_SECMARK.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPMSS.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-03-27T08:09:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TEE.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TPROXY.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_TRACE.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_addrtype.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_bpf.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cgroup.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cluster.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_comment.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connbytes.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlabel.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connlimit.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_connmark.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_conntrack.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_cpu.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dccp.ko 2024-03-27T08:09:35.741 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_devgroup.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_dscp.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ecn.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_esp.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hashlimit.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_helper.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_hl.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipcomp.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_iprange.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_ipvs.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_l2tp.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_length.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_limit.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mac.ko 2024-03-27T08:09:35.742 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_mark.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_multiport.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nat.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_nfacct.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_osf.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_owner.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_physdev.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_pkttype.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_policy.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_quota.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_rateest.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_realm.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_recent.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_sctp.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_set.ko 2024-03-27T08:09:35.743 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_socket.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_state.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_statistic.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_string.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_tcpmss.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_time.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netfilter/xt_u32.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/netlink/netlink_diag.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/nsh/nsh.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/openvswitch.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-geneve.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-gre.ko 2024-03-27T08:09:35.744 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/openvswitch/vport-vxlan.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/packet/af_packet_diag.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_rdma.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/rds/rds_tcp.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_csum.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_gact.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_mirred.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_nat.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_pedit.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_police.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_simple.ko 2024-03-27T08:09:35.745 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_skbedit.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/act_vlan.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_basic.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_bpf.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_flow.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_fw.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_route.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/cls_u32.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_cmp.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_ipset.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_meta.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_nbyte.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_text.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/em_u32.ko 2024-03-27T08:09:35.746 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_choke.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_codel.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_drr.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_fq.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_gred.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hfsc.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_hhf.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_htb.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_ingress.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_mqprio_lib.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_multiq.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_netem.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_pie.ko 2024-03-27T08:09:35.747 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_plug.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_prio.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_qfq.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_red.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfb.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_sfq.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_tbf.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sched/sch_teql.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sctp/sctp_diag.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-03-27T08:09:35.748 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/sunrpc.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/diag.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/tipc/tipc.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/unix/unix_diag.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_diag.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/vmw_vsock/vsock_loopback.ko 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm 2024-03-27T08:09:35.749 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/net/xfrm/xfrm_ipcomp.ko 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/security/keys/trusted-keys/trusted.ko 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/kernel/virt/lib/irqbypass.ko 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.alias.bin 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.alias.bin 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.bin 2024-03-27T08:09:35.750 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.builtin.modinfo 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.dep.bin 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.devname 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.order 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.softdep 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/modules.symbols.bin 2024-03-27T08:09:35.751 INFO:teuthology.orchestra.run.smithi173.stdout:/lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:35.754 DEBUG:teuthology.task.kernel:get_image_version: 6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.755 DEBUG:teuthology.orchestra.run.smithi173:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout:postinstall scriptlet (using /bin/sh): 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout: /usr/bin/kernel-install add 6.8.0-g1df0c7e8a235 /lib/modules/6.8.0-g1df0c7e8a235/vmlinuz 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout:for file in vmlinuz System.map config; do 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout: if ! cmp --silent "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235"; then 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout: cp "/lib/modules/6.8.0-g1df0c7e8a235/${file}" "/boot/${file}-6.8.0-g1df0c7e8a235" 2024-03-27T08:09:35.777 INFO:teuthology.orchestra.run.smithi173.stdout: fi 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:done 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:preuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:new-kernel-pkg --remove 6.8.0-g1df0c7e8a235 --rminitrd --initrdfile=/boot/initramfs-6.8.0-g1df0c7e8a235.img 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:elif [ -x /usr/bin/kernel-install ]; then 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:kernel-install remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:postuninstall scriptlet (using /bin/sh): 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:if [ -x /sbin/update-bootloader ]; then 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:/sbin/update-bootloader --remove 6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.778 INFO:teuthology.orchestra.run.smithi173.stdout:fi 2024-03-27T08:09:35.779 DEBUG:teuthology.orchestra.run.smithi173:> sudo rpm -qi grub2-tools 2024-03-27T08:09:35.862 INFO:teuthology.orchestra.run.smithi173.stdout:Name : grub2-tools 2024-03-27T08:09:35.862 INFO:teuthology.orchestra.run.smithi173.stdout:Epoch : 1 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Version : 2.06 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Release : 68.el9 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Architecture: x86_64 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Group : Unspecified 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Size : 8264254 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:License : GPLv3+ 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Packager : builder@centos.org 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Vendor : CentOS 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-27T08:09:35.863 INFO:teuthology.orchestra.run.smithi173.stdout:Summary : Support tools for GRUB. 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:Description : 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:hardware devices. 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:09:35.864 INFO:teuthology.orchestra.run.smithi173.stdout:This subpackage provides tools for support of all platforms. 2024-03-27T08:09:35.865 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-27T08:09:35.865 INFO:teuthology.task.kernel:Updating grub on smithi173 to boot 6.8.0-g1df0c7e8a235 2024-03-27T08:09:35.865 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-27T08:09:36.476 INFO:teuthology.orchestra.run.smithi173.stderr:Generating grub configuration file ... 2024-03-27T08:09:37.806 INFO:teuthology.orchestra.run.smithi173.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-27T08:09:37.838 INFO:teuthology.orchestra.run.smithi173.stderr:done 2024-03-27T08:09:37.840 DEBUG:teuthology.orchestra.run.smithi173:> mktemp 2024-03-27T08:09:37.855 INFO:teuthology.orchestra.run.smithi173.stdout:/tmp/tmp.bouGZjVd4r 2024-03-27T08:09:37.855 DEBUG:teuthology.orchestra.run.smithi173:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.bouGZjVd4r 2024-03-27T08:09:37.924 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 0666 /tmp/tmp.bouGZjVd4r 2024-03-27T08:09:38.068 DEBUG:teuthology.orchestra.remote:smithi173:/tmp/tmp.bouGZjVd4r is 6KB 2024-03-27T08:09:38.117 DEBUG:teuthology.orchestra.run.smithi173:> rm -fr /tmp/tmp.bouGZjVd4r 2024-03-27T08:09:38.131 DEBUG:teuthology.orchestra.run.smithi173:> sudo /bin/ls /boot/loader/entries || true 2024-03-27T08:09:38.205 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-27T08:09:38.205 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-27T08:09:38.205 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-27T08:09:38.205 INFO:teuthology.orchestra.run.smithi173.stdout:15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235.conf 2024-03-27T08:09:38.207 DEBUG:teuthology.orchestra.run.smithi173:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.8.0-g1df0c7e8a235 2024-03-27T08:09:38.376 DEBUG:teuthology.orchestra.run.smithi173:> sudo shutdown -r now 2024-03-27T08:09:50.458 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-03-27T08:09:50.459 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:09:50.460 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:05.146 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-03-27T08:10:05.147 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:10:05.148 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:08.382 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-03-27T08:10:08.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:10:08.383 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:08.802 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-27T08:10:17.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:10:17.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:20.862 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-03-27T08:10:23.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-27T08:10:26.718 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-27T08:10:32.654 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:10:32.655 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:32.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:10:32.865 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:35.710 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-27T08:10:35.719 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:10:35.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:38.786 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.173 2024-03-27T08:10:47.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:10:47.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:10:50.790 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:10:50.791 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:11:06.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-27T08:11:21.162 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:11:21.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:11:24.222 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.164 2024-03-27T08:11:32.874 DEBUG:teuthology.orchestra.remote:timed out 2024-03-27T08:11:42.230 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:11:42.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:11:42.745 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-03-27T08:11:43.497 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:11:43.498 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.8.0-g1df0c7e8a235"... 2024-03-27T08:11:43.498 DEBUG:teuthology.orchestra.run.smithi164:> uname -r 2024-03-27T08:11:43.579 INFO:teuthology.orchestra.run.smithi164.stdout:6.8.0-g1df0c7e8a235 2024-03-27T08:11:43.579 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-27T08:11:43.579 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T08:11:43.579 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T08:11:44.580 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-03-27T08:11:44.580 DEBUG:teuthology.orchestra.run.smithi164:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T08:11:44.762 INFO:teuthology.orchestra.run.smithi164.stdout:ttyS1 2024-03-27T08:11:44.815 DEBUG:teuthology.parallel:result is None 2024-03-27T08:11:47.875 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:11:47.876 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:11:48.276 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-03-27T08:11:48.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:11:48.964 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.8.0-g1df0c7e8a235"... 2024-03-27T08:11:48.964 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-03-27T08:11:49.016 INFO:teuthology.orchestra.run.smithi167.stdout:6.8.0-g1df0c7e8a235 2024-03-27T08:11:49.016 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-27T08:11:49.017 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T08:11:49.017 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T08:11:50.018 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-03-27T08:11:50.018 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T08:11:50.164 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-03-27T08:11:50.238 DEBUG:teuthology.parallel:result is None 2024-03-27T08:11:50.794 DEBUG:teuthology.orchestra.remote:timed out 2024-03-27T08:12:05.795 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:12:05.796 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:12:06.149 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-03-27T08:12:06.825 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:12:06.825 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.8.0-g1df0c7e8a235"... 2024-03-27T08:12:06.826 DEBUG:teuthology.orchestra.run.smithi173:> uname -r 2024-03-27T08:12:06.879 INFO:teuthology.orchestra.run.smithi173.stdout:6.8.0-g1df0c7e8a235 2024-03-27T08:12:06.879 DEBUG:teuthology.task.kernel:current kernel version is 6.8.0-g1df0c7e8a235 vs 6.8.0-g1df0c7e8a235 2024-03-27T08:12:06.880 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-27T08:12:06.880 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-27T08:12:07.881 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-03-27T08:12:07.881 DEBUG:teuthology.orchestra.run.smithi173:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-27T08:12:08.032 INFO:teuthology.orchestra.run.smithi173.stdout:ttyS1 2024-03-27T08:12:08.094 DEBUG:teuthology.parallel:result is None 2024-03-27T08:12:08.095 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-27T08:12:08.102 INFO:teuthology.task.internal:Creating test directory... 2024-03-27T08:12:08.102 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T08:12:08.110 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T08:12:08.117 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-27T08:12:08.174 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-27T08:12:08.181 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-27T08:12:08.196 INFO:teuthology.task.internal:Creating archive directory... 2024-03-27T08:12:08.196 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T08:12:08.202 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T08:12:08.208 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-27T08:12:08.284 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-27T08:12:08.291 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-27T08:12:08.291 DEBUG:teuthology.orchestra.run.smithi164:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T08:12:08.298 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T08:12:08.305 DEBUG:teuthology.orchestra.run.smithi173:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-27T08:12:08.392 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.407 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.414 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.435 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.448 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.456 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-27T08:12:08.461 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-27T08:12:08.469 INFO:teuthology.task.internal:Configuring sudo... 2024-03-27T08:12:08.469 DEBUG:teuthology.orchestra.run.smithi164:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T08:12:08.476 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T08:12:08.483 DEBUG:teuthology.orchestra.run.smithi173:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-27T08:12:08.578 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-27T08:12:08.592 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-27T08:12:08.593 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T08:12:08.601 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T08:12:08.606 DEBUG:teuthology.orchestra.run.smithi173:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-27T08:12:08.661 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:08.745 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:08.876 DEBUG:teuthology.orchestra.run.smithi164:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:08.959 DEBUG:teuthology.orchestra.run.smithi164:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:09.053 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:12:09.053 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T08:12:09.146 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:09.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:09.379 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:09.462 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:09.553 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:12:09.553 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T08:12:09.639 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:09.725 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-27T08:12:09.839 DEBUG:teuthology.orchestra.run.smithi173:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:09.926 DEBUG:teuthology.orchestra.run.smithi173:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-27T08:12:10.024 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:12:10.025 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-27T08:12:10.121 DEBUG:teuthology.orchestra.run.smithi164:> sudo service rsyslog restart 2024-03-27T08:12:10.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-03-27T08:12:10.136 DEBUG:teuthology.orchestra.run.smithi173:> sudo service rsyslog restart 2024-03-27T08:12:10.256 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:12:10.264 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:12:10.283 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:12:10.661 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-27T08:12:10.669 INFO:teuthology.task.internal:Starting timer... 2024-03-27T08:12:10.669 INFO:teuthology.run_tasks:Running task pcp... 2024-03-27T08:12:10.679 INFO:teuthology.run_tasks:Running task selinux... 2024-03-27T08:12:10.688 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-03-27T08:12:10.689 DEBUG:teuthology.orchestra.run.smithi164:> sudo service auditd rotate 2024-03-27T08:12:10.815 INFO:teuthology.orchestra.run.smithi164.stdout:Rotating logs: 2024-03-27T08:12:10.820 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-03-27T08:12:10.947 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-03-27T08:12:10.951 DEBUG:teuthology.orchestra.run.smithi173:> sudo service auditd rotate 2024-03-27T08:12:11.103 INFO:teuthology.orchestra.run.smithi173.stdout:Rotating logs: 2024-03-27T08:12:11.108 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-27T08:12:11.108 DEBUG:teuthology.orchestra.run.smithi164:> /usr/sbin/getenforce 2024-03-27T08:12:11.164 INFO:teuthology.orchestra.run.smithi164.stdout:Permissive 2024-03-27T08:12:11.165 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-03-27T08:12:11.222 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-03-27T08:12:11.222 DEBUG:teuthology.orchestra.run.smithi173:> /usr/sbin/getenforce 2024-03-27T08:12:11.282 INFO:teuthology.orchestra.run.smithi173.stdout:Permissive 2024-03-27T08:12:11.283 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi164.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi173.front.sepia.ceph.com': 'permissive'} 2024-03-27T08:12:11.283 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:12:11.367 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:12:11.368 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:12:11.450 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:12:11.450 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:12:11.533 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:12:11.534 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-27T08:12:11.534 DEBUG:teuthology.orchestra.run.smithi164:> sudo /usr/sbin/setenforce permissive 2024-03-27T08:12:11.627 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-03-27T08:12:11.727 DEBUG:teuthology.orchestra.run.smithi173:> sudo /usr/sbin/setenforce permissive 2024-03-27T08:12:11.830 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-27T08:12:11.840 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-27T08:12:11.846 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-27T08:12:11.980 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-27T08:12:11.997 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-27T08:12:11.999 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi164.front.sepia.ceph.com,smithi167.front.sepia.ceph.com,smithi173.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-27T08:18:36.675 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi164.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com'), Remote(name='ubuntu@smithi173.front.sepia.ceph.com')] 2024-03-27T08:18:36.676 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:18:36.678 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi164.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:18:36.831 DEBUG:teuthology.orchestra.run.smithi164:> true 2024-03-27T08:18:36.987 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi164.front.sepia.ceph.com' 2024-03-27T08:18:36.988 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:18:36.988 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:18:37.128 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-03-27T08:18:37.279 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-03-27T08:18:37.280 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:18:37.280 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi173.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-27T08:18:37.416 DEBUG:teuthology.orchestra.run.smithi173:> true 2024-03-27T08:18:37.561 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi173.front.sepia.ceph.com' 2024-03-27T08:18:37.561 INFO:teuthology.run_tasks:Running task clock... 2024-03-27T08:18:37.572 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-27T08:18:37.572 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T08:18:37.572 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:18:37.580 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T08:18:37.580 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:18:37.588 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-27T08:18:37.588 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:18:37.677 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T08:18:37.680 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T08:18:37.694 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-27T08:18:37.730 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T08:18:37.734 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T08:18:37.745 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-27T08:18:37.826 INFO:teuthology.orchestra.run.smithi164.stderr:sudo: ntpd: command not found 2024-03-27T08:18:37.828 INFO:teuthology.orchestra.run.smithi173.stderr:sudo: ntpd: command not found 2024-03-27T08:18:37.829 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-03-27T08:18:37.868 INFO:teuthology.orchestra.run.smithi173.stdout:506 Cannot talk to daemon 2024-03-27T08:18:37.869 INFO:teuthology.orchestra.run.smithi164.stdout:506 Cannot talk to daemon 2024-03-27T08:18:37.873 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-03-27T08:18:37.918 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T08:18:37.921 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T08:18:37.924 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-27T08:18:37.968 INFO:teuthology.orchestra.run.smithi173.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T08:18:37.970 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T08:18:37.976 INFO:teuthology.orchestra.run.smithi164.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-27T08:18:38.093 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:18:38.097 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:18:38.099 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:18:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:18:38.100 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-03-27T08:18:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.101 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.105 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.107 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:18:38.108 INFO:teuthology.run_tasks:Running task install... 2024-03-27T08:18:38.116 DEBUG:teuthology.task.install:project ceph 2024-03-27T08:18:38.117 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'}} 2024-03-27T08:18:38.117 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0'} 2024-03-27T08:18:38.117 INFO:teuthology.task.install:Using flavor: default 2024-03-27T08:18:38.123 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-27T08:18:38.123 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-27T08:18:38.124 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T08:18:38.124 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:18:38.127 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T08:18:38.127 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:18:38.128 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'tag': None, 'wait_for_package': False} 2024-03-27T08:18:38.128 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:18:38.290 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T08:18:38.290 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T08:18:38.294 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T08:18:38.294 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T08:18:38.295 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/ 2024-03-27T08:18:38.295 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2478.g155268c4 2024-03-27T08:18:38.402 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T08:18:38.402 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:18:38.402 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T08:18:38.408 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T08:18:38.408 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:18:38.409 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T08:18:38.464 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-27T08:18:38.464 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:18:38.464 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-27T08:18:38.500 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T08:18:38.500 DEBUG:teuthology.orchestra.run.smithi173:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T08:18:38.506 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T08:18:38.507 DEBUG:teuthology.orchestra.run.smithi164:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T08:18:38.561 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-27T08:18:38.561 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/155268c4e432a12433aa833f174f9fe3b1016ae0/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-27T08:18:38.634 DEBUG:teuthology.orchestra.run.smithi173:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T08:18:38.646 DEBUG:teuthology.orchestra.run.smithi164:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T08:18:38.693 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-27T08:18:38.756 DEBUG:teuthology.orchestra.run.smithi173:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T08:18:38.775 DEBUG:teuthology.orchestra.run.smithi164:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T08:18:38.820 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-27T08:18:38.842 INFO:teuthology.orchestra.run.smithi173.stdout:check_obsoletes = 1 2024-03-27T08:18:38.846 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum clean all 2024-03-27T08:18:38.861 INFO:teuthology.orchestra.run.smithi164.stdout:check_obsoletes = 1 2024-03-27T08:18:38.866 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum clean all 2024-03-27T08:18:38.910 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-03-27T08:18:38.914 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-03-27T08:18:39.190 INFO:teuthology.orchestra.run.smithi173.stdout:74 files removed 2024-03-27T08:18:39.210 INFO:teuthology.orchestra.run.smithi164.stdout:74 files removed 2024-03-27T08:18:39.228 DEBUG:teuthology.orchestra.run.smithi173:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T08:18:39.249 DEBUG:teuthology.orchestra.run.smithi164:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T08:18:39.268 INFO:teuthology.orchestra.run.smithi167.stdout:74 files removed 2024-03-27T08:18:39.306 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-27T08:18:40.197 INFO:teuthology.orchestra.run.smithi173.stdout:ceph packages for x86_64 179 kB/s | 83 kB 00:00 2024-03-27T08:18:40.288 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 175 kB/s | 83 kB 00:00 2024-03-27T08:18:40.297 INFO:teuthology.orchestra.run.smithi164.stdout:ceph packages for x86_64 149 kB/s | 83 kB 00:00 2024-03-27T08:18:40.798 INFO:teuthology.orchestra.run.smithi164.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-03-27T08:18:40.806 INFO:teuthology.orchestra.run.smithi173.stdout:ceph noarch packages 22 kB/s | 12 kB 00:00 2024-03-27T08:18:40.864 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 24 kB/s | 12 kB 00:00 2024-03-27T08:18:41.332 INFO:teuthology.orchestra.run.smithi164.stdout:ceph source packages 4.1 kB/s | 1.9 kB 00:00 2024-03-27T08:18:41.398 INFO:teuthology.orchestra.run.smithi173.stdout:ceph source packages 3.7 kB/s | 1.9 kB 00:00 2024-03-27T08:18:41.423 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-03-27T08:18:41.901 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - AppStream 13 MB/s | 6.7 MB 00:00 2024-03-27T08:18:42.044 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - AppStream 12 MB/s | 6.7 MB 00:00 2024-03-27T08:18:42.084 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-27T08:18:43.494 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2024-03-27T08:18:43.752 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS-9 - BaseOS 5.2 MB/s | 2.0 MB 00:00 2024-03-27T08:18:43.961 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS-9 - BaseOS 3.2 MB/s | 2.0 MB 00:00 2024-03-27T08:18:44.661 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.0 MB 00:00 2024-03-27T08:18:46.680 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - BaseOS 3.5 MB/s | 8.0 MB 00:02 2024-03-27T08:18:52.864 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 945 kB/s | 8.0 MB 00:08 2024-03-27T08:18:55.439 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 13 MB/s | 19 MB 00:01 2024-03-27T08:18:59.699 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.1 MB 00:00 2024-03-27T08:19:01.306 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-27T08:19:01.594 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 27 kB/s | 16 kB 00:00 2024-03-27T08:19:03.548 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-03-27T08:19:03.687 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - AppStream 1.2 MB/s | 19 MB 00:15 2024-03-27T08:19:08.340 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - CRB 7.0 MB/s | 6.1 MB 00:00 2024-03-27T08:19:09.334 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-03-27T08:19:09.958 INFO:teuthology.orchestra.run.smithi173.stdout:CentOS Stream 9 - Extras packages 61 kB/s | 16 kB 00:00 2024-03-27T08:19:11.193 INFO:teuthology.orchestra.run.smithi173.stdout:Extra Packages for Enterprise Linux 19 MB/s | 21 MB 00:01 2024-03-27T08:19:12.035 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:12.037 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:12.059 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T08:19:12.060 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T08:19:12.062 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T08:19:12.063 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:12.066 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:12.069 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T08:19:12.071 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T08:19:12.159 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T08:19:12.179 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T08:19:12.180 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T08:19:12.181 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T08:19:12.182 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T08:19:12.183 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T08:19:12.184 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T08:19:12.185 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T08:19:12.186 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T08:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T08:19:12.188 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T08:19:12.189 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T08:19:12.190 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T08:19:12.191 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T08:19:12.192 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:============================================================================================ 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:Install 150 Packages 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 24 Packages 2024-03-27T08:19:12.193 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:19:12.194 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 227 M 2024-03-27T08:19:12.194 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-03-27T08:19:12.968 INFO:teuthology.orchestra.run.smithi167.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 24 kB/s | 6.6 kB 00:00 2024-03-27T08:19:13.177 INFO:teuthology.orchestra.run.smithi167.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 4.2 MB/s | 890 kB 00:00 2024-03-27T08:19:13.253 INFO:teuthology.orchestra.run.smithi167.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 1.9 MB/s | 145 kB 00:00 2024-03-27T08:19:13.430 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - CRB 757 kB/s | 6.1 MB 00:08 2024-03-27T08:19:13.536 INFO:teuthology.orchestra.run.smithi167.stdout:(4/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 8.4 MB/s | 2.4 MB 00:00 2024-03-27T08:19:13.653 INFO:teuthology.orchestra.run.smithi167.stdout:(5/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 5.6 MB/s | 5.4 MB 00:00 2024-03-27T08:19:13.737 INFO:teuthology.orchestra.run.smithi167.stdout:(6/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 7.5 MB/s | 1.5 MB 00:00 2024-03-27T08:19:14.229 INFO:teuthology.orchestra.run.smithi167.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 8.2 MB/s | 4.7 MB 00:00 2024-03-27T08:19:15.304 INFO:teuthology.orchestra.run.smithi167.stdout:(8/174): ceph-osd-19.0.0-2478.g155268c4.el9.x86 11 MB/s | 17 MB 00:01 2024-03-27T08:19:15.380 INFO:teuthology.orchestra.run.smithi167.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 341 kB/s | 25 kB 00:00 2024-03-27T08:19:15.555 INFO:teuthology.orchestra.run.smithi167.stdout:(10/174): ceph-radosgw-19.0.0-2478.g155268c4.el 7.4 MB/s | 9.8 MB 00:01 2024-03-27T08:19:15.839 INFO:teuthology.orchestra.run.smithi167.stdout:(11/174): ceph-common-19.0.0-2478.g155268c4.el9 6.6 MB/s | 21 MB 00:03 2024-03-27T08:19:15.872 INFO:teuthology.orchestra.run.smithi167.stdout:(12/174): cephfs-mirror-19.0.0-2478.g155268c4.e 701 kB/s | 221 kB 00:00 2024-03-27T08:19:15.979 INFO:teuthology.orchestra.run.smithi167.stdout:(13/174): cephfs-shell-19.0.0-2478.g155268c4.el 195 kB/s | 27 kB 00:00 2024-03-27T08:19:16.039 INFO:teuthology.orchestra.run.smithi167.stdout:(14/174): libcephfs-devel-19.0.0-2478.g155268c4 191 kB/s | 32 kB 00:00 2024-03-27T08:19:16.106 INFO:teuthology.orchestra.run.smithi167.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 2.4 MB/s | 163 kB 00:00 2024-03-27T08:19:16.140 INFO:teuthology.orchestra.run.smithi167.stdout:(16/174): libcephfs2-19.0.0-2478.g155268c4.el9. 4.6 MB/s | 746 kB 00:00 2024-03-27T08:19:16.190 INFO:teuthology.orchestra.run.smithi167.stdout:(17/174): librados-devel-19.0.0-2478.g155268c4. 1.5 MB/s | 127 kB 00:00 2024-03-27T08:19:16.232 INFO:teuthology.orchestra.run.smithi167.stdout:(18/174): libradosstriper1-19.0.0-2478.g155268c 5.3 MB/s | 501 kB 00:00 2024-03-27T08:19:16.281 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS Stream 9 - Extras packages 11 kB/s | 16 kB 00:01 2024-03-27T08:19:16.290 INFO:teuthology.orchestra.run.smithi167.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 792 kB/s | 45 kB 00:00 2024-03-27T08:19:16.415 INFO:teuthology.orchestra.run.smithi167.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 1.1 MB/s | 134 kB 00:00 2024-03-27T08:19:16.525 INFO:teuthology.orchestra.run.smithi167.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 1.5 MB/s | 162 kB 00:00 2024-03-27T08:19:16.633 INFO:teuthology.orchestra.run.smithi167.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 2.9 MB/s | 320 kB 00:00 2024-03-27T08:19:16.784 INFO:teuthology.orchestra.run.smithi167.stdout:(23/174): librgw2-19.0.0-2478.g155268c4.el9.x86 8.7 MB/s | 5.1 MB 00:00 2024-03-27T08:19:16.817 INFO:teuthology.orchestra.run.smithi167.stdout:(24/174): python3-rbd-19.0.0-2478.g155268c4.el9 1.6 MB/s | 298 kB 00:00 2024-03-27T08:19:16.867 INFO:teuthology.orchestra.run.smithi167.stdout:(25/174): python3-rgw-19.0.0-2478.g155268c4.el9 1.2 MB/s | 99 kB 00:00 2024-03-27T08:19:16.918 INFO:teuthology.orchestra.run.smithi167.stdout:(26/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 859 kB/s | 85 kB 00:00 2024-03-27T08:19:16.935 INFO:teuthology.orchestra.run.smithi173.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2024-03-27T08:19:16.993 INFO:teuthology.orchestra.run.smithi167.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 2.2 MB/s | 170 kB 00:00 2024-03-27T08:19:17.093 INFO:teuthology.orchestra.run.smithi167.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 342 kB/s | 34 kB 00:00 2024-03-27T08:19:17.235 INFO:teuthology.orchestra.run.smithi167.stdout:(29/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 8.4 MB/s | 3.1 MB 00:00 2024-03-27T08:19:17.269 INFO:teuthology.orchestra.run.smithi167.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 811 kB/s | 141 kB 00:00 2024-03-27T08:19:17.508 INFO:teuthology.orchestra.run.smithi164.stdout:Extra Packages for Enterprise Linux 20 MB/s | 21 MB 00:01 2024-03-27T08:19:17.702 INFO:teuthology.orchestra.run.smithi167.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 7.6 MB/s | 3.5 MB 00:00 2024-03-27T08:19:17.794 INFO:teuthology.orchestra.run.smithi167.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 2.7 MB/s | 249 kB 00:00 2024-03-27T08:19:17.903 INFO:teuthology.orchestra.run.smithi167.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 459 kB/s | 49 kB 00:00 2024-03-27T08:19:17.995 INFO:teuthology.orchestra.run.smithi167.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 181 kB/s | 16 kB 00:00 2024-03-27T08:19:18.162 INFO:teuthology.orchestra.run.smithi167.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 8.3 MB/s | 7.4 MB 00:00 2024-03-27T08:19:18.195 INFO:teuthology.orchestra.run.smithi167.stdout:(36/174): ceph-volume-19.0.0-2478.g155268c4.el9 1.3 MB/s | 264 kB 00:00 2024-03-27T08:19:18.287 INFO:teuthology.orchestra.run.smithi167.stdout:(37/174): cephadm-19.0.0-2478.g155268c4.el9.noa 6.0 MB/s | 762 kB 00:00 2024-03-27T08:19:18.304 INFO:teuthology.orchestra.run.smithi167.stdout:(38/174): cephfs-top-19.0.0-2478.g155268c4.el9. 169 kB/s | 18 kB 00:00 2024-03-27T08:19:18.521 INFO:teuthology.orchestra.run.smithi167.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 3.0 MB/s | 662 kB 00:00 2024-03-27T08:19:19.055 INFO:teuthology.orchestra.run.smithi167.stdout:(40/174): ceph-test-19.0.0-2478.g155268c4.el9.x 13 MB/s | 48 MB 00:03 2024-03-27T08:19:19.105 INFO:teuthology.orchestra.run.smithi167.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 920 kB 00:00 2024-03-27T08:19:19.130 INFO:teuthology.orchestra.run.smithi167.stdout:(42/174): boost-program-options-1.75.0-8.el9.x8 175 kB/s | 106 kB 00:00 2024-03-27T08:19:19.164 INFO:teuthology.orchestra.run.smithi167.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 307 kB 00:00 2024-03-27T08:19:19.198 INFO:teuthology.orchestra.run.smithi167.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 500 kB/s | 32 kB 00:00 2024-03-27T08:19:19.281 INFO:teuthology.orchestra.run.smithi167.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 20 MB/s | 3.0 MB 00:00 2024-03-27T08:19:19.306 INFO:teuthology.orchestra.run.smithi167.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 136 kB/s | 17 kB 00:00 2024-03-27T08:19:19.332 INFO:teuthology.orchestra.run.smithi167.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 10 kB 00:00 2024-03-27T08:19:19.357 INFO:teuthology.orchestra.run.smithi167.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 44 kB 00:00 2024-03-27T08:19:19.407 INFO:teuthology.orchestra.run.smithi167.stdout:(49/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 159 kB 00:00 2024-03-27T08:19:19.440 INFO:teuthology.orchestra.run.smithi167.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.0 MB/s | 661 kB 00:00 2024-03-27T08:19:19.483 INFO:teuthology.orchestra.run.smithi167.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 4.8 MB/s | 578 kB 00:00 2024-03-27T08:19:19.508 INFO:teuthology.orchestra.run.smithi167.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 754 kB/s | 46 kB 00:00 2024-03-27T08:19:19.533 INFO:teuthology.orchestra.run.smithi167.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.2 MB/s | 282 kB 00:00 2024-03-27T08:19:19.563 INFO:teuthology.orchestra.run.smithi173.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:19.564 INFO:teuthology.orchestra.run.smithi173.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:19.566 INFO:teuthology.orchestra.run.smithi167.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-03-27T08:19:19.584 INFO:teuthology.orchestra.run.smithi173.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T08:19:19.585 INFO:teuthology.orchestra.run.smithi173.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T08:19:19.586 INFO:teuthology.orchestra.run.smithi173.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T08:19:19.588 INFO:teuthology.orchestra.run.smithi173.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:19.590 INFO:teuthology.orchestra.run.smithi173.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:19.592 INFO:teuthology.orchestra.run.smithi167.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 612 kB/s | 34 kB 00:00 2024-03-27T08:19:19.594 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T08:19:19.595 INFO:teuthology.orchestra.run.smithi173.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T08:19:19.642 INFO:teuthology.orchestra.run.smithi167.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.0 MB/s | 217 kB 00:00 2024-03-27T08:19:19.681 INFO:teuthology.orchestra.run.smithi173.stdout:Dependencies resolved. 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================ 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: Package Arch Version Repository Size 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================ 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout:Installing: 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T08:19:19.707 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T08:19:19.708 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T08:19:19.709 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrading: 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T08:19:19.710 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T08:19:19.711 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout:Installing dependencies: 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T08:19:19.712 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T08:19:19.713 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T08:19:19.714 INFO:teuthology.orchestra.run.smithi173.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T08:19:19.715 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T08:19:19.716 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T08:19:19.717 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T08:19:19.718 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T08:19:19.719 INFO:teuthology.orchestra.run.smithi173.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout:Installing weak dependencies: 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction Summary 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout:============================================================================================ 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout:Install 150 Packages 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout:Upgrade 24 Packages 2024-03-27T08:19:19.720 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:19:19.721 INFO:teuthology.orchestra.run.smithi173.stdout:Total download size: 227 M 2024-03-27T08:19:19.721 INFO:teuthology.orchestra.run.smithi173.stdout:Downloading Packages: 2024-03-27T08:19:19.776 INFO:teuthology.orchestra.run.smithi167.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 23 MB/s | 4.7 MB 00:00 2024-03-27T08:19:19.818 INFO:teuthology.orchestra.run.smithi167.stdout:(58/174): protobuf-3.14.0-13.el9.x86_64.rpm 4.9 MB/s | 1.0 MB 00:00 2024-03-27T08:19:19.834 INFO:teuthology.orchestra.run.smithi167.stdout:(59/174): python3-attrs-20.3.0-7.el9.noarch.rpm 439 kB/s | 78 kB 00:00 2024-03-27T08:19:19.901 INFO:teuthology.orchestra.run.smithi167.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 375 kB/s | 24 kB 00:00 2024-03-27T08:19:19.935 INFO:teuthology.orchestra.run.smithi167.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 183 kB/s | 18 kB 00:00 2024-03-27T08:19:20.086 INFO:teuthology.orchestra.run.smithi167.stdout:(62/174): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2024-03-27T08:19:20.110 INFO:teuthology.orchestra.run.smithi167.stdout:(63/174): python3-mako-1.1.4-6.el9.noarch.rpm 694 kB/s | 144 kB 00:00 2024-03-27T08:19:20.136 INFO:teuthology.orchestra.run.smithi167.stdout:(64/174): python3-markupsafe-1.1.1-12.el9.x86_6 169 kB/s | 32 kB 00:00 2024-03-27T08:19:20.169 INFO:teuthology.orchestra.run.smithi167.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 6.7 MB/s | 217 kB 00:00 2024-03-27T08:19:20.203 INFO:teuthology.orchestra.run.smithi167.stdout:(66/174): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2024-03-27T08:19:20.320 INFO:teuthology.orchestra.run.smithi167.stdout:(67/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 26 MB/s | 4.8 MB 00:00 2024-03-27T08:19:20.336 INFO:teuthology.orchestra.run.smithi167.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 433 kB/s | 69 kB 00:00 2024-03-27T08:19:20.361 INFO:teuthology.orchestra.run.smithi167.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 285 kB/s | 41 kB 00:00 2024-03-27T08:19:20.404 INFO:teuthology.orchestra.run.smithi167.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2024-03-27T08:19:20.437 INFO:teuthology.orchestra.run.smithi167.stdout:(71/174): python3-protobuf-3.14.0-13.el9.noarch 3.1 MB/s | 238 kB 00:00 2024-03-27T08:19:20.454 INFO:teuthology.orchestra.run.smithi167.stdout:(72/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-03-27T08:19:20.488 INFO:teuthology.orchestra.run.smithi167.stdout:(73/174): python3-pytz-2021.1-5.el9.noarch.rpm 595 kB/s | 47 kB 00:00 2024-03-27T08:19:20.530 INFO:teuthology.orchestra.run.smithi167.stdout:(74/174): python3-requests-oauthlib-1.3.0-12.el 578 kB/s | 43 kB 00:00 2024-03-27T08:19:20.553 INFO:teuthology.orchestra.run.smithi173.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 25 kB/s | 6.6 kB 00:00 2024-03-27T08:19:20.778 INFO:teuthology.orchestra.run.smithi173.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 3.9 MB/s | 890 kB 00:00 2024-03-27T08:19:20.830 INFO:teuthology.orchestra.run.smithi167.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 42 MB/s | 16 MB 00:00 2024-03-27T08:19:20.845 INFO:teuthology.orchestra.run.smithi173.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 2.1 MB/s | 145 kB 00:00 2024-03-27T08:19:20.874 INFO:teuthology.orchestra.run.smithi167.stdout:(76/174): python3-toml-0.10.2-6.el9.noarch.rpm 104 kB/s | 39 kB 00:00 2024-03-27T08:19:20.897 INFO:teuthology.orchestra.run.smithi167.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 116 kB/s | 41 kB 00:00 2024-03-27T08:19:20.939 INFO:teuthology.orchestra.run.smithi167.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2024-03-27T08:19:20.964 INFO:teuthology.orchestra.run.smithi167.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 963 kB/s | 63 kB 00:00 2024-03-27T08:19:20.998 INFO:teuthology.orchestra.run.smithi167.stdout:(80/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 300 kB 00:00 2024-03-27T08:19:21.015 INFO:teuthology.orchestra.run.smithi167.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 595 kB/s | 44 kB 00:00 2024-03-27T08:19:21.040 INFO:teuthology.orchestra.run.smithi167.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-03-27T08:19:21.052 INFO:teuthology.orchestra.run.smithi173.stdout:(4/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 7.1 MB/s | 5.4 MB 00:00 2024-03-27T08:19:21.082 INFO:teuthology.orchestra.run.smithi167.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.6 MB/s | 241 kB 00:00 2024-03-27T08:19:21.124 INFO:teuthology.orchestra.run.smithi167.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-27T08:19:21.149 INFO:teuthology.orchestra.run.smithi167.stdout:(85/174): python3-ply-3.11-14.el9.noarch.rpm 996 kB/s | 103 kB 00:00 2024-03-27T08:19:21.163 INFO:teuthology.orchestra.run.smithi173.stdout:(5/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 7.5 MB/s | 2.4 MB 00:00 2024-03-27T08:19:21.183 INFO:teuthology.orchestra.run.smithi167.stdout:(86/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2024-03-27T08:19:21.208 INFO:teuthology.orchestra.run.smithi167.stdout:(87/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 124 kB 00:00 2024-03-27T08:19:21.221 INFO:teuthology.orchestra.run.smithi173.stdout:(6/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 8.9 MB/s | 1.5 MB 00:00 2024-03-27T08:19:21.317 INFO:teuthology.orchestra.run.smithi167.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-27T08:19:21.375 INFO:teuthology.orchestra.run.smithi167.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.1 MB/s | 195 kB 00:00 2024-03-27T08:19:21.400 INFO:teuthology.orchestra.run.smithi167.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-03-27T08:19:21.601 INFO:teuthology.orchestra.run.smithi167.stdout:(91/174): libgfortran-11.4.1-3.el9.x86_64.rpm 1.9 MB/s | 803 kB 00:00 2024-03-27T08:19:21.613 INFO:teuthology.orchestra.run.smithi173.stdout:(7/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 10 MB/s | 4.7 MB 00:00 2024-03-27T08:19:21.626 INFO:teuthology.orchestra.run.smithi167.stdout:(92/174): elfutils-libelf-devel-0.190-2.el9.x86 86 kB/s | 21 kB 00:00 2024-03-27T08:19:21.677 INFO:teuthology.orchestra.run.smithi167.stdout:(93/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 93 kB/s | 25 kB 00:00 2024-03-27T08:19:21.910 INFO:teuthology.orchestra.run.smithi167.stdout:(94/174): postgresql-13.14-1.el9.x86_64.rpm 5.6 MB/s | 1.6 MB 00:00 2024-03-27T08:19:21.985 INFO:teuthology.orchestra.run.smithi167.stdout:(95/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2024-03-27T08:19:22.036 INFO:teuthology.orchestra.run.smithi167.stdout:(96/174): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-03-27T08:19:22.094 INFO:teuthology.orchestra.run.smithi167.stdout:(97/174): postgresql-contrib-13.14-1.el9.x86_64 2.1 MB/s | 911 kB 00:00 2024-03-27T08:19:22.136 INFO:teuthology.orchestra.run.smithi167.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-27T08:19:22.203 INFO:teuthology.orchestra.run.smithi167.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.2 MB/s | 248 kB 00:00 2024-03-27T08:19:22.236 INFO:teuthology.orchestra.run.smithi167.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.2 MB/s | 221 kB 00:00 2024-03-27T08:19:22.287 INFO:teuthology.orchestra.run.smithi167.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 433 kB/s | 36 kB 00:00 2024-03-27T08:19:22.312 INFO:teuthology.orchestra.run.smithi167.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 638 kB/s | 47 kB 00:00 2024-03-27T08:19:22.371 INFO:teuthology.orchestra.run.smithi167.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.1 MB/s | 94 kB 00:00 2024-03-27T08:19:22.554 INFO:teuthology.orchestra.run.smithi167.stdout:(104/174): postgresql-server-13.14-1.el9.x86_64 10 MB/s | 5.8 MB 00:00 2024-03-27T08:19:22.564 INFO:teuthology.orchestra.run.smithi173.stdout:(8/174): ceph-osd-19.0.0-2478.g155268c4.el9.x86 13 MB/s | 17 MB 00:01 2024-03-27T08:19:22.614 INFO:teuthology.orchestra.run.smithi173.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 516 kB/s | 25 kB 00:00 2024-03-27T08:19:22.798 INFO:teuthology.orchestra.run.smithi173.stdout:(10/174): ceph-radosgw-19.0.0-2478.g155268c4.el 8.3 MB/s | 9.8 MB 00:01 2024-03-27T08:19:22.909 INFO:teuthology.orchestra.run.smithi173.stdout:(11/174): cephfs-mirror-19.0.0-2478.g155268c4.e 2.0 MB/s | 221 kB 00:00 2024-03-27T08:19:22.998 INFO:teuthology.orchestra.run.smithi173.stdout:(12/174): cephfs-shell-19.0.0-2478.g155268c4.el 304 kB/s | 27 kB 00:00 2024-03-27T08:19:23.080 INFO:teuthology.orchestra.run.smithi167.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-03-27T08:19:23.081 INFO:teuthology.orchestra.run.smithi173.stdout:(13/174): libcephfs-devel-19.0.0-2478.g155268c4 385 kB/s | 32 kB 00:00 2024-03-27T08:19:23.105 INFO:teuthology.orchestra.run.smithi167.stdout:(106/174): lua-devel-5.4.4-4.el9.x86_64.rpm 28 kB/s | 22 kB 00:00 2024-03-27T08:19:23.155 INFO:teuthology.orchestra.run.smithi167.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 4.2 MB/s | 309 kB 00:00 2024-03-27T08:19:23.180 INFO:teuthology.orchestra.run.smithi167.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 260 kB/s | 19 kB 00:00 2024-03-27T08:19:23.299 INFO:teuthology.orchestra.run.smithi164.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-03-27T08:19:23.406 INFO:teuthology.orchestra.run.smithi167.stdout:(109/174): libarrow-9.0.0-10.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-03-27T08:19:23.431 INFO:teuthology.orchestra.run.smithi167.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 104 kB/s | 26 kB 00:00 2024-03-27T08:19:23.506 INFO:teuthology.orchestra.run.smithi167.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 659 kB/s | 49 kB 00:00 2024-03-27T08:19:23.523 INFO:teuthology.orchestra.run.smithi167.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 746 kB/s | 67 kB 00:00 2024-03-27T08:19:23.598 INFO:teuthology.orchestra.run.smithi167.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-03-27T08:19:23.640 INFO:teuthology.orchestra.run.smithi167.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 7.1 MB/s | 838 kB 00:00 2024-03-27T08:19:23.690 INFO:teuthology.orchestra.run.smithi167.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 6.3 MB/s | 548 kB 00:00 2024-03-27T08:19:23.725 INFO:teuthology.orchestra.run.smithi167.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 524 kB/s | 43 kB 00:00 2024-03-27T08:19:23.758 INFO:teuthology.orchestra.run.smithi167.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 491 kB/s | 32 kB 00:00 2024-03-27T08:19:23.809 INFO:teuthology.orchestra.run.smithi167.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 179 kB/s | 15 kB 00:00 2024-03-27T08:19:23.842 INFO:teuthology.orchestra.run.smithi167.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2024-03-27T08:19:23.892 INFO:teuthology.orchestra.run.smithi167.stdout:(120/174): python3-cherrypy-18.6.1-2.el9.noarch 4.4 MB/s | 358 kB 00:00 2024-03-27T08:19:23.926 INFO:teuthology.orchestra.run.smithi167.stdout:(121/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.6 MB/s | 303 kB 00:00 2024-03-27T08:19:23.959 INFO:teuthology.orchestra.run.smithi167.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 555 kB/s | 35 kB 00:00 2024-03-27T08:19:23.965 INFO:teuthology.orchestra.run.smithi173.stdout:(14/174): libcephfs2-19.0.0-2478.g155268c4.el9. 846 kB/s | 746 kB 00:00 2024-03-27T08:19:24.001 INFO:teuthology.orchestra.run.smithi167.stdout:(123/174): python3-google-auth-2.28.2-1.el9.noa 2.7 MB/s | 203 kB 00:00 2024-03-27T08:19:24.118 INFO:teuthology.orchestra.run.smithi167.stdout:(124/174): python3-grpcio-1.46.7-10.el9.x86_64. 13 MB/s | 2.0 MB 00:00 2024-03-27T08:19:24.135 INFO:teuthology.orchestra.run.smithi167.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.1 MB/s | 144 kB 00:00 2024-03-27T08:19:24.177 INFO:teuthology.orchestra.run.smithi167.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 189 kB/s | 11 kB 00:00 2024-03-27T08:19:24.194 INFO:teuthology.orchestra.run.smithi167.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 306 kB/s | 18 kB 00:00 2024-03-27T08:19:24.244 INFO:teuthology.orchestra.run.smithi167.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 351 kB/s | 23 kB 00:00 2024-03-27T08:19:24.304 INFO:teuthology.orchestra.run.smithi167.stdout:(129/174): protobuf-compiler-3.14.0-13.el9.x86_ 447 kB/s | 863 kB 00:01 2024-03-27T08:19:24.328 INFO:teuthology.orchestra.run.smithi167.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2024-03-27T08:19:24.353 INFO:teuthology.orchestra.run.smithi167.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 186 kB/s | 20 kB 00:00 2024-03-27T08:19:24.395 INFO:teuthology.orchestra.run.smithi167.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 708 kB/s | 46 kB 00:00 2024-03-27T08:19:24.424 INFO:teuthology.orchestra.run.smithi173.stdout:(15/174): ceph-common-19.0.0-2478.g155268c4.el9 5.0 MB/s | 21 MB 00:04 2024-03-27T08:19:24.445 INFO:teuthology.orchestra.run.smithi167.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 8.8 MB/s | 1.0 MB 00:00 2024-03-27T08:19:24.449 INFO:teuthology.orchestra.run.smithi173.stdout:(16/174): libcephsqlite-19.0.0-2478.g155268c4.e 338 kB/s | 163 kB 00:00 2024-03-27T08:19:24.471 INFO:teuthology.orchestra.run.smithi167.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 677 kB/s | 79 kB 00:00 2024-03-27T08:19:24.491 INFO:teuthology.orchestra.run.smithi173.stdout:(17/174): librados-devel-19.0.0-2478.g155268c4. 1.9 MB/s | 127 kB 00:00 2024-03-27T08:19:24.496 INFO:teuthology.orchestra.run.smithi167.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 635 kB/s | 58 kB 00:00 2024-03-27T08:19:24.547 INFO:teuthology.orchestra.run.smithi167.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.6 MB/s | 272 kB 00:00 2024-03-27T08:19:24.572 INFO:teuthology.orchestra.run.smithi167.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 166 kB/s | 16 kB 00:00 2024-03-27T08:19:24.664 INFO:teuthology.orchestra.run.smithi167.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 540 kB/s | 90 kB 00:00 2024-03-27T08:19:24.689 INFO:teuthology.orchestra.run.smithi167.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 201 kB/s | 28 kB 00:00 2024-03-27T08:19:24.731 INFO:teuthology.orchestra.run.smithi167.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 469 kB/s | 31 kB 00:00 2024-03-27T08:19:24.765 INFO:teuthology.orchestra.run.smithi167.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 1.9 MB/s | 188 kB 00:00 2024-03-27T08:19:24.815 INFO:teuthology.orchestra.run.smithi167.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 473 kB/s | 59 kB 00:00 2024-03-27T08:19:24.840 INFO:teuthology.orchestra.run.smithi167.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 337 kB/s | 36 kB 00:00 2024-03-27T08:19:24.882 INFO:teuthology.orchestra.run.smithi167.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 780 kB/s | 51 kB 00:00 2024-03-27T08:19:24.900 INFO:teuthology.orchestra.run.smithi173.stdout:(18/174): libradosstriper1-19.0.0-2478.g155268c 1.1 MB/s | 501 kB 00:00 2024-03-27T08:19:24.915 INFO:teuthology.orchestra.run.smithi167.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-03-27T08:19:24.941 INFO:teuthology.orchestra.run.smithi167.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 898 kB/s | 90 kB 00:00 2024-03-27T08:19:24.974 INFO:teuthology.orchestra.run.smithi167.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.7 MB/s | 427 kB 00:00 2024-03-27T08:19:24.992 INFO:teuthology.orchestra.run.smithi173.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 503 kB/s | 45 kB 00:00 2024-03-27T08:19:25.016 INFO:teuthology.orchestra.run.smithi167.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 283 kB/s | 20 kB 00:00 2024-03-27T08:19:25.050 INFO:teuthology.orchestra.run.smithi167.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.8 MB/s | 192 kB 00:00 2024-03-27T08:19:25.108 INFO:teuthology.orchestra.run.smithi167.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-03-27T08:19:25.159 INFO:teuthology.orchestra.run.smithi173.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 806 kB/s | 134 kB 00:00 2024-03-27T08:19:25.287 INFO:teuthology.orchestra.run.smithi167.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.7 MB/s | 321 kB 00:00 2024-03-27T08:19:25.326 INFO:teuthology.orchestra.run.smithi173.stdout:(21/174): librgw2-19.0.0-2478.g155268c4.el9.x86 6.2 MB/s | 5.1 MB 00:00 2024-03-27T08:19:25.359 INFO:teuthology.orchestra.run.smithi173.stdout:(22/174): python3-cephfs-19.0.0-2478.g155268c4. 811 kB/s | 162 kB 00:00 2024-03-27T08:19:25.401 INFO:teuthology.orchestra.run.smithi173.stdout:(23/174): python3-rados-19.0.0-2478.g155268c4.e 4.2 MB/s | 320 kB 00:00 2024-03-27T08:19:25.510 INFO:teuthology.orchestra.run.smithi173.stdout:(24/174): python3-rgw-19.0.0-2478.g155268c4.el9 925 kB/s | 99 kB 00:00 2024-03-27T08:19:25.544 INFO:teuthology.orchestra.run.smithi173.stdout:(25/174): python3-rbd-19.0.0-2478.g155268c4.el9 1.6 MB/s | 298 kB 00:00 2024-03-27T08:19:25.576 INFO:teuthology.orchestra.run.smithi167.stdout:(152/174): NetworkManager-1.47.2-1.el9.x86_64.r 8.1 MB/s | 2.3 MB 00:00 2024-03-27T08:19:25.619 INFO:teuthology.orchestra.run.smithi173.stdout:(26/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 792 kB/s | 85 kB 00:00 2024-03-27T08:19:25.782 INFO:teuthology.orchestra.run.smithi167.stdout:(153/174): NetworkManager-libnm-1.47.2-1.el9.x8 9.0 MB/s | 1.8 MB 00:00 2024-03-27T08:19:25.794 INFO:teuthology.orchestra.run.smithi173.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 977 kB/s | 170 kB 00:00 2024-03-27T08:19:25.835 INFO:teuthology.orchestra.run.smithi167.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 810 kB/s | 42 kB 00:00 2024-03-27T08:19:25.889 INFO:teuthology.orchestra.run.smithi164.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:25.891 INFO:teuthology.orchestra.run.smithi164.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-27T08:19:25.894 INFO:teuthology.orchestra.run.smithi173.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 341 kB/s | 34 kB 00:00 2024-03-27T08:19:25.900 INFO:teuthology.orchestra.run.smithi167.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 3.8 MB/s | 248 kB 00:00 2024-03-27T08:19:25.911 INFO:teuthology.orchestra.run.smithi164.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-27T08:19:25.913 INFO:teuthology.orchestra.run.smithi164.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-27T08:19:25.914 INFO:teuthology.orchestra.run.smithi164.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-27T08:19:25.916 INFO:teuthology.orchestra.run.smithi164.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:25.918 INFO:teuthology.orchestra.run.smithi164.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-27T08:19:25.922 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-27T08:19:25.923 INFO:teuthology.orchestra.run.smithi164.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-27T08:19:25.950 INFO:teuthology.orchestra.run.smithi167.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-27T08:19:25.986 INFO:teuthology.orchestra.run.smithi173.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 1.5 MB/s | 141 kB 00:00 2024-03-27T08:19:26.001 INFO:teuthology.orchestra.run.smithi167.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 739 kB/s | 36 kB 00:00 2024-03-27T08:19:26.010 INFO:teuthology.orchestra.run.smithi164.stdout:Dependencies resolved. 2024-03-27T08:19:26.028 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: Package Arch Version Repository Size 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout:Installing: 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: ceph x86_64 2:19.0.0-2478.g155268c4.el9 ceph 6.6 k 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.4 M 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 890 k 2024-03-27T08:19:26.029 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2478.g155268c4.el9 ceph 145 k 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr x86_64 2:19.0.0-2478.g155268c4.el9 ceph 1.5 M 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 141 k 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 3.5 M 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 7.4 M 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 49 k 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 9.8 M 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test x86_64 2:19.0.0-2478.g155268c4.el9 ceph 48 M 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 264 k 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 762 k 2024-03-27T08:19:26.030 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 221 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell x86_64 2:19.0.0-2478.g155268c4.el9 ceph 27 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 18 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 32 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 746 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel x86_64 2:19.0.0-2478.g155268c4.el9 ceph 127 k 2024-03-27T08:19:26.031 INFO:teuthology.orchestra.run.smithi164.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-27T08:19:26.032 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-27T08:19:26.032 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-27T08:19:26.032 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-03-27T08:19:26.032 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-03-27T08:19:26.032 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs x86_64 2:19.0.0-2478.g155268c4.el9 ceph 162 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados x86_64 2:19.0.0-2478.g155268c4.el9 ceph 320 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 298 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw x86_64 2:19.0.0-2478.g155268c4.el9 ceph 99 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 85 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 170 k 2024-03-27T08:19:26.033 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-27T08:19:26.034 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrading: 2024-03-27T08:19:26.034 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager x86_64 1:1.47.2-1.el9 baseos 2.3 M 2024-03-27T08:19:26.034 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm x86_64 1:1.47.2-1.el9 baseos 1.8 M 2024-03-27T08:19:26.034 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team x86_64 1:1.47.2-1.el9 baseos 42 k 2024-03-27T08:19:26.034 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui x86_64 1:1.47.2-1.el9 baseos 248 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-27T08:19:26.035 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: librados2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.4 M 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 3.1 M 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-27T08:19:26.036 INFO:teuthology.orchestra.run.smithi164.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout:Installing dependencies: 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-27T08:19:26.037 INFO:teuthology.orchestra.run.smithi164.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 21 M 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 34 k 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds x86_64 2:19.0.0-2478.g155268c4.el9 ceph 2.4 M 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 249 k 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon x86_64 2:19.0.0-2478.g155268c4.el9 ceph 4.7 M 2024-03-27T08:19:26.038 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd x86_64 2:19.0.0-2478.g155268c4.el9 ceph 17 M 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2478.g155268c4.el9 ceph-noarch 16 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux x86_64 2:19.0.0-2478.g155268c4.el9 ceph 25 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-27T08:19:26.039 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-27T08:19:26.040 INFO:teuthology.orchestra.run.smithi164.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-27T08:19:26.040 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-27T08:19:26.040 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-27T08:19:26.040 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite x86_64 2:19.0.0-2478.g155268c4.el9 ceph 163 k 2024-03-27T08:19:26.040 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-27T08:19:26.041 INFO:teuthology.orchestra.run.smithi164.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-27T08:19:26.041 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-27T08:19:26.041 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-27T08:19:26.041 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 501 k 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2 x86_64 2:19.0.0-2478.g155268c4.el9 ceph 5.1 M 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-27T08:19:26.042 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-27T08:19:26.043 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-27T08:19:26.044 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-03-27T08:19:26.044 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-27T08:19:26.044 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-27T08:19:26.044 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse x86_64 2:19.0.0-2478.g155268c4.el9 ceph 45 k 2024-03-27T08:19:26.045 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common x86_64 2:19.0.0-2478.g155268c4.el9 ceph 134 k 2024-03-27T08:19:26.046 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-27T08:19:26.046 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-27T08:19:26.046 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-27T08:19:26.046 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-27T08:19:26.046 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-27T08:19:26.047 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-27T08:19:26.048 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-27T08:19:26.049 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-27T08:19:26.050 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-27T08:19:26.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-27T08:19:26.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-27T08:19:26.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-27T08:19:26.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-27T08:19:26.051 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-27T08:19:26.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-27T08:19:26.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-27T08:19:26.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-27T08:19:26.052 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-27T08:19:26.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-27T08:19:26.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-27T08:19:26.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-27T08:19:26.053 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-27T08:19:26.054 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-03-27T08:19:26.055 INFO:teuthology.orchestra.run.smithi164.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-27T08:19:26.056 INFO:teuthology.orchestra.run.smithi164.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-27T08:19:26.056 INFO:teuthology.orchestra.run.smithi164.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-27T08:19:26.056 INFO:teuthology.orchestra.run.smithi164.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-27T08:19:26.056 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout:Installing weak dependencies: 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction Summary 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout:============================================================================================ 2024-03-27T08:19:26.057 INFO:teuthology.orchestra.run.smithi164.stdout:Install 150 Packages 2024-03-27T08:19:26.058 INFO:teuthology.orchestra.run.smithi164.stdout:Upgrade 24 Packages 2024-03-27T08:19:26.058 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:19:26.058 INFO:teuthology.orchestra.run.smithi164.stdout:Total download size: 227 M 2024-03-27T08:19:26.059 INFO:teuthology.orchestra.run.smithi164.stdout:Downloading Packages: 2024-03-27T08:19:26.059 INFO:teuthology.orchestra.run.smithi167.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.3 MB/s | 192 kB 00:00 2024-03-27T08:19:26.118 INFO:teuthology.orchestra.run.smithi167.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-03-27T08:19:26.177 INFO:teuthology.orchestra.run.smithi167.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 399 kB/s | 23 kB 00:00 2024-03-27T08:19:26.227 INFO:teuthology.orchestra.run.smithi167.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 108 kB 00:00 2024-03-27T08:19:26.287 INFO:teuthology.orchestra.run.smithi173.stdout:(30/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 4.2 MB/s | 3.1 MB 00:00 2024-03-27T08:19:26.319 INFO:teuthology.orchestra.run.smithi167.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.7 MB/s | 155 kB 00:00 2024-03-27T08:19:26.369 INFO:teuthology.orchestra.run.smithi167.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.7 MB/s | 136 kB 00:00 2024-03-27T08:19:26.419 INFO:teuthology.orchestra.run.smithi167.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-03-27T08:19:26.470 INFO:teuthology.orchestra.run.smithi167.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 580 kB/s | 29 kB 00:00 2024-03-27T08:19:26.620 INFO:teuthology.orchestra.run.smithi167.stdout:(166/174): openssl-3.0.7-27.el9.x86_64.rpm 8.1 MB/s | 1.2 MB 00:00 2024-03-27T08:19:26.812 INFO:teuthology.orchestra.run.smithi167.stdout:(167/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 11 MB/s | 2.2 MB 00:00 2024-03-27T08:19:27.137 INFO:teuthology.orchestra.run.smithi167.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.0 MB/s | 2.3 MB 00:00 2024-03-27T08:19:27.189 INFO:teuthology.orchestra.run.smithi173.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 2.9 MB/s | 3.5 MB 00:01 2024-03-27T08:19:27.239 INFO:teuthology.orchestra.run.smithi167.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 4.5 MB/s | 465 kB 00:00 2024-03-27T08:19:27.288 INFO:teuthology.orchestra.run.smithi167.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 675 kB/s | 31 kB 00:00 2024-03-27T08:19:27.296 INFO:teuthology.orchestra.run.smithi173.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 2.3 MB/s | 249 kB 00:00 2024-03-27T08:19:27.413 INFO:teuthology.orchestra.run.smithi167.stdout:(171/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 8.6 MB/s | 1.1 MB 00:00 2024-03-27T08:19:27.431 INFO:teuthology.orchestra.run.smithi164.stdout:(1/174): ceph-19.0.0-2478.g155268c4.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-03-27T08:19:27.663 INFO:teuthology.orchestra.run.smithi167.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 298 kB/s | 74 kB 00:00 2024-03-27T08:19:27.855 INFO:teuthology.orchestra.run.smithi173.stdout:(33/174): ceph-test-19.0.0-2478.g155268c4.el9.x 9.1 MB/s | 48 MB 00:05 2024-03-27T08:19:27.880 INFO:teuthology.orchestra.run.smithi173.stdout:(34/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 85 kB/s | 49 kB 00:00 2024-03-27T08:19:28.047 INFO:teuthology.orchestra.run.smithi173.stdout:(35/174): ceph-mgr-diskprediction-local-19.0.0- 4.2 MB/s | 7.4 MB 00:01 2024-03-27T08:19:28.080 INFO:teuthology.orchestra.run.smithi173.stdout:(36/174): ceph-prometheus-alerts-19.0.0-2478.g1 73 kB/s | 16 kB 00:00 2024-03-27T08:19:28.114 INFO:teuthology.orchestra.run.smithi173.stdout:(37/174): ceph-volume-19.0.0-2478.g155268c4.el9 1.1 MB/s | 264 kB 00:00 2024-03-27T08:19:28.231 INFO:teuthology.orchestra.run.smithi173.stdout:(38/174): cephfs-top-19.0.0-2478.g155268c4.el9. 122 kB/s | 18 kB 00:00 2024-03-27T08:19:28.281 INFO:teuthology.orchestra.run.smithi173.stdout:(39/174): cephadm-19.0.0-2478.g155268c4.el9.noa 3.2 MB/s | 762 kB 00:00 2024-03-27T08:19:28.365 INFO:teuthology.orchestra.run.smithi173.stdout:(40/174): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 662 kB 00:00 2024-03-27T08:19:28.407 INFO:teuthology.orchestra.run.smithi173.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 5.2 MB/s | 920 kB 00:00 2024-03-27T08:19:28.432 INFO:teuthology.orchestra.run.smithi173.stdout:(42/174): boost-program-options-1.75.0-8.el9.x8 716 kB/s | 106 kB 00:00 2024-03-27T08:19:28.466 INFO:teuthology.orchestra.run.smithi173.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 3.1 MB/s | 307 kB 00:00 2024-03-27T08:19:28.501 INFO:teuthology.orchestra.run.smithi164.stdout:(2/174): ceph-fuse-19.0.0-2478.g155268c4.el9.x8 829 kB/s | 890 kB 00:01 2024-03-27T08:19:28.524 INFO:teuthology.orchestra.run.smithi173.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 357 kB/s | 32 kB 00:00 2024-03-27T08:19:28.608 INFO:teuthology.orchestra.run.smithi173.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 17 MB/s | 3.0 MB 00:00 2024-03-27T08:19:28.633 INFO:teuthology.orchestra.run.smithi173.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 111 kB/s | 17 kB 00:00 2024-03-27T08:19:28.659 INFO:teuthology.orchestra.run.smithi173.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 83 kB/s | 10 kB 00:00 2024-03-27T08:19:28.675 INFO:teuthology.orchestra.run.smithi164.stdout:(3/174): ceph-immutable-object-cache-19.0.0-247 832 kB/s | 145 kB 00:00 2024-03-27T08:19:28.692 INFO:teuthology.orchestra.run.smithi173.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 159 kB 00:00 2024-03-27T08:19:28.717 INFO:teuthology.orchestra.run.smithi173.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 536 kB/s | 44 kB 00:00 2024-03-27T08:19:28.768 INFO:teuthology.orchestra.run.smithi173.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.1 MB/s | 661 kB 00:00 2024-03-27T08:19:28.793 INFO:teuthology.orchestra.run.smithi173.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 672 kB/s | 46 kB 00:00 2024-03-27T08:19:28.835 INFO:teuthology.orchestra.run.smithi173.stdout:(52/174): libtool-2.4.6-45.el9.x86_64.rpm 5.1 MB/s | 578 kB 00:00 2024-03-27T08:19:28.885 INFO:teuthology.orchestra.run.smithi173.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 282 kB 00:00 2024-03-27T08:19:28.919 INFO:teuthology.orchestra.run.smithi173.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 187 kB 00:00 2024-03-27T08:19:28.944 INFO:teuthology.orchestra.run.smithi173.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 608 kB/s | 34 kB 00:00 2024-03-27T08:19:28.980 INFO:teuthology.orchestra.run.smithi167.stdout:(173/174): librbd1-19.0.0-2478.g155268c4.el9.x8 822 kB/s | 3.1 MB 00:03 2024-03-27T08:19:28.986 INFO:teuthology.orchestra.run.smithi173.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.2 MB/s | 217 kB 00:00 2024-03-27T08:19:29.103 INFO:teuthology.orchestra.run.smithi173.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 26 MB/s | 4.7 MB 00:00 2024-03-27T08:19:29.145 INFO:teuthology.orchestra.run.smithi173.stdout:(58/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.5 MB/s | 1.0 MB 00:00 2024-03-27T08:19:29.170 INFO:teuthology.orchestra.run.smithi173.stdout:(59/174): python3-attrs-20.3.0-7.el9.noarch.rpm 457 kB/s | 78 kB 00:00 2024-03-27T08:19:29.212 INFO:teuthology.orchestra.run.smithi173.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 610 kB/s | 24 kB 00:00 2024-03-27T08:19:29.262 INFO:teuthology.orchestra.run.smithi173.stdout:(61/174): python3-jsonpointer-2.0-4.el9.noarch. 200 kB/s | 18 kB 00:00 2024-03-27T08:19:29.412 INFO:teuthology.orchestra.run.smithi173.stdout:(62/174): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2024-03-27T08:19:29.438 INFO:teuthology.orchestra.run.smithi173.stdout:(63/174): python3-markupsafe-1.1.1-12.el9.x86_6 197 kB/s | 32 kB 00:00 2024-03-27T08:19:29.463 INFO:teuthology.orchestra.run.smithi173.stdout:(64/174): python3-mako-1.1.4-6.el9.noarch.rpm 778 kB/s | 144 kB 00:00 2024-03-27T08:19:29.496 INFO:teuthology.orchestra.run.smithi173.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.8 MB/s | 217 kB 00:00 2024-03-27T08:19:29.655 INFO:teuthology.orchestra.run.smithi173.stdout:(66/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 22 MB/s | 4.8 MB 00:00 2024-03-27T08:19:29.680 INFO:teuthology.orchestra.run.smithi173.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 814 kB/s | 174 kB 00:00 2024-03-27T08:19:29.697 INFO:teuthology.orchestra.run.smithi173.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 370 kB/s | 69 kB 00:00 2024-03-27T08:19:29.739 INFO:teuthology.orchestra.run.smithi173.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-27T08:19:29.756 INFO:teuthology.orchestra.run.smithi173.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2024-03-27T08:19:29.790 INFO:teuthology.orchestra.run.smithi173.stdout:(71/174): python3-protobuf-3.14.0-13.el9.noarch 2.6 MB/s | 238 kB 00:00 2024-03-27T08:19:29.815 INFO:teuthology.orchestra.run.smithi173.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 850 kB/s | 47 kB 00:00 2024-03-27T08:19:29.849 INFO:teuthology.orchestra.run.smithi173.stdout:(73/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 211 kB 00:00 2024-03-27T08:19:29.874 INFO:teuthology.orchestra.run.smithi173.stdout:(74/174): python3-requests-oauthlib-1.3.0-12.el 515 kB/s | 43 kB 00:00 2024-03-27T08:19:29.876 INFO:teuthology.orchestra.run.smithi164.stdout:(4/174): ceph-base-19.0.0-2478.g155268c4.el9.x8 1.8 MB/s | 5.4 MB 00:02 2024-03-27T08:19:30.151 INFO:teuthology.orchestra.run.smithi164.stdout:(5/174): ceph-common-19.0.0-2478.g155268c4.el9. 6.4 MB/s | 21 MB 00:03 2024-03-27T08:19:30.234 INFO:teuthology.orchestra.run.smithi164.stdout:(6/174): ceph-mds-19.0.0-2478.g155268c4.el9.x86 1.5 MB/s | 2.4 MB 00:01 2024-03-27T08:19:30.341 INFO:teuthology.orchestra.run.smithi173.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 30 MB/s | 16 MB 00:00 2024-03-27T08:19:30.391 INFO:teuthology.orchestra.run.smithi173.stdout:(76/174): python3-toml-0.10.2-6.el9.noarch.rpm 77 kB/s | 39 kB 00:00 2024-03-27T08:19:30.416 INFO:teuthology.orchestra.run.smithi173.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 78 kB/s | 41 kB 00:00 2024-03-27T08:19:30.450 INFO:teuthology.orchestra.run.smithi173.stdout:(78/174): uuid-1.6.2-55.el9.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2024-03-27T08:19:30.451 INFO:teuthology.orchestra.run.smithi164.stdout:(7/174): ceph-mgr-19.0.0-2478.g155268c4.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-03-27T08:19:30.484 INFO:teuthology.orchestra.run.smithi173.stdout:(79/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 958 kB/s | 63 kB 00:00 2024-03-27T08:19:30.517 INFO:teuthology.orchestra.run.smithi173.stdout:(80/174): socat-1.7.4.1-5.el9.x86_64.rpm 2.9 MB/s | 300 kB 00:00 2024-03-27T08:19:30.534 INFO:teuthology.orchestra.run.smithi173.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 936 kB/s | 44 kB 00:00 2024-03-27T08:19:30.547 INFO:teuthology.orchestra.run.smithi167.stdout:(174/174): librados2-19.0.0-2478.g155268c4.el9. 629 kB/s | 3.4 MB 00:05 2024-03-27T08:19:30.559 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:19:30.560 INFO:teuthology.orchestra.run.smithi173.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 1.1 MB/s | 79 kB 00:00 2024-03-27T08:19:30.561 INFO:teuthology.orchestra.run.smithi167.stdout:Total 12 MB/s | 227 MB 00:18 2024-03-27T08:19:30.593 INFO:teuthology.orchestra.run.smithi173.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2024-03-27T08:19:30.618 INFO:teuthology.orchestra.run.smithi173.stdout:(84/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-27T08:19:30.652 INFO:teuthology.orchestra.run.smithi164.stdout:(8/174): ceph-mon-19.0.0-2478.g155268c4.el9.x86 9.4 MB/s | 4.7 MB 00:00 2024-03-27T08:19:30.669 INFO:teuthology.orchestra.run.smithi173.stdout:(85/174): python3-cryptography-36.0.1-4.el9.x86 11 MB/s | 1.1 MB 00:00 2024-03-27T08:19:30.694 INFO:teuthology.orchestra.run.smithi173.stdout:(86/174): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2024-03-27T08:19:30.702 INFO:teuthology.orchestra.run.smithi164.stdout:(9/174): ceph-selinux-19.0.0-2478.g155268c4.el9 509 kB/s | 25 kB 00:00 2024-03-27T08:19:30.757 INFO:teuthology.orchestra.run.smithi173.stdout:(87/174): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 187 kB 00:00 2024-03-27T08:19:31.369 INFO:teuthology.orchestra.run.smithi173.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 268 kB/s | 187 kB 00:00 2024-03-27T08:19:31.496 INFO:teuthology.orchestra.run.smithi173.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 265 kB/s | 195 kB 00:00 2024-03-27T08:19:31.520 INFO:teuthology.orchestra.run.smithi173.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 835 kB/s | 125 kB 00:00 2024-03-27T08:19:31.587 INFO:teuthology.orchestra.run.smithi173.stdout:(91/174): elfutils-libelf-devel-0.190-2.el9.x86 239 kB/s | 21 kB 00:00 2024-03-27T08:19:31.612 INFO:teuthology.orchestra.run.smithi173.stdout:(92/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 278 kB/s | 25 kB 00:00 2024-03-27T08:19:31.763 INFO:teuthology.orchestra.run.smithi173.stdout:(93/174): libgfortran-11.4.1-3.el9.x86_64.rpm 753 kB/s | 803 kB 00:01 2024-03-27T08:19:31.888 INFO:teuthology.orchestra.run.smithi173.stdout:(94/174): postgresql-13.14-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-03-27T08:19:31.980 INFO:teuthology.orchestra.run.smithi173.stdout:(95/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2024-03-27T08:19:32.013 INFO:teuthology.orchestra.run.smithi173.stdout:(96/174): postgresql-private-libs-13.14-1.el9.x 1.0 MB/s | 133 kB 00:00 2024-03-27T08:19:32.072 INFO:teuthology.orchestra.run.smithi173.stdout:(97/174): postgresql-contrib-13.14-1.el9.x86_64 2.9 MB/s | 911 kB 00:00 2024-03-27T08:19:32.114 INFO:teuthology.orchestra.run.smithi173.stdout:(98/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-27T08:19:32.148 INFO:teuthology.orchestra.run.smithi173.stdout:(99/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-03-27T08:19:32.198 INFO:teuthology.orchestra.run.smithi173.stdout:(100/174): qatlib-service-24.02.0-1.el9.x86_64. 727 kB/s | 36 kB 00:00 2024-03-27T08:19:32.202 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-03-27T08:19:32.259 INFO:teuthology.orchestra.run.smithi173.stdout:(101/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.5 MB/s | 221 kB 00:00 2024-03-27T08:19:32.282 INFO:teuthology.orchestra.run.smithi173.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 571 kB/s | 47 kB 00:00 2024-03-27T08:19:32.307 INFO:teuthology.orchestra.run.smithi173.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.9 MB/s | 94 kB 00:00 2024-03-27T08:19:32.332 INFO:teuthology.orchestra.run.smithi173.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 451 kB/s | 22 kB 00:00 2024-03-27T08:19:32.391 INFO:teuthology.orchestra.run.smithi173.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 10 MB/s | 863 kB 00:00 2024-03-27T08:19:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-03-27T08:19:32.584 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-03-27T08:19:32.617 INFO:teuthology.orchestra.run.smithi173.stdout:(106/174): postgresql-server-13.14-1.el9.x86_64 9.1 MB/s | 5.8 MB 00:00 2024-03-27T08:19:33.000 INFO:teuthology.orchestra.run.smithi173.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 51 kB/s | 19 kB 00:00 2024-03-27T08:19:33.042 INFO:teuthology.orchestra.run.smithi173.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 475 kB/s | 309 kB 00:00 2024-03-27T08:19:33.076 INFO:teuthology.orchestra.run.smithi173.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 738 kB/s | 548 kB 00:00 2024-03-27T08:19:33.134 INFO:teuthology.orchestra.run.smithi173.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 284 kB/s | 26 kB 00:00 2024-03-27T08:19:33.160 INFO:teuthology.orchestra.run.smithi173.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 585 kB/s | 49 kB 00:00 2024-03-27T08:19:33.227 INFO:teuthology.orchestra.run.smithi173.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 738 kB/s | 67 kB 00:00 2024-03-27T08:19:33.260 INFO:teuthology.orchestra.run.smithi173.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.5 MB/s | 151 kB 00:00 2024-03-27T08:19:33.427 INFO:teuthology.orchestra.run.smithi173.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 3.2 MB/s | 548 kB 00:00 2024-03-27T08:19:33.469 INFO:teuthology.orchestra.run.smithi173.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.4 MB/s | 838 kB 00:00 2024-03-27T08:19:33.529 INFO:teuthology.orchestra.run.smithi173.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 435 kB/s | 43 kB 00:00 2024-03-27T08:19:33.561 INFO:teuthology.orchestra.run.smithi173.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 351 kB/s | 32 kB 00:00 2024-03-27T08:19:33.662 INFO:teuthology.orchestra.run.smithi173.stdout:(118/174): libarrow-9.0.0-10.el9.x86_64.rpm 6.7 MB/s | 4.4 MB 00:00 2024-03-27T08:19:33.721 INFO:teuthology.orchestra.run.smithi173.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 78 kB/s | 15 kB 00:00 2024-03-27T08:19:33.754 INFO:teuthology.orchestra.run.smithi173.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 897 kB/s | 172 kB 00:00 2024-03-27T08:19:33.788 INFO:teuthology.orchestra.run.smithi173.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-03-27T08:19:33.821 INFO:teuthology.orchestra.run.smithi173.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.0 MB/s | 303 kB 00:00 2024-03-27T08:19:33.846 INFO:teuthology.orchestra.run.smithi173.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 385 kB/s | 35 kB 00:00 2024-03-27T08:19:33.880 INFO:teuthology.orchestra.run.smithi173.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-03-27T08:19:33.939 INFO:teuthology.orchestra.run.smithi173.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-03-27T08:19:33.964 INFO:teuthology.orchestra.run.smithi173.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 129 kB/s | 11 kB 00:00 2024-03-27T08:19:34.031 INFO:teuthology.orchestra.run.smithi173.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 9.7 MB/s | 2.0 MB 00:00 2024-03-27T08:19:34.081 INFO:teuthology.orchestra.run.smithi173.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 125 kB/s | 18 kB 00:00 2024-03-27T08:19:34.115 INFO:teuthology.orchestra.run.smithi173.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 154 kB/s | 23 kB 00:00 2024-03-27T08:19:34.141 INFO:teuthology.orchestra.run.smithi173.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 180 kB/s | 19 kB 00:00 2024-03-27T08:19:34.182 INFO:teuthology.orchestra.run.smithi173.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 299 kB/s | 20 kB 00:00 2024-03-27T08:19:34.216 INFO:teuthology.orchestra.run.smithi173.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 618 kB/s | 46 kB 00:00 2024-03-27T08:19:34.266 INFO:teuthology.orchestra.run.smithi173.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-03-27T08:19:34.283 INFO:teuthology.orchestra.run.smithi173.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 789 kB/s | 79 kB 00:00 2024-03-27T08:19:34.317 INFO:teuthology.orchestra.run.smithi173.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 576 kB/s | 58 kB 00:00 2024-03-27T08:19:34.367 INFO:teuthology.orchestra.run.smithi173.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 197 kB/s | 16 kB 00:00 2024-03-27T08:19:34.401 INFO:teuthology.orchestra.run.smithi173.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.0 MB/s | 272 kB 00:00 2024-03-27T08:19:34.446 INFO:teuthology.orchestra.run.smithi173.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 703 kB/s | 90 kB 00:00 2024-03-27T08:19:34.477 INFO:teuthology.orchestra.run.smithi173.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 261 kB/s | 28 kB 00:00 2024-03-27T08:19:34.485 INFO:teuthology.orchestra.run.smithi164.stdout:(10/174): ceph-radosgw-19.0.0-2478.g155268c4.el 2.4 MB/s | 9.8 MB 00:04 2024-03-27T08:19:34.502 INFO:teuthology.orchestra.run.smithi173.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 308 kB/s | 31 kB 00:00 2024-03-27T08:19:34.527 INFO:teuthology.orchestra.run.smithi173.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.3 MB/s | 188 kB 00:00 2024-03-27T08:19:34.569 INFO:teuthology.orchestra.run.smithi173.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 646 kB/s | 59 kB 00:00 2024-03-27T08:19:34.594 INFO:teuthology.orchestra.run.smithi173.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 391 kB/s | 36 kB 00:00 2024-03-27T08:19:34.620 INFO:teuthology.orchestra.run.smithi173.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 554 kB/s | 51 kB 00:00 2024-03-27T08:19:34.678 INFO:teuthology.orchestra.run.smithi173.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.1 MB/s | 230 kB 00:00 2024-03-27T08:19:34.712 INFO:teuthology.orchestra.run.smithi173.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 769 kB/s | 90 kB 00:00 2024-03-27T08:19:34.762 INFO:teuthology.orchestra.run.smithi173.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-03-27T08:19:34.788 INFO:teuthology.orchestra.run.smithi173.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 184 kB/s | 20 kB 00:00 2024-03-27T08:19:34.846 INFO:teuthology.orchestra.run.smithi173.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.4 MB/s | 192 kB 00:00 2024-03-27T08:19:34.914 INFO:teuthology.orchestra.run.smithi173.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-03-27T08:19:34.964 INFO:teuthology.orchestra.run.smithi173.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.4 MB/s | 321 kB 00:00 2024-03-27T08:19:34.969 INFO:teuthology.orchestra.run.smithi164.stdout:(11/174): ceph-test-19.0.0-2478.g155268c4.el9.x 11 MB/s | 48 MB 00:04 2024-03-27T08:19:35.002 INFO:teuthology.orchestra.run.smithi164.stdout:(12/174): cephfs-mirror-19.0.0-2478.g155268c4.e 429 kB/s | 221 kB 00:00 2024-03-27T08:19:35.053 INFO:teuthology.orchestra.run.smithi164.stdout:(13/174): cephfs-shell-19.0.0-2478.g155268c4.el 327 kB/s | 27 kB 00:00 2024-03-27T08:19:35.063 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-03-27T08:19:35.064 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-03-27T08:19:35.078 INFO:teuthology.orchestra.run.smithi164.stdout:(14/174): libcephfs-devel-19.0.0-2478.g155268c4 425 kB/s | 32 kB 00:00 2024-03-27T08:19:35.337 INFO:teuthology.orchestra.run.smithi164.stdout:(15/174): libcephsqlite-19.0.0-2478.g155268c4.e 634 kB/s | 163 kB 00:00 2024-03-27T08:19:35.378 INFO:teuthology.orchestra.run.smithi164.stdout:(16/174): libcephfs2-19.0.0-2478.g155268c4.el9. 2.2 MB/s | 746 kB 00:00 2024-03-27T08:19:35.429 INFO:teuthology.orchestra.run.smithi164.stdout:(17/174): librados-devel-19.0.0-2478.g155268c4. 1.4 MB/s | 127 kB 00:00 2024-03-27T08:19:35.496 INFO:teuthology.orchestra.run.smithi164.stdout:(18/174): libradosstriper1-19.0.0-2478.g155268c 4.2 MB/s | 501 kB 00:00 2024-03-27T08:19:35.562 INFO:teuthology.orchestra.run.smithi164.stdout:(19/174): python3-ceph-argparse-19.0.0-2478.g15 685 kB/s | 45 kB 00:00 2024-03-27T08:19:35.589 INFO:teuthology.orchestra.run.smithi173.stdout:(152/174): librados2-19.0.0-2478.g155268c4.el9. 4.2 MB/s | 3.4 MB 00:00 2024-03-27T08:19:35.688 INFO:teuthology.orchestra.run.smithi164.stdout:(20/174): python3-ceph-common-19.0.0-2478.g1552 1.1 MB/s | 134 kB 00:00 2024-03-27T08:19:35.740 INFO:teuthology.orchestra.run.smithi173.stdout:(153/174): librbd1-19.0.0-2478.g155268c4.el9.x8 3.5 MB/s | 3.1 MB 00:00 2024-03-27T08:19:35.771 INFO:teuthology.orchestra.run.smithi164.stdout:(21/174): python3-cephfs-19.0.0-2478.g155268c4. 1.9 MB/s | 162 kB 00:00 2024-03-27T08:19:35.855 INFO:teuthology.orchestra.run.smithi164.stdout:(22/174): python3-rados-19.0.0-2478.g155268c4.e 3.8 MB/s | 320 kB 00:00 2024-03-27T08:19:35.947 INFO:teuthology.orchestra.run.smithi164.stdout:(23/174): python3-rbd-19.0.0-2478.g155268c4.el9 3.2 MB/s | 298 kB 00:00 2024-03-27T08:19:35.948 INFO:teuthology.orchestra.run.smithi173.stdout:(154/174): NetworkManager-1.47.2-1.el9.x86_64.r 2.3 MB/s | 2.3 MB 00:00 2024-03-27T08:19:36.007 INFO:teuthology.orchestra.run.smithi173.stdout:(155/174): NetworkManager-team-1.47.2-1.el9.x86 158 kB/s | 42 kB 00:00 2024-03-27T08:19:36.057 INFO:teuthology.orchestra.run.smithi173.stdout:(156/174): NetworkManager-tui-1.47.2-1.el9.x86_ 2.2 MB/s | 248 kB 00:00 2024-03-27T08:19:36.174 INFO:teuthology.orchestra.run.smithi173.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 313 kB/s | 36 kB 00:00 2024-03-27T08:19:36.190 INFO:teuthology.orchestra.run.smithi164.stdout:(24/174): ceph-osd-19.0.0-2478.g155268c4.el9.x8 2.8 MB/s | 17 MB 00:05 2024-03-27T08:19:36.199 INFO:teuthology.orchestra.run.smithi173.stdout:(158/174): acl-2.3.1-4.el9.x86_64.rpm 372 kB/s | 71 kB 00:00 2024-03-27T08:19:36.222 INFO:teuthology.orchestra.run.smithi164.stdout:(25/174): python3-rgw-19.0.0-2478.g155268c4.el9 362 kB/s | 99 kB 00:00 2024-03-27T08:19:36.264 INFO:teuthology.orchestra.run.smithi164.stdout:(26/174): rbd-fuse-19.0.0-2478.g155268c4.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-27T08:19:36.316 INFO:teuthology.orchestra.run.smithi173.stdout:(159/174): elfutils-libelf-0.190-2.el9.x86_64.r 1.3 MB/s | 192 kB 00:00 2024-03-27T08:19:36.373 INFO:teuthology.orchestra.run.smithi164.stdout:(27/174): rbd-nbd-19.0.0-2478.g155268c4.el9.x86 1.6 MB/s | 170 kB 00:00 2024-03-27T08:19:36.394 INFO:teuthology.orchestra.run.smithi173.stdout:(160/174): NetworkManager-libnm-1.47.2-1.el9.x8 2.3 MB/s | 1.8 MB 00:00 2024-03-27T08:19:36.425 INFO:teuthology.orchestra.run.smithi173.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 214 kB/s | 23 kB 00:00 2024-03-27T08:19:36.467 INFO:teuthology.orchestra.run.smithi173.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 958 kB/s | 256 kB 00:00 2024-03-27T08:19:36.473 INFO:teuthology.orchestra.run.smithi164.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2478.g 341 kB/s | 34 kB 00:00 2024-03-27T08:19:36.509 INFO:teuthology.orchestra.run.smithi173.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 928 kB/s | 108 kB 00:00 2024-03-27T08:19:36.543 INFO:teuthology.orchestra.run.smithi173.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 155 kB 00:00 2024-03-27T08:19:36.557 INFO:teuthology.orchestra.run.smithi164.stdout:(29/174): rbd-mirror-19.0.0-2478.g155268c4.el9. 9.3 MB/s | 3.1 MB 00:00 2024-03-27T08:19:36.577 INFO:teuthology.orchestra.run.smithi173.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 1.2 MB/s | 136 kB 00:00 2024-03-27T08:19:36.590 INFO:teuthology.orchestra.run.smithi164.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2478.g155268c 1.2 MB/s | 141 kB 00:00 2024-03-27T08:19:36.619 INFO:teuthology.orchestra.run.smithi173.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 590 kB/s | 64 kB 00:00 2024-03-27T08:19:36.686 INFO:teuthology.orchestra.run.smithi173.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 201 kB/s | 29 kB 00:00 2024-03-27T08:19:36.869 INFO:teuthology.orchestra.run.smithi173.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 8.6 MB/s | 2.2 MB 00:00 2024-03-27T08:19:36.932 INFO:teuthology.orchestra.run.smithi164.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2478.g15526 9.4 MB/s | 3.5 MB 00:00 2024-03-27T08:19:36.995 INFO:teuthology.orchestra.run.smithi173.stdout:(169/174): openssl-3.0.7-27.el9.x86_64.rpm 2.9 MB/s | 1.2 MB 00:00 2024-03-27T08:19:36.999 INFO:teuthology.orchestra.run.smithi164.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2478.g15 3.7 MB/s | 249 kB 00:00 2024-03-27T08:19:37.070 INFO:teuthology.orchestra.run.smithi173.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 2.3 MB/s | 465 kB 00:00 2024-03-27T08:19:37.084 INFO:teuthology.orchestra.run.smithi164.stdout:(33/174): ceph-mgr-rook-19.0.0-2478.g155268c4.e 595 kB/s | 49 kB 00:00 2024-03-27T08:19:37.104 INFO:teuthology.orchestra.run.smithi173.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 288 kB/s | 31 kB 00:00 2024-03-27T08:19:37.133 INFO:teuthology.orchestra.run.smithi164.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2478.g1 335 kB/s | 16 kB 00:00 2024-03-27T08:19:37.192 INFO:teuthology.orchestra.run.smithi164.stdout:(35/174): ceph-volume-19.0.0-2478.g155268c4.el9 4.5 MB/s | 264 kB 00:00 2024-03-27T08:19:37.202 INFO:teuthology.orchestra.run.smithi173.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 898 kB/s | 74 kB 00:00 2024-03-27T08:19:37.238 INFO:teuthology.orchestra.run.smithi173.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.4 MB/s | 1.1 MB 00:00 2024-03-27T08:19:37.317 INFO:teuthology.orchestra.run.smithi164.stdout:(36/174): librgw2-19.0.0-2478.g155268c4.el9.x86 2.7 MB/s | 5.1 MB 00:01 2024-03-27T08:19:37.367 INFO:teuthology.orchestra.run.smithi164.stdout:(37/174): cephadm-19.0.0-2478.g155268c4.el9.noa 4.3 MB/s | 762 kB 00:00 2024-03-27T08:19:37.393 INFO:teuthology.orchestra.run.smithi164.stdout:(38/174): cephfs-top-19.0.0-2478.g155268c4.el9. 245 kB/s | 18 kB 00:00 2024-03-27T08:19:37.580 INFO:teuthology.orchestra.run.smithi173.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 2.3 MB 00:00 2024-03-27T08:19:37.587 INFO:teuthology.orchestra.run.smithi173.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:19:37.588 INFO:teuthology.orchestra.run.smithi173.stdout:Total 13 MB/s | 227 MB 00:17 2024-03-27T08:19:37.785 INFO:teuthology.orchestra.run.smithi164.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 662 kB 00:00 2024-03-27T08:19:37.844 INFO:teuthology.orchestra.run.smithi164.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 2.0 MB/s | 920 kB 00:00 2024-03-27T08:19:37.869 INFO:teuthology.orchestra.run.smithi164.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 106 kB 00:00 2024-03-27T08:19:37.903 INFO:teuthology.orchestra.run.smithi164.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 5.3 MB/s | 307 kB 00:00 2024-03-27T08:19:37.928 INFO:teuthology.orchestra.run.smithi164.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 562 kB/s | 32 kB 00:00 2024-03-27T08:19:38.103 INFO:teuthology.orchestra.run.smithi164.stdout:(44/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2024-03-27T08:19:38.129 INFO:teuthology.orchestra.run.smithi164.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 88 kB/s | 17 kB 00:00 2024-03-27T08:19:38.162 INFO:teuthology.orchestra.run.smithi164.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 315 kB/s | 10 kB 00:00 2024-03-27T08:19:38.195 INFO:teuthology.orchestra.run.smithi164.stdout:(47/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 159 kB 00:00 2024-03-27T08:19:38.221 INFO:teuthology.orchestra.run.smithi164.stdout:(48/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 789 kB/s | 44 kB 00:00 2024-03-27T08:19:38.263 INFO:teuthology.orchestra.run.smithi164.stdout:(49/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.8 MB/s | 661 kB 00:00 2024-03-27T08:19:38.305 INFO:teuthology.orchestra.run.smithi164.stdout:(50/174): libtool-2.4.6-45.el9.x86_64.rpm 7.3 MB/s | 578 kB 00:00 2024-03-27T08:19:38.330 INFO:teuthology.orchestra.run.smithi164.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 756 kB/s | 46 kB 00:00 2024-03-27T08:19:38.364 INFO:teuthology.orchestra.run.smithi164.stdout:(52/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2024-03-27T08:19:38.397 INFO:teuthology.orchestra.run.smithi164.stdout:(53/174): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2024-03-27T08:19:38.431 INFO:teuthology.orchestra.run.smithi164.stdout:(54/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2024-03-27T08:19:38.456 INFO:teuthology.orchestra.run.smithi164.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 610 kB/s | 34 kB 00:00 2024-03-27T08:19:38.611 INFO:teuthology.orchestra.run.smithi164.stdout:(56/174): openblas-openmp-0.3.21-2.el9.x86_64.r 27 MB/s | 4.7 MB 00:00 2024-03-27T08:19:38.665 INFO:teuthology.orchestra.run.smithi164.stdout:(57/174): protobuf-3.14.0-13.el9.x86_64.rpm 5.2 MB/s | 1.0 MB 00:00 2024-03-27T08:19:38.690 INFO:teuthology.orchestra.run.smithi164.stdout:(58/174): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 78 kB 00:00 2024-03-27T08:19:38.832 INFO:teuthology.orchestra.run.smithi164.stdout:(59/174): python3-babel-2.9.1-2.el9.noarch.rpm 35 MB/s | 5.8 MB 00:00 2024-03-27T08:19:38.857 INFO:teuthology.orchestra.run.smithi164.stdout:(60/174): python3-jsonpatch-1.21-16.el9.noarch. 161 kB/s | 24 kB 00:00 2024-03-27T08:19:38.999 INFO:teuthology.orchestra.run.smithi164.stdout:(61/174): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2024-03-27T08:19:39.024 INFO:teuthology.orchestra.run.smithi164.stdout:(62/174): python3-jsonpointer-2.0-4.el9.noarch. 109 kB/s | 18 kB 00:00 2024-03-27T08:19:39.050 INFO:teuthology.orchestra.run.smithi164.stdout:(63/174): python3-mako-1.1.4-6.el9.noarch.rpm 756 kB/s | 144 kB 00:00 2024-03-27T08:19:39.075 INFO:teuthology.orchestra.run.smithi164.stdout:(64/174): python3-markupsafe-1.1.1-12.el9.x86_6 432 kB/s | 32 kB 00:00 2024-03-27T08:19:39.108 INFO:teuthology.orchestra.run.smithi164.stdout:(65/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 217 kB 00:00 2024-03-27T08:19:39.173 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction check 2024-03-27T08:19:39.250 INFO:teuthology.orchestra.run.smithi164.stdout:(66/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 24 MB/s | 4.8 MB 00:00 2024-03-27T08:19:39.275 INFO:teuthology.orchestra.run.smithi164.stdout:(67/174): python3-oauthlib-3.1.1-5.el9.noarch.r 884 kB/s | 174 kB 00:00 2024-03-27T08:19:39.300 INFO:teuthology.orchestra.run.smithi164.stdout:(68/174): python3-packaging-20.9-5.el9.noarch.r 387 kB/s | 69 kB 00:00 2024-03-27T08:19:39.343 INFO:teuthology.orchestra.run.smithi164.stdout:(69/174): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 41 kB 00:00 2024-03-27T08:19:39.368 INFO:teuthology.orchestra.run.smithi164.stdout:(70/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.0 MB/s | 132 kB 00:00 2024-03-27T08:19:39.401 INFO:teuthology.orchestra.run.smithi164.stdout:(71/174): python3-protobuf-3.14.0-13.el9.noarch 2.4 MB/s | 238 kB 00:00 2024-03-27T08:19:39.427 INFO:teuthology.orchestra.run.smithi164.stdout:(72/174): python3-pytz-2021.1-5.el9.noarch.rpm 853 kB/s | 47 kB 00:00 2024-03-27T08:19:39.469 INFO:teuthology.orchestra.run.smithi164.stdout:(73/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.1 MB/s | 211 kB 00:00 2024-03-27T08:19:39.502 INFO:teuthology.orchestra.run.smithi164.stdout:(74/174): python3-requests-oauthlib-1.3.0-12.el 429 kB/s | 43 kB 00:00 2024-03-27T08:19:39.550 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction check succeeded. 2024-03-27T08:19:39.550 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction test 2024-03-27T08:19:39.861 INFO:teuthology.orchestra.run.smithi164.stdout:(75/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-27T08:19:39.886 INFO:teuthology.orchestra.run.smithi164.stdout:(76/174): python3-toml-0.10.2-6.el9.noarch.rpm 104 kB/s | 39 kB 00:00 2024-03-27T08:19:39.911 INFO:teuthology.orchestra.run.smithi164.stdout:(77/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 104 kB/s | 41 kB 00:00 2024-03-27T08:19:39.945 INFO:teuthology.orchestra.run.smithi164.stdout:(78/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.6 MB/s | 300 kB 00:00 2024-03-27T08:19:39.970 INFO:teuthology.orchestra.run.smithi164.stdout:(79/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2024-03-27T08:19:39.995 INFO:teuthology.orchestra.run.smithi164.stdout:(80/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 784 kB/s | 63 kB 00:00 2024-03-27T08:19:40.021 INFO:teuthology.orchestra.run.smithi164.stdout:(81/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 598 kB/s | 44 kB 00:00 2024-03-27T08:19:40.054 INFO:teuthology.orchestra.run.smithi164.stdout:(82/174): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2024-03-27T08:19:40.079 INFO:teuthology.orchestra.run.smithi164.stdout:(83/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.9 MB/s | 241 kB 00:00 2024-03-27T08:19:40.138 INFO:teuthology.orchestra.run.smithi164.stdout:(84/174): python3-cryptography-36.0.1-4.el9.x86 10 MB/s | 1.1 MB 00:00 2024-03-27T08:19:40.163 INFO:teuthology.orchestra.run.smithi164.stdout:(85/174): python3-pycparser-2.20-6.el9.noarch.r 1.7 MB/s | 124 kB 00:00 2024-03-27T08:19:40.188 INFO:teuthology.orchestra.run.smithi164.stdout:(86/174): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 103 kB 00:00 2024-03-27T08:19:40.213 INFO:teuthology.orchestra.run.smithi164.stdout:(87/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 187 kB 00:00 2024-03-27T08:19:40.339 INFO:teuthology.orchestra.run.smithi164.stdout:(88/174): jq-1.6-16.el9.x86_64.rpm 1.1 MB/s | 187 kB 00:00 2024-03-27T08:19:40.364 INFO:teuthology.orchestra.run.smithi164.stdout:(89/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.3 MB/s | 195 kB 00:00 2024-03-27T08:19:40.428 INFO:teuthology.orchestra.run.smithi164.stdout:(90/174): python3-requests-2.25.1-8.el9.noarch. 1.4 MB/s | 125 kB 00:00 2024-03-27T08:19:40.498 INFO:teuthology.orchestra.run.smithi164.stdout:(91/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.8 MB/s | 803 kB 00:00 2024-03-27T08:19:40.740 INFO:teuthology.orchestra.run.smithi164.stdout:(92/174): elfutils-libelf-devel-0.190-2.el9.x86 57 kB/s | 21 kB 00:00 2024-03-27T08:19:40.765 INFO:teuthology.orchestra.run.smithi164.stdout:(93/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 76 kB/s | 25 kB 00:00 2024-03-27T08:19:41.007 INFO:teuthology.orchestra.run.smithi164.stdout:(94/174): postgresql-contrib-13.14-1.el9.x86_64 3.7 MB/s | 911 kB 00:00 2024-03-27T08:19:41.133 INFO:teuthology.orchestra.run.smithi164.stdout:(95/174): postgresql-13.14-1.el9.x86_64.rpm 4.1 MB/s | 1.6 MB 00:00 2024-03-27T08:19:41.166 INFO:teuthology.orchestra.run.smithi164.stdout:(96/174): postgresql-private-libs-13.14-1.el9.x 844 kB/s | 133 kB 00:00 2024-03-27T08:19:41.266 INFO:teuthology.orchestra.run.smithi164.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 2.4 MB/s | 245 kB 00:00 2024-03-27T08:19:41.360 INFO:teuthology.orchestra.run.smithi164.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.6 MB/s | 248 kB 00:00 2024-03-27T08:19:41.450 INFO:teuthology.orchestra.run.smithi164.stdout:(99/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 4.7 MB/s | 4.1 MB 00:00 2024-03-27T08:19:41.517 INFO:teuthology.orchestra.run.smithi164.stdout:(100/174): qatlib-24.02.0-1.el9.x86_64.rpm 1.4 MB/s | 221 kB 00:00 2024-03-27T08:19:41.567 INFO:teuthology.orchestra.run.smithi164.stdout:(101/174): qatlib-service-24.02.0-1.el9.x86_64. 309 kB/s | 36 kB 00:00 2024-03-27T08:19:41.609 INFO:teuthology.orchestra.run.smithi164.stdout:(102/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 519 kB/s | 47 kB 00:00 2024-03-27T08:19:41.643 INFO:teuthology.orchestra.run.smithi164.stdout:(103/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.2 MB/s | 94 kB 00:00 2024-03-27T08:19:41.685 INFO:teuthology.orchestra.run.smithi164.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 300 kB/s | 22 kB 00:00 2024-03-27T08:19:41.777 INFO:teuthology.orchestra.run.smithi164.stdout:(105/174): protobuf-compiler-3.14.0-13.el9.x86_ 6.4 MB/s | 863 kB 00:00 2024-03-27T08:19:41.902 INFO:teuthology.orchestra.run.smithi164.stdout:(106/174): postgresql-server-13.14-1.el9.x86_64 7.5 MB/s | 5.8 MB 00:00 2024-03-27T08:19:41.955 INFO:teuthology.orchestra.run.smithi173.stdout:Transaction test succeeded. 2024-03-27T08:19:41.956 INFO:teuthology.orchestra.run.smithi173.stdout:Running transaction 2024-03-27T08:19:41.986 INFO:teuthology.orchestra.run.smithi164.stdout:(107/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-03-27T08:19:42.011 INFO:teuthology.orchestra.run.smithi164.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 182 kB/s | 19 kB 00:00 2024-03-27T08:19:42.069 INFO:teuthology.orchestra.run.smithi164.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.0 MB/s | 309 kB 00:00 2024-03-27T08:19:42.095 INFO:teuthology.orchestra.run.smithi164.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 314 kB/s | 26 kB 00:00 2024-03-27T08:19:42.162 INFO:teuthology.orchestra.run.smithi164.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 741 kB/s | 49 kB 00:00 2024-03-27T08:19:42.187 INFO:teuthology.orchestra.run.smithi164.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 744 kB/s | 67 kB 00:00 2024-03-27T08:19:42.221 INFO:teuthology.orchestra.run.smithi164.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-03-27T08:19:42.329 INFO:teuthology.orchestra.run.smithi164.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-03-27T08:19:42.371 INFO:teuthology.orchestra.run.smithi164.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-03-27T08:19:42.396 INFO:teuthology.orchestra.run.smithi164.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 654 kB/s | 43 kB 00:00 2024-03-27T08:19:42.421 INFO:teuthology.orchestra.run.smithi164.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 652 kB/s | 32 kB 00:00 2024-03-27T08:19:42.438 INFO:teuthology.orchestra.run.smithi164.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 365 kB/s | 15 kB 00:00 2024-03-27T08:19:42.468 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-03-27T08:19:42.480 INFO:teuthology.orchestra.run.smithi164.stdout:(119/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 838 kB 00:00 2024-03-27T08:19:42.522 INFO:teuthology.orchestra.run.smithi164.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.7 MB/s | 172 kB 00:00 2024-03-27T08:19:42.564 INFO:teuthology.orchestra.run.smithi164.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 2.8 MB/s | 358 kB 00:00 2024-03-27T08:19:42.581 INFO:teuthology.orchestra.run.smithi164.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 611 kB/s | 35 kB 00:00 2024-03-27T08:19:42.596 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T08:19:42.615 INFO:teuthology.orchestra.run.smithi164.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.2 MB/s | 303 kB 00:00 2024-03-27T08:19:42.645 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T08:19:42.648 INFO:teuthology.orchestra.run.smithi164.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.4 MB/s | 203 kB 00:00 2024-03-27T08:19:42.674 INFO:teuthology.orchestra.run.smithi164.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2024-03-27T08:19:42.691 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:42.722 INFO:teuthology.orchestra.run.smithi164.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 146 kB/s | 11 kB 00:00 2024-03-27T08:19:42.738 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:42.741 INFO:teuthology.orchestra.run.smithi164.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 267 kB/s | 18 kB 00:00 2024-03-27T08:19:42.758 INFO:teuthology.orchestra.run.smithi164.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 674 kB/s | 23 kB 00:00 2024-03-27T08:19:42.783 INFO:teuthology.orchestra.run.smithi164.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 471 kB/s | 19 kB 00:00 2024-03-27T08:19:42.800 INFO:teuthology.orchestra.run.smithi164.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 476 kB/s | 20 kB 00:00 2024-03-27T08:19:42.831 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T08:19:42.892 INFO:teuthology.orchestra.run.smithi164.stdout:(131/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.6 MB/s | 2.0 MB 00:00 2024-03-27T08:19:42.917 INFO:teuthology.orchestra.run.smithi164.stdout:(132/174): python3-logutils-0.3.5-21.el9.noarch 398 kB/s | 46 kB 00:00 2024-03-27T08:19:42.926 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T08:19:42.943 INFO:teuthology.orchestra.run.smithi164.stdout:(133/174): python3-more-itertools-8.12.0-2.el9. 1.6 MB/s | 79 kB 00:00 2024-03-27T08:19:42.982 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T08:19:42.993 INFO:teuthology.orchestra.run.smithi164.stdout:(134/174): python3-kubernetes-26.1.0-2.el9.noar 4.9 MB/s | 1.0 MB 00:00 2024-03-27T08:19:43.014 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T08:19:43.018 INFO:teuthology.orchestra.run.smithi164.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 578 kB/s | 58 kB 00:00 2024-03-27T08:19:43.043 INFO:teuthology.orchestra.run.smithi164.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 336 kB/s | 16 kB 00:00 2024-03-27T08:19:43.085 INFO:teuthology.orchestra.run.smithi164.stdout:(137/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.9 MB/s | 272 kB 00:00 2024-03-27T08:19:43.106 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T08:19:43.111 INFO:teuthology.orchestra.run.smithi164.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 981 kB/s | 90 kB 00:00 2024-03-27T08:19:43.136 INFO:teuthology.orchestra.run.smithi164.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 308 kB/s | 28 kB 00:00 2024-03-27T08:19:43.161 INFO:teuthology.orchestra.run.smithi164.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 412 kB/s | 31 kB 00:00 2024-03-27T08:19:43.186 INFO:teuthology.orchestra.run.smithi164.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-03-27T08:19:43.212 INFO:teuthology.orchestra.run.smithi164.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 723 kB/s | 36 kB 00:00 2024-03-27T08:19:43.237 INFO:teuthology.orchestra.run.smithi164.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-03-27T08:19:43.283 INFO:teuthology.orchestra.run.smithi164.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 533 kB/s | 51 kB 00:00 2024-03-27T08:19:43.312 INFO:teuthology.orchestra.run.smithi164.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.3 MB/s | 230 kB 00:00 2024-03-27T08:19:43.338 INFO:teuthology.orchestra.run.smithi164.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 1.6 MB/s | 90 kB 00:00 2024-03-27T08:19:43.363 INFO:teuthology.orchestra.run.smithi164.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 404 kB/s | 20 kB 00:00 2024-03-27T08:19:43.397 INFO:teuthology.orchestra.run.smithi164.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-03-27T08:19:43.430 INFO:teuthology.orchestra.run.smithi164.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-03-27T08:19:43.516 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T08:19:43.562 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:43.630 INFO:teuthology.orchestra.run.smithi164.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 5.9 MB/s | 1.6 MB 00:00 2024-03-27T08:19:43.711 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:43.737 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:43.789 INFO:teuthology.orchestra.run.smithi164.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 2.0 MB/s | 321 kB 00:00 2024-03-27T08:19:43.856 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:43.911 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:19:43.971 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T08:19:43.981 INFO:teuthology.orchestra.run.smithi164.stdout:(152/174): librados2-19.0.0-2478.g155268c4.el9. 5.8 MB/s | 3.4 MB 00:00 2024-03-27T08:19:44.081 INFO:teuthology.orchestra.run.smithi164.stdout:(153/174): NetworkManager-1.47.2-1.el9.x86_64.r 7.9 MB/s | 2.3 MB 00:00 2024-03-27T08:19:44.123 INFO:teuthology.orchestra.run.smithi164.stdout:(154/174): NetworkManager-team-1.47.2-1.el9.x86 1.0 MB/s | 42 kB 00:00 2024-03-27T08:19:44.173 INFO:teuthology.orchestra.run.smithi164.stdout:(155/174): NetworkManager-tui-1.47.2-1.el9.x86_ 5.0 MB/s | 248 kB 00:00 2024-03-27T08:19:44.243 INFO:teuthology.orchestra.run.smithi164.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-03-27T08:19:44.263 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T08:19:44.317 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T08:19:44.326 INFO:teuthology.orchestra.run.smithi164.stdout:(157/174): librbd1-19.0.0-2478.g155268c4.el9.x8 3.8 MB/s | 3.1 MB 00:00 2024-03-27T08:19:44.343 INFO:teuthology.orchestra.run.smithi164.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 366 kB/s | 36 kB 00:00 2024-03-27T08:19:44.366 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:44.402 INFO:teuthology.orchestra.run.smithi164.stdout:(159/174): NetworkManager-libnm-1.47.2-1.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-03-27T08:19:44.452 INFO:teuthology.orchestra.run.smithi164.stdout:(160/174): elfutils-libs-0.190-2.el9.x86_64.rpm 2.3 MB/s | 256 kB 00:00 2024-03-27T08:19:44.469 INFO:teuthology.orchestra.run.smithi164.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 347 kB/s | 23 kB 00:00 2024-03-27T08:19:44.503 INFO:teuthology.orchestra.run.smithi164.stdout:(162/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-27T08:19:44.528 INFO:teuthology.orchestra.run.smithi164.stdout:(163/174): elfutils-libelf-0.190-2.el9.x86_64.r 956 kB/s | 192 kB 00:00 2024-03-27T08:19:44.529 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:44.561 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:44.581 INFO:teuthology.orchestra.run.smithi164.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.3 MB/s | 64 kB 00:00 2024-03-27T08:19:44.629 INFO:teuthology.orchestra.run.smithi164.stdout:(165/174): libfdisk-2.37.4-18.el9.x86_64.rpm 977 kB/s | 155 kB 00:00 2024-03-27T08:19:44.651 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:44.654 INFO:teuthology.orchestra.run.smithi164.stdout:(166/174): libmount-2.37.4-18.el9.x86_64.rpm 904 kB/s | 136 kB 00:00 2024-03-27T08:19:44.679 INFO:teuthology.orchestra.run.smithi164.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 287 kB/s | 29 kB 00:00 2024-03-27T08:19:44.704 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T08:19:44.729 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:44.779 INFO:teuthology.orchestra.run.smithi164.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 9.7 MB/s | 1.2 MB 00:00 2024-03-27T08:19:44.801 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:44.880 INFO:teuthology.orchestra.run.smithi164.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.6 MB/s | 2.2 MB 00:00 2024-03-27T08:19:44.913 INFO:teuthology.orchestra.run.smithi164.stdout:(170/174): util-linux-core-2.37.4-18.el9.x86_64 3.4 MB/s | 465 kB 00:00 2024-03-27T08:19:44.990 INFO:teuthology.orchestra.run.smithi164.stdout:(171/174): util-linux-2.37.4-18.el9.x86_64.rpm 7.4 MB/s | 2.3 MB 00:00 2024-03-27T08:19:45.039 INFO:teuthology.orchestra.run.smithi164.stdout:(172/174): util-linux-user-2.37.4-18.el9.x86_64 250 kB/s | 31 kB 00:00 2024-03-27T08:19:45.106 INFO:teuthology.orchestra.run.smithi164.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 5.6 MB/s | 1.1 MB 00:00 2024-03-27T08:19:45.140 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:45.195 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:45.238 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T08:19:45.289 INFO:teuthology.orchestra.run.smithi164.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 248 kB/s | 74 kB 00:00 2024-03-27T08:19:45.299 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:19:45.300 INFO:teuthology.orchestra.run.smithi164.stdout:Total 12 MB/s | 227 MB 00:19 2024-03-27T08:19:45.541 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T08:19:45.737 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:19:45.851 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:19:46.018 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:46.098 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:46.477 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:46.662 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T08:19:46.949 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction check 2024-03-27T08:19:47.123 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T08:19:47.163 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T08:19:47.211 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T08:19:47.285 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T08:19:47.327 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction check succeeded. 2024-03-27T08:19:47.327 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction test 2024-03-27T08:19:47.402 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T08:19:47.475 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T08:19:47.523 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T08:19:47.624 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T08:19:47.669 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T08:19:47.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T08:19:47.773 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T08:19:47.805 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T08:19:47.948 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T08:19:47.988 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T08:19:48.034 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T08:19:48.071 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T08:19:48.182 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T08:19:48.245 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T08:19:48.346 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T08:19:48.523 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T08:19:48.589 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T08:19:49.280 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T08:19:49.385 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T08:19:49.492 INFO:teuthology.orchestra.run.smithi173.stdout: Preparing : 1/1 2024-03-27T08:19:49.493 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T08:19:49.538 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:19:49.564 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:19:49.615 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T08:19:49.685 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T08:19:49.712 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T08:19:49.713 INFO:teuthology.orchestra.run.smithi164.stdout:Transaction test succeeded. 2024-03-27T08:19:49.713 INFO:teuthology.orchestra.run.smithi164.stdout:Running transaction 2024-03-27T08:19:49.738 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T08:19:49.761 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T08:19:49.807 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:49.815 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T08:19:49.851 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:49.937 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T08:19:50.037 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T08:19:50.090 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T08:19:50.120 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T08:19:50.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T08:19:50.265 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T08:19:50.500 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T08:19:50.601 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T08:19:50.608 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T08:19:50.652 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:50.657 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T08:19:50.820 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:50.855 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:50.859 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T08:19:50.916 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T08:19:50.959 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:50.993 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T08:19:50.995 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:19:51.059 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T08:19:51.086 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T08:19:51.124 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T08:19:51.180 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T08:19:51.249 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T08:19:51.297 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T08:19:51.360 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T08:19:51.386 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T08:19:51.426 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T08:19:51.443 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T08:19:51.468 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:51.619 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T08:19:51.644 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:51.670 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T08:19:51.677 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:51.707 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T08:19:51.768 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:51.791 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T08:19:51.813 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T08:19:51.838 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:51.898 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:51.936 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T08:19:51.973 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T08:19:52.019 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T08:19:52.056 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T08:19:52.089 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T08:19:52.180 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:52.221 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:52.260 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T08:19:52.296 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T08:19:52.440 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T08:19:52.575 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T08:19:52.601 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T08:19:52.625 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T08:19:52.688 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T08:19:52.778 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:19:52.787 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T08:19:52.867 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:19:53.039 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T08:19:53.059 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:53.097 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T08:19:53.114 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:53.273 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T08:19:53.328 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T08:19:53.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T08:19:53.415 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T08:19:53.448 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:19:53.456 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T08:19:53.501 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T08:19:53.571 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T08:19:53.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T08:19:53.638 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T08:19:53.719 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T08:19:53.766 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T08:19:53.807 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T08:19:53.841 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T08:19:53.864 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T08:19:53.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T08:19:53.912 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T08:19:53.948 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T08:19:54.015 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T08:19:54.019 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T08:19:54.060 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T08:19:54.086 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T08:19:54.136 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T08:19:54.206 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T08:19:54.236 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T08:19:54.276 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T08:19:54.323 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T08:19:54.335 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T08:19:54.379 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T08:19:54.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T08:19:54.422 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T08:19:54.425 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T08:19:54.483 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T08:19:54.565 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T08:19:54.608 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T08:19:54.626 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T08:19:54.659 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T08:19:54.689 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T08:19:54.702 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T08:19:54.806 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T08:19:54.899 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T08:19:55.002 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T08:19:55.186 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T08:19:55.269 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T08:19:55.603 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T08:19:55.691 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T08:19:55.725 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T08:19:55.786 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T08:19:55.906 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T08:19:55.950 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T08:19:55.957 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T08:19:56.058 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T08:19:56.166 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T08:19:56.184 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T08:19:56.210 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:19:56.222 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T08:19:56.237 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:19:56.286 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T08:19:56.318 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T08:19:56.374 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T08:19:56.427 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T08:19:56.476 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T08:19:56.891 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T08:19:57.099 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T08:19:57.118 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T08:19:57.180 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T08:19:57.193 INFO:teuthology.orchestra.run.smithi164.stdout: Preparing : 1/1 2024-03-27T08:19:57.234 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T08:19:57.250 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T08:19:57.310 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-27T08:19:57.353 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-27T08:19:57.400 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:57.442 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T08:19:57.444 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-27T08:19:57.494 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T08:19:57.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-27T08:19:57.571 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T08:19:57.636 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-27T08:19:57.662 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T08:19:57.710 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T08:19:57.724 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-27T08:19:57.750 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T08:19:57.765 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-27T08:19:57.847 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T08:19:57.857 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-27T08:19:57.901 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T08:19:57.967 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T08:19:58.030 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T08:19:58.220 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T08:19:58.273 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T08:19:58.288 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-27T08:19:58.311 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T08:19:58.354 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:58.367 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T08:19:58.496 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T08:19:58.497 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:19:58.530 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:58.559 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T08:19:58.606 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T08:19:58.642 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T08:19:58.660 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:19:58.675 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T08:19:58.696 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:19:58.761 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-03-27T08:19:58.810 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T08:19:58.830 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T08:19:58.895 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T08:19:58.932 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T08:19:58.963 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T08:19:59.002 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T08:19:59.030 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T08:19:59.102 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-27T08:19:59.152 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-03-27T08:19:59.166 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T08:19:59.177 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:59.218 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T08:19:59.314 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T08:19:59.326 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:19:59.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:59.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T08:19:59.390 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T08:19:59.402 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:19:59.484 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 17/198 2024-03-27T08:19:59.521 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:19:59.530 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-27T08:19:59.550 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T08:19:59.563 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:59.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T08:19:59.635 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-03-27T08:19:59.636 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T08:19:59.706 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T08:19:59.879 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T08:19:59.887 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:59.920 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T08:19:59.938 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-03-27T08:19:59.959 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T08:20:00.013 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-27T08:20:00.032 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T08:20:00.075 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T08:20:00.123 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T08:20:00.145 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T08:20:00.173 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:00.192 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T08:20:00.246 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T08:20:00.272 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:00.296 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T08:20:00.300 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T08:20:00.355 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-27T08:20:00.407 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T08:20:00.457 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T08:20:00.491 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T08:20:00.504 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:20:00.545 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T08:20:00.585 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T08:20:00.609 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 23/198 2024-03-27T08:20:00.717 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T08:20:00.801 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:20:00.847 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T08:20:00.857 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:20:00.900 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T08:20:00.936 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T08:20:00.991 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T08:20:01.130 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T08:20:01.176 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.47.2-1.el9.x86_64 24/198 2024-03-27T08:20:01.202 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T08:20:01.353 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-27T08:20:01.479 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-27T08:20:01.521 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-27T08:20:01.558 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-27T08:20:01.616 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-27T08:20:01.727 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-27T08:20:01.804 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-27T08:20:01.855 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-27T08:20:01.955 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-27T08:20:02.002 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-27T08:20:02.065 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-27T08:20:02.108 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-27T08:20:02.140 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-27T08:20:02.148 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T08:20:02.229 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T08:20:02.253 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-27T08:20:02.268 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T08:20:02.324 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 39/198 2024-03-27T08:20:02.327 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T08:20:02.396 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 40/198 2024-03-27T08:20:02.426 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 41/198 2024-03-27T08:20:02.438 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T08:20:02.485 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T08:20:02.542 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-27T08:20:02.594 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-27T08:20:02.692 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-27T08:20:02.712 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T08:20:02.748 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T08:20:02.840 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T08:20:02.865 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-27T08:20:02.888 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:02.922 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:02.930 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-27T08:20:03.560 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:03.601 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:03.624 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T08:20:03.625 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-27T08:20:03.712 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-27T08:20:03.755 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:03.755 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T08:20:03.755 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T08:20:03.756 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:03.777 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T08:20:03.810 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:03.826 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-27T08:20:03.872 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:20:03.898 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-27T08:20:03.944 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-03-27T08:20:04.011 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-27T08:20:04.071 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 53/198 2024-03-27T08:20:04.113 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-27T08:20:04.525 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-27T08:20:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-27T08:20:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-27T08:20:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-27T08:20:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-27T08:20:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-27T08:20:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-27T08:20:05.266 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T08:20:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-27T08:20:05.360 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T08:20:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-27T08:20:05.399 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T08:20:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-27T08:20:05.429 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T08:20:05.469 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T08:20:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-27T08:20:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-27T08:20:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-27T08:20:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-27T08:20:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-27T08:20:05.842 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T08:20:05.877 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:20:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-27T08:20:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-27T08:20:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-27T08:20:06.004 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:20:06.033 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T08:20:06.101 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T08:20:06.106 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-27T08:20:06.146 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-03-27T08:20:06.190 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-27T08:20:06.220 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-27T08:20:06.253 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-27T08:20:06.412 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-27T08:20:06.581 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-27T08:20:06.617 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T08:20:06.677 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:06.714 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-27T08:20:06.763 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-27T08:20:06.780 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:06.807 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T08:20:06.817 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-27T08:20:06.894 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-27T08:20:07.135 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-27T08:20:07.194 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-27T08:20:07.361 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-27T08:20:07.407 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 87/198 2024-03-27T08:20:07.455 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-27T08:20:07.502 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-27T08:20:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-27T08:20:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-27T08:20:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-27T08:20:07.741 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-27T08:20:07.791 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-27T08:20:07.918 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-27T08:20:07.960 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-27T08:20:07.995 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-27T08:20:08.054 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-27T08:20:08.093 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-27T08:20:08.254 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-27T08:20:08.366 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-27T08:20:08.431 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-27T08:20:08.467 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-27T08:20:08.524 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-27T08:20:08.663 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-27T08:20:08.749 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-27T08:20:09.450 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:09.489 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:09.728 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-27T08:20:09.782 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-27T08:20:09.815 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-27T08:20:09.897 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-27T08:20:10.011 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-27T08:20:10.050 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-27T08:20:10.108 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:10.158 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:10.280 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-27T08:20:10.305 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-27T08:20:10.306 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:10.306 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T08:20:10.307 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T08:20:10.307 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:10.376 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:10.388 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-27T08:20:11.195 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-27T08:20:11.334 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-27T08:20:12.844 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-27T08:20:12.943 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-27T08:20:12.980 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-27T08:20:13.011 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-27T08:20:13.043 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-27T08:20:13.415 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-27T08:20:13.442 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:20:13.561 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 124/198 2024-03-27T08:20:13.589 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 125/198 2024-03-27T08:20:13.642 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-27T08:20:14.154 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-27T08:20:14.186 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:14.270 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 128/198 2024-03-27T08:20:14.297 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 129/198 2024-03-27T08:20:16.725 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-03-27T08:20:16.726 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:16.956 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:16.974 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:17.000 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:17.001 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:17.001 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T08:20:17.001 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:17.021 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:17.645 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 130/198 2024-03-27T08:20:17.690 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:17.844 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 131/198 2024-03-27T08:20:17.844 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-27T08:20:17.844 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-27T08:20:17.844 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:17.883 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:18.608 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:18.686 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:18.687 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:18.687 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T08:20:18.687 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:18.687 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:18.687 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:18.942 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:19.009 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:19.009 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:19.010 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T08:20:19.010 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:19.010 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:19.010 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:19.526 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:19.595 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:19.596 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:19.596 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T08:20:19.596 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:19.596 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:19.596 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:19.719 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T08:20:20.327 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:20.371 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:20.423 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T08:20:20.553 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T08:20:20.583 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:21.890 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:21.961 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:23.051 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:23.094 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:23.234 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:23.407 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T08:20:23.446 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:23.538 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:23.538 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:23.538 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T08:20:23.538 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:23.539 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:23.539 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:23.597 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:23.623 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:23.623 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /sys 2024-03-27T08:20:23.623 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /proc 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /mnt 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /var/tmp 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /home 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /root 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout:skipping the directory /tmp 2024-03-27T08:20:23.624 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:23.635 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:23.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T08:20:23.871 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:23.918 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:23.918 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:23.918 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T08:20:23.918 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:24.692 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T08:20:24.724 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:24.811 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:24.811 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:24.812 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T08:20:24.812 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:24.812 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:24.812 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:24.883 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:24.977 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:24.978 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:24.978 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T08:20:24.978 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:25.068 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:25.170 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:25.171 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:25.171 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T08:20:25.171 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:25.171 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:25.171 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:25.560 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:25.574 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:25.647 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:25.647 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:25.648 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T08:20:25.648 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:25.648 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:25.648 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:25.651 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:25.916 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:25.983 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:25.984 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:25.984 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T08:20:25.984 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:25.984 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:25.984 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:26.458 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:26.528 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:26.528 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:26.528 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T08:20:26.528 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:26.528 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:26.529 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:26.635 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T08:20:27.297 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:27.327 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:27.378 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T08:20:27.478 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T08:20:27.515 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:28.799 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:28.842 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:29.921 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:29.951 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:30.092 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:30.271 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T08:20:30.303 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:30.369 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:30.450 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:30.463 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:30.494 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T08:20:30.500 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:30.531 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T08:20:30.566 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T08:20:30.589 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T08:20:30.825 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 132/198 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /sys 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /proc 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /mnt 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /var/tmp 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /home 2024-03-27T08:20:30.910 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /root 2024-03-27T08:20:30.911 INFO:teuthology.orchestra.run.smithi164.stdout:skipping the directory /tmp 2024-03-27T08:20:30.911 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:30.951 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T08:20:30.999 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T08:20:31.048 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T08:20:31.123 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:31.123 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T08:20:31.166 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 133/198 2024-03-27T08:20:31.167 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:31.167 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-27T08:20:31.167 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:31.170 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T08:20:31.205 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T08:20:31.275 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T08:20:31.326 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T08:20:31.417 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T08:20:31.525 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T08:20:31.543 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T08:20:31.560 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T08:20:31.580 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:31.651 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:31.652 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:31.652 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T08:20:31.652 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:31.652 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:31.652 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:31.706 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:31.775 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:31.775 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:31.775 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T08:20:31.775 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:31.849 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:31.922 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:31.922 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:31.922 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T08:20:31.922 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:31.923 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:31.923 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:32.291 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:32.365 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:32.365 INFO:teuthology.orchestra.run.smithi173.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:32.365 INFO:teuthology.orchestra.run.smithi173.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T08:20:32.365 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:32.366 INFO:teuthology.orchestra.run.smithi173.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:32.366 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:32.611 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:32.657 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:32.719 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:32.784 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 134/198 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-27T08:20:32.891 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:33.158 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 135/198 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-27T08:20:33.254 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:33.776 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:33.846 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 136/198 2024-03-27T08:20:33.846 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:33.847 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-27T08:20:33.847 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:33.847 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-27T08:20:33.847 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:33.969 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-27T08:20:34.073 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T08:20:34.195 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T08:20:34.261 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T08:20:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T08:20:34.441 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T08:20:34.474 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T08:20:34.517 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T08:20:34.528 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T08:20:34.558 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:34.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 138/198 2024-03-27T08:20:34.614 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 139/198 2024-03-27T08:20:34.716 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 140/198 2024-03-27T08:20:34.730 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:34.741 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:34.771 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T08:20:34.772 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:34.918 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:34.962 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T08:20:35.008 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T08:20:35.050 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T08:20:35.082 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T08:20:35.167 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T08:20:35.256 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T08:20:35.303 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T08:20:35.337 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T08:20:35.371 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T08:20:35.405 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:35.437 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T08:20:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:35.473 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:35.805 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:35.944 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:35.975 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:36.028 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T08:20:36.035 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 141/198 2024-03-27T08:20:36.061 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T08:20:36.076 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:36.101 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T08:20:36.264 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:36.526 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:36.527 INFO:teuthology.orchestra.run.smithi167.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-27T08:20:36.527 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:37.157 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:37.172 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 142/198 2024-03-27T08:20:37.201 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:37.214 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T08:20:37.254 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T08:20:37.293 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T08:20:37.345 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 143/198 2024-03-27T08:20:37.524 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 144/198 2024-03-27T08:20:37.562 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:37.575 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T08:20:37.632 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 145/198 2024-03-27T08:20:37.632 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:37.632 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-27T08:20:37.632 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:37.633 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-27T08:20:37.633 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:37.688 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:37.698 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T08:20:37.725 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 146/198 2024-03-27T08:20:37.755 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T08:20:37.814 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 147/198 2024-03-27T08:20:37.838 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T08:20:37.905 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T08:20:37.951 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T08:20:37.993 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T08:20:38.040 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T08:20:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T08:20:38.214 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T08:20:38.317 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T08:20:38.348 INFO:teuthology.orchestra.run.smithi173.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T08:20:38.766 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-27T08:20:38.798 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:38.866 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 149/198 2024-03-27T08:20:38.866 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:38.866 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-27T08:20:38.867 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:38.867 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-27T08:20:38.867 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:38.907 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:38.974 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2478.g15526 150/198 2024-03-27T08:20:38.974 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:38.974 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-27T08:20:38.974 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:39.096 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:39.201 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:39.202 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:39.202 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-27T08:20:39.202 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:39.202 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-27T08:20:39.202 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:39.321 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:39.371 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:39.424 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:39.592 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:39.666 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 152/198 2024-03-27T08:20:39.666 INFO:teuthology.orchestra.run.smithi164.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-27T08:20:39.667 INFO:teuthology.orchestra.run.smithi164.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-27T08:20:39.667 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:39.667 INFO:teuthology.orchestra.run.smithi164.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-27T08:20:39.667 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:40.726 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T08:20:40.818 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T08:20:40.876 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T08:20:41.010 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T08:20:41.045 INFO:teuthology.orchestra.run.smithi173.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T08:20:41.078 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T08:20:41.144 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T08:20:41.189 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T08:20:41.189 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:41.341 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:41.391 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T08:20:41.391 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:41.546 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:41.590 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T08:20:41.637 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T08:20:41.669 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T08:20:41.702 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T08:20:41.770 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T08:20:41.809 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:20:41.810 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T08:20:41.811 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T08:20:41.812 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T08:20:41.827 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T08:20:41.827 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T08:20:41.827 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T08:20:41.828 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T08:20:41.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T08:20:41.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T08:20:41.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T08:20:41.832 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T08:20:41.833 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T08:20:41.834 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T08:20:41.835 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T08:20:41.836 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T08:20:41.837 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T08:20:41.838 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:41.839 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T08:20:41.840 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T08:20:41.915 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T08:20:41.948 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T08:20:41.982 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T08:20:42.015 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:42.049 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T08:20:42.084 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:42.084 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:42.415 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:42.416 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:42.554 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:42.584 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:42.664 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T08:20:42.696 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T08:20:42.736 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T08:20:42.854 INFO:teuthology.orchestra.run.smithi173.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:43.107 INFO:teuthology.orchestra.run.smithi173.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:43.107 INFO:teuthology.orchestra.run.smithi173.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-27T08:20:43.108 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:44.454 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T08:20:44.454 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:44.455 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-03-27T08:20:44.455 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:44.455 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.456 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-03-27T08:20:44.457 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.458 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.459 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T08:20:44.460 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: jq-1.6-16.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T08:20:44.461 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T08:20:44.462 INFO:teuthology.orchestra.run.smithi167.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T08:20:44.463 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T08:20:44.464 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T08:20:44.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T08:20:44.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T08:20:44.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T08:20:44.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T08:20:44.465 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T08:20:44.466 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T08:20:44.467 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T08:20:44.468 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T08:20:44.469 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-03-27T08:20:44.470 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-03-27T08:20:44.507 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:44.563 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 154/198 2024-03-27T08:20:44.596 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 155/198 2024-03-27T08:20:44.634 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-27T08:20:44.911 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 157/198 2024-03-27T08:20:45.041 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 158/198 2024-03-27T08:20:45.088 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 159/198 2024-03-27T08:20:45.142 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-27T08:20:45.196 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-27T08:20:45.240 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-27T08:20:45.275 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 163/198 2024-03-27T08:20:45.331 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-27T08:20:45.368 DEBUG:teuthology.parallel:result is None 2024-03-27T08:20:45.384 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-team-1:1.47.2-1.el9.x86_64 165/198 2024-03-27T08:20:45.503 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : NetworkManager-tui-1:1.47.2-1.el9.x86_64 166/198 2024-03-27T08:20:45.621 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-27T08:20:45.657 INFO:teuthology.orchestra.run.smithi164.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-27T08:20:46.593 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:46.639 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:46.691 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-03-27T08:20:47.948 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 170/198 2024-03-27T08:20:48.053 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-27T08:20:48.111 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-27T08:20:48.254 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-27T08:20:48.314 INFO:teuthology.orchestra.run.smithi164.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-27T08:20:48.347 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-27T08:20:48.390 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-27T08:20:48.433 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-27T08:20:48.433 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:48.576 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-27T08:20:48.619 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-27T08:20:48.619 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T08:20:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T08:20:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T08:20:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T08:20:48.630 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:20:48.631 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T08:20:48.632 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T08:20:48.633 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T08:20:48.633 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T08:20:48.633 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T08:20:48.633 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T08:20:48.658 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T08:20:48.659 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T08:20:48.660 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T08:20:48.661 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T08:20:48.662 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T08:20:48.663 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T08:20:48.664 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T08:20:48.665 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T08:20:48.666 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T08:20:48.667 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T08:20:48.668 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T08:20:48.669 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T08:20:48.670 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T08:20:48.671 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T08:20:48.756 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-27T08:20:48.811 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-27T08:20:48.855 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-27T08:20:48.905 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-27T08:20:48.946 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-27T08:20:49.014 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-27T08:20:49.085 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-27T08:20:49.126 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-27T08:20:49.168 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-27T08:20:49.210 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-27T08:20:49.243 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:49.276 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-27T08:20:49.313 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:49.314 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:49.643 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-27T08:20:49.643 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:49.783 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-27T08:20:49.813 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:49.868 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-27T08:20:49.908 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-27T08:20:49.956 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-27T08:20:50.076 INFO:teuthology.orchestra.run.smithi164.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:50.323 INFO:teuthology.orchestra.run.smithi164.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-27T08:20:50.323 INFO:teuthology.orchestra.run.smithi164.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-03-27T08:20:50.323 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:51.266 INFO:teuthology.orchestra.run.smithi173.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T08:20:51.266 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:51.266 INFO:teuthology.orchestra.run.smithi173.stdout:Upgraded: 2024-03-27T08:20:51.266 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:51.266 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T08:20:51.267 INFO:teuthology.orchestra.run.smithi173.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.268 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout:Installed: 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.269 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.270 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T08:20:51.271 INFO:teuthology.orchestra.run.smithi173.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: jq-1.6-16.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.272 INFO:teuthology.orchestra.run.smithi173.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:51.273 INFO:teuthology.orchestra.run.smithi173.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.274 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T08:20:51.275 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:51.276 INFO:teuthology.orchestra.run.smithi173.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.277 INFO:teuthology.orchestra.run.smithi173.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T08:20:51.278 INFO:teuthology.orchestra.run.smithi173.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T08:20:51.279 INFO:teuthology.orchestra.run.smithi173.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T08:20:51.280 INFO:teuthology.orchestra.run.smithi173.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T08:20:51.280 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:20:51.280 INFO:teuthology.orchestra.run.smithi173.stdout:Complete! 2024-03-27T08:20:52.036 DEBUG:teuthology.parallel:result is None 2024-03-27T08:20:55.591 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-2:19.0.0-2478.g155268c4.el9.x86_64 1/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 3/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 4/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2478.g15526 5/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 6/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 7/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 8/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 9/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 10/198 2024-03-27T08:20:55.592 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 11/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 12/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 13/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 14/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_ 15/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 16/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 17/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados-devel-2:19.0.0-2478.g155268c4.el9.x86_6 18/198 2024-03-27T08:20:55.593 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86 19/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 20/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2478.g155268c4.el 21/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ceph-common-2:19.0.0-2478.g155268c4.el9. 22/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_6 23/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 24/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 25/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 26/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 27/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 28/198 2024-03-27T08:20:55.594 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 29/198 2024-03-27T08:20:55.595 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2478.g155268c4. 30/198 2024-03-27T08:20:55.595 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noa 31/198 2024-03-27T08:20:55.595 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.n 32/198 2024-03-27T08:20:55.613 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2478.g155 33/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el 34/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 35/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.e 36/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 37/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephadm-2:19.0.0-2478.g155268c4.el9.noarch 38/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 39/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-27T08:20:55.614 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-27T08:20:55.615 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 58/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 59/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 60/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 61/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 62/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 63/198 2024-03-27T08:20:55.617 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 64/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 65/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 66/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 67/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 68/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 69/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 70/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 71/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 72/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 73/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 74/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 75/198 2024-03-27T08:20:55.618 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 76/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 77/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 78/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 79/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 80/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 82/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 83/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 84/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-ply-3.11-14.el9.noarch 85/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 86/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 87/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : jq-1.6-16.el9.x86_64 88/198 2024-03-27T08:20:55.619 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 89/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 90/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 91/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 92/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 93/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 94/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-13.14-1.el9.x86_64 95/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 96/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 97/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 98/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 101/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 102/198 2024-03-27T08:20:55.620 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 103/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-03-27T08:20:55.621 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-27T08:20:55.622 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-27T08:20:55.623 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:19.0.0-2478.g155268c4.el9.x86_64 151/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 153/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.47.2-1.el9.x86_64 157/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.47.2-1.el9.x86_64 159/198 2024-03-27T08:20:55.624 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.47.2-1.el9.x86_64 161/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.47.2-1.el9.x86_64 163/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-27T08:20:55.625 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-27T08:20:55.626 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-27T08:20:55.627 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-27T08:20:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-27T08:20:58.151 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:58.151 INFO:teuthology.orchestra.run.smithi164.stdout:Upgraded: 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-libnm-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-team-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: NetworkManager-tui-1:1.47.2-1.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: acl-2.3.1-4.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-27T08:20:58.152 INFO:teuthology.orchestra.run.smithi164.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: librados2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: librbd1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-27T08:20:58.153 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout:Installed: 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: automake-1.16.2-8.el9.noarch 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: bison-3.7.4-5.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-base-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-grafana-dashboards-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.154 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-immutable-object-cache-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mds-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-dashboard-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-modules-core-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mgr-rook-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-mon-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-osd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-prometheus-alerts-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.155 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-radosgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-selinux-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-test-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: ceph-volume-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: cephadm-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-shell-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: cephfs-top-2:19.0.0-2478.g155268c4.el9.noarch 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: flex-2.6.4-9.el9.x86_64 2024-03-27T08:20:58.156 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: jq-1.6-16.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libcephfs2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.157 INFO:teuthology.orchestra.run.smithi164.stdout: libcephsqlite-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: librados-devel-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: libradosstriper1-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: librgw2-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.158 INFO:teuthology.orchestra.run.smithi164.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: lua-5.4.4-4.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-13.14-1.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-03-27T08:20:58.159 INFO:teuthology.orchestra.run.smithi164.stdout: postgresql-server-13.14-1.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-argparse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ceph-common-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.160 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cephfs-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-27T08:20:58.161 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:58.162 INFO:teuthology.orchestra.run.smithi164.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-ply-3.11-14.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-27T08:20:58.163 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rados-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rgw-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-27T08:20:58.164 INFO:teuthology.orchestra.run.smithi164.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-24.02.0-1.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-fuse-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-mirror-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: rbd-nbd-2:19.0.0-2478.g155268c4.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: re2-1:20211101-3.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-27T08:20:58.165 INFO:teuthology.orchestra.run.smithi164.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-27T08:20:58.166 INFO:teuthology.orchestra.run.smithi164.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-27T08:20:58.166 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:20:58.166 INFO:teuthology.orchestra.run.smithi164.stdout:Complete! 2024-03-27T08:20:58.752 DEBUG:teuthology.parallel:result is None 2024-03-27T08:20:58.753 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:20:58.984 DEBUG:teuthology.orchestra.run.smithi164:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T08:20:59.040 INFO:teuthology.orchestra.run.smithi164.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.041 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.041 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T08:20:59.043 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:20:59.264 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T08:20:59.331 INFO:teuthology.orchestra.run.smithi167.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.331 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.331 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T08:20:59.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:20:59.556 DEBUG:teuthology.orchestra.run.smithi173:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-27T08:20:59.696 INFO:teuthology.orchestra.run.smithi173.stdout:19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.696 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2478.g155268c4.el9 2024-03-27T08:20:59.696 INFO:teuthology.task.install:The correct ceph version 19.0.0-2478.g155268c4 is installed. 2024-03-27T08:20:59.698 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-27T08:20:59.698 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:20:59.699 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T08:20:59.783 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:20:59.783 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T08:20:59.881 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:20:59.881 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-27T08:20:59.984 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-27T08:20:59.984 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:20:59.984 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T08:21:00.058 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T08:21:00.167 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:21:00.167 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T08:21:00.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T08:21:00.403 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:21:00.404 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/daemon-helper 2024-03-27T08:21:00.500 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-27T08:21:00.637 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-27T08:21:00.637 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:21:00.637 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T08:21:00.719 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T08:21:00.830 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:21:00.830 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T08:21:00.931 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T08:21:01.072 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:21:01.072 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-27T08:21:01.168 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-27T08:21:01.304 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-27T08:21:01.304 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:21:01.304 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T08:21:01.378 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T08:21:01.491 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:21:01.491 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T08:21:01.592 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T08:21:01.685 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:21:01.685 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/usr/bin/stdin-killer 2024-03-27T08:21:01.781 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-27T08:21:01.874 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-27T08:21:01.972 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-03-27T08:21:01.973 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:21:01.973 INFO:tasks.cephadm:Cluster fsid is f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:21:01.973 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-27T08:21:01.973 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.164', 'mon.b': '172.21.15.167', 'mon.c': '172.21.15.173'} 2024-03-27T08:21:01.973 INFO:tasks.cephadm:First mon is mon.a on smithi164 2024-03-27T08:21:01.974 INFO:tasks.cephadm:First mgr is x 2024-03-27T08:21:01.974 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-27T08:21:01.974 DEBUG:teuthology.orchestra.run.smithi164:> sudo hostname $(hostname -s) 2024-03-27T08:21:02.051 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-03-27T08:21:02.152 DEBUG:teuthology.orchestra.run.smithi173:> sudo hostname $(hostname -s) 2024-03-27T08:21:02.249 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-03-27T08:21:02.250 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:21:02.408 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '155268c4e432a12433aa833f174f9fe3b1016ae0', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/77988/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-2478-g155268c4', 'node_name': '172.21.5.35+adami05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-2478.g155268c4'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-03-26 19:55:12.154042', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-rishabh-testing-20240326.131558', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-03-27T08:21:02.644 INFO:tasks.util.chacra:got chacra host 3.chacra.ceph.com, ref wip-rishabh-testing-20240326.131558, sha1 155268c4e432a12433aa833f174f9fe3b1016ae0 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:21:02.645 INFO:tasks.cephadm:Discovered cachra url: https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm 2024-03-27T08:21:02.646 DEBUG:teuthology.orchestra.run.smithi164:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:03.764 INFO:teuthology.orchestra.run.smithi164.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 08:21 /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:03.764 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:04.863 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 08:21 /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:04.863 DEBUG:teuthology.orchestra.run.smithi173:> curl --silent -L https://3.chacra.ceph.com/binaries/ceph/wip-rishabh-testing-20240326.131558/155268c4e432a12433aa833f174f9fe3b1016ae0/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:06.341 INFO:teuthology.orchestra.run.smithi173.stdout:-rw-r--r--. 1 ubuntu ubuntu 781299 Mar 27 08:21 /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:06.341 DEBUG:teuthology.orchestra.run.smithi164:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:06.402 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:06.461 DEBUG:teuthology.orchestra.run.smithi173:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-27T08:21:06.536 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 on all hosts... 2024-03-27T08:21:06.536 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T08:21:06.544 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T08:21:06.551 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 pull 2024-03-27T08:21:07.613 INFO:teuthology.orchestra.run.smithi164.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T08:21:07.799 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T08:21:07.918 INFO:teuthology.orchestra.run.smithi173.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T08:21:43.042 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout: "repo_digests": [ 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout: ] 2024-03-27T08:21:43.043 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout: "repo_digests": [ 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:21:45.269 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:21:53.272 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-03-27T08:21:53.273 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T08:21:53.273 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801", 2024-03-27T08:21:53.273 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-03-27T08:21:53.274 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772" 2024-03-27T08:21:53.274 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-03-27T08:21:53.274 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-03-27T08:21:53.322 DEBUG:teuthology.orchestra.run.smithi164:> sudo mkdir -p /etc/ceph 2024-03-27T08:21:53.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-03-27T08:21:53.523 DEBUG:teuthology.orchestra.run.smithi173:> sudo mkdir -p /etc/ceph 2024-03-27T08:21:53.623 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 777 /etc/ceph 2024-03-27T08:21:53.718 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-03-27T08:21:53.816 DEBUG:teuthology.orchestra.run.smithi173:> sudo chmod 777 /etc/ceph 2024-03-27T08:21:53.911 INFO:tasks.cephadm:Writing seed config... 2024-03-27T08:21:53.913 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-03-27T08:21:53.913 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-27T08:21:53.913 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-27T08:21:53.913 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-27T08:21:53.914 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-03-27T08:21:53.915 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-27T08:21:53.916 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-27T08:21:53.917 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-27T08:21:53.917 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-27T08:21:53.917 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-27T08:21:53.917 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-03-27T08:21:53.917 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-03-27T08:21:53.918 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:21:53.918 DEBUG:teuthology.orchestra.run.smithi164:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-27T08:21:53.973 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = f2a81f2e-ec12-11ee-95d0-87774f69a715 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-27T08:21:53.973 DEBUG:teuthology.orchestra.run.smithi164:mon.a> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service 2024-03-27T08:21:54.018 DEBUG:teuthology.orchestra.run.smithi164:mgr.x> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x.service 2024-03-27T08:21:54.063 INFO:tasks.cephadm:Bootstrapping... 2024-03-27T08:21:54.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 -v bootstrap --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.164 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:21:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:-------------------------------------------------------------------------------- 2024-03-27T08:21:54.338 INFO:teuthology.orchestra.run.smithi164.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0', '-v', 'bootstrap', '--fsid', 'f2a81f2e-ec12-11ee-95d0-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.164', '--skip-admin-label'] 2024-03-27T08:21:54.338 INFO:teuthology.orchestra.run.smithi164.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-03-27T08:21:54.339 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying podman|docker is present... 2024-03-27T08:21:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-27T08:21:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying lvm2 is present... 2024-03-27T08:21:54.393 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying time synchronization is in place... 2024-03-27T08:21:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-27T08:21:54.410 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-27T08:21:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-27T08:21:54.425 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:21:54.446 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout enabled 2024-03-27T08:21:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout active 2024-03-27T08:21:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:Unit chronyd.service is enabled and running 2024-03-27T08:21:54.466 INFO:teuthology.orchestra.run.smithi164.stdout:Repeating the final host check... 2024-03-27T08:21:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stdout 4.9.4-dev 2024-03-27T08:21:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:podman (/bin/podman) version 4.9.4 is present 2024-03-27T08:21:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl is present 2024-03-27T08:21:54.523 INFO:teuthology.orchestra.run.smithi164.stdout:lvcreate is present 2024-03-27T08:21:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-03-27T08:21:54.537 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-03-27T08:21:54.551 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-03-27T08:21:54.551 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:21:54.567 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout enabled 2024-03-27T08:21:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout active 2024-03-27T08:21:54.582 INFO:teuthology.orchestra.run.smithi164.stdout:Unit chronyd.service is enabled and running 2024-03-27T08:21:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:Host looks OK 2024-03-27T08:21:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:Cluster fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:21:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:Acquiring lock 140523794715312 on /run/cephadm/f2a81f2e-ec12-11ee-95d0-87774f69a715.lock 2024-03-27T08:21:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:Lock 140523794715312 acquired on /run/cephadm/f2a81f2e-ec12-11ee-95d0-87774f69a715.lock 2024-03-27T08:21:54.583 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying IP 172.21.15.164 port 3300 ... 2024-03-27T08:21:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying IP 172.21.15.164 port 6789 ... 2024-03-27T08:21:54.584 INFO:teuthology.orchestra.run.smithi164.stdout:Base mon IP(s) is [172.21.15.164:3300, 172.21.15.164:6789], mon addrv is [v2:172.21.15.164:3300,v1:172.21.15.164:6789] 2024-03-27T08:21:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.164 metric 100 2024-03-27T08:21:54.594 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.164 metric 100 2024-03-27T08:21:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-03-27T08:21:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-03-27T08:21:54.604 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1790sec hoplimit 64 pref medium 2024-03-27T08:21:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-27T08:21:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-03-27T08:21:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-27T08:21:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-03-27T08:21:54.613 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-03-27T08:21:54.614 INFO:teuthology.orchestra.run.smithi164.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-03-27T08:21:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:Mon IP `172.21.15.164` is in CIDR network `172.21.0.0/20` 2024-03-27T08:21:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:Mon IP `172.21.15.164` is in CIDR network `172.21.0.0/20` 2024-03-27T08:21:54.616 INFO:teuthology.orchestra.run.smithi164.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-27T08:21:54.618 INFO:teuthology.orchestra.run.smithi164.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-27T08:21:54.620 INFO:teuthology.orchestra.run.smithi164.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stdout b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0... 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Getting image source signatures 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Copying blob sha256:e605917547793151c989dc0ed66d07767a9fed5a2365fd05914b705e7a7b6e21 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Copying blob sha256:11da15500eca1f826c328eb3265caa30b0a3730510e2a32023084d6fe9cee20c 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Copying config sha256:b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 2024-03-27T08:21:58.375 INFO:teuthology.orchestra.run.smithi164.stdout:/bin/podman: stderr Writing manifest to image destination 2024-03-27T08:21:59.596 INFO:teuthology.orchestra.run.smithi164.stdout:ceph: stdout ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T08:21:59.597 INFO:teuthology.orchestra.run.smithi164.stdout:Ceph version: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev) 2024-03-27T08:21:59.597 INFO:teuthology.orchestra.run.smithi164.stdout:Extracting ceph user uid/gid from container image... 2024-03-27T08:22:00.648 INFO:teuthology.orchestra.run.smithi164.stdout:stat: stdout 167 167 2024-03-27T08:22:00.648 INFO:teuthology.orchestra.run.smithi164.stdout:Creating initial keys... 2024-03-27T08:22:01.819 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph-authtool: stdout AQAp1wNmohkJBxAAPO/P2V0TduRXqz8xkAssog== 2024-03-27T08:22:02.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph-authtool: stdout AQAq1wNmUL3TDxAA/xAgtQeGbao5Q2Mtufqd5Q== 2024-03-27T08:22:04.323 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph-authtool: stdout AQAr1wNmcIkMGBAAdtZUTbjswvDbeaH/SgcKbg== 2024-03-27T08:22:04.326 INFO:teuthology.orchestra.run.smithi164.stdout:Creating initial monmap... 2024-03-27T08:22:05.475 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-27T08:22:05.475 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-03-27T08:22:05.475 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:monmaptool for a [v2:172.21.15.164:3300,v1:172.21.15.164:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:setting min_mon_release = quincy 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: set fsid to f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:22:05.476 INFO:teuthology.orchestra.run.smithi164.stdout:Creating mon... 2024-03-27T08:22:06.636 INFO:teuthology.orchestra.run.smithi164.stdout:create mon.a on 2024-03-27T08:22:07.011 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-03-27T08:22:07.245 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-27T08:22:07.522 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target. 2024-03-27T08:22:07.523 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target → /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target. 2024-03-27T08:22:08.001 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a 2024-03-27T08:22:08.001 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service: Unit ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service not loaded. 2024-03-27T08:22:08.290 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target.wants/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service → /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@.service. 2024-03-27T08:22:09.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:08 smithi164 podman[31402]: 2024-03-27 08:22:08.703303872 +0000 UTC m=+0.144057348 container create 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-03-27T08:22:09.472 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T08:22:09.472 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout disabled 2024-03-27T08:22:09.487 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T08:22:09.487 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:22:09.487 INFO:teuthology.orchestra.run.smithi164.stdout:firewalld.service is not enabled 2024-03-27T08:22:09.487 INFO:teuthology.orchestra.run.smithi164.stdout:Not possible to enable service . firewalld.service is not available 2024-03-27T08:22:09.488 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mon to start... 2024-03-27T08:22:09.488 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mon... 2024-03-27T08:22:09.638 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 podman[31402]: 2024-03-27 08:22:09.347604134 +0000 UTC m=+0.788357653 container init 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:22:09.639 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 podman[31402]: 2024-03-27 08:22:09.357735189 +0000 UTC m=+0.798488675 container start 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:22:09.639 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 ceph-mon[31421]: mkfs f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:09.639 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 ceph-mon[31421]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-27T08:22:09.639 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 bash[31402]: 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea 2024-03-27T08:22:09.639 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:09 smithi164 systemd[1]: Started Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:22:10.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: monmap epoch 1 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: last_changed 2024-03-27T08:22:04.813774+0000 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: min_mon_release 19 (squid) 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: election_strategy: 1 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: fsmap 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: osdmap e1: 0 total, 0 up, 0 in 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: mgrmap e1: no daemons active 2024-03-27T08:22:10.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:10 smithi164 ceph-mon[31421]: from='client.? 172.21.15.164:0/4199182152' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-27T08:22:10.887 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout cluster: 2024-03-27T08:22:10.888 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout id: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout services: 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.78874s) 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-03-27T08:22:10.889 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout data: 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout pgs: 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.131+0000 7ff043a00700 1 Processor -- start 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.132+0000 7ff043a00700 1 -- start start 2024-03-27T08:22:10.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.132+0000 7ff043a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.132+0000 7ff043a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c10ad50 con 0x7ff03c10a360 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.133+0000 7ff041000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.133+0000 7ff041000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40836/0 (socket says 172.21.15.164:40836) 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.133+0000 7ff041000700 1 -- 172.21.15.164:0/3734984854 learned_addr learned my addr 172.21.15.164:0/3734984854 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.133+0000 7ff041000700 1 -- 172.21.15.164:0/3734984854 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c10b510 con 0x7ff03c10a360 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.134+0000 7ff041000700 1 --2- 172.21.15.164:0/3734984854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0300098a0 tx=0x7ff030009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3b784615c05dc3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.134+0000 7ff03b400700 1 -- 172.21.15.164:0/3734984854 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff030004160 con 0x7ff03c10a360 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.134+0000 7ff03b400700 1 -- 172.21.15.164:0/3734984854 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff030004300 con 0x7ff03c10a360 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.134+0000 7ff03b400700 1 -- 172.21.15.164:0/3734984854 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0300036a0 con 0x7ff03c10a360 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 -- 172.21.15.164:0/3734984854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 msgr2=0x7ff03c10a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 --2- 172.21.15.164:0/3734984854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff0300098a0 tx=0x7ff030009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:10.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 -- 172.21.15.164:0/3734984854 shutdown_connections 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 --2- 172.21.15.164:0/3734984854 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c10a780 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 -- 172.21.15.164:0/3734984854 >> 172.21.15.164:0/3734984854 conn(0x7ff03c07d710 msgr2=0x7ff03c07db60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 -- 172.21.15.164:0/3734984854 shutdown_connections 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.135+0000 7ff043a00700 1 -- 172.21.15.164:0/3734984854 wait complete. 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.136+0000 7ff043a00700 1 Processor -- start 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.136+0000 7ff043a00700 1 -- start start 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.136+0000 7ff043a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.136+0000 7ff043a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff03c10ba40 con 0x7ff03c10a360 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.137+0000 7ff041000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.137+0000 7ff041000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40848/0 (socket says 172.21.15.164:40848) 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.137+0000 7ff041000700 1 -- 172.21.15.164:0/4199182152 learned_addr learned my addr 172.21.15.164:0/4199182152 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.137+0000 7ff041000700 1 -- 172.21.15.164:0/4199182152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff03c19df40 con 0x7ff03c10a360 2024-03-27T08:22:10.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.137+0000 7ff041000700 1 --2- 172.21.15.164:0/4199182152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff030000c00 tx=0x7ff030004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff030003db0 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff030011630 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff030011950 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff03c19e1d0 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff03c1a0ec0 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff030011af0 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.138+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff03001c450 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.139+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff03c063c70 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.142+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ff030032020 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.221+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7ff03c02deb0 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.221+0000 7ff039600700 1 -- 172.21.15.164:0/4199182152 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7ff030004260 con 0x7ff03c10a360 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.222+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 msgr2=0x7ff03c19da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:10.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.222+0000 7ff043a00700 1 --2- 172.21.15.164:0/4199182152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff030000c00 tx=0x7ff030004750 comp rx=0 tx=0).stop 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.222+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 shutdown_connections 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.222+0000 7ff043a00700 1 --2- 172.21.15.164:0/4199182152 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff03c10a360 0x7ff03c19da00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.222+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 >> 172.21.15.164:0/4199182152 conn(0x7ff03c07d710 msgr2=0x7ff03c194610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.223+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 shutdown_connections 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:10.223+0000 7ff043a00700 1 -- 172.21.15.164:0/4199182152 wait complete. 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:mon is available 2024-03-27T08:22:10.899 INFO:teuthology.orchestra.run.smithi164.stdout:Assimilating anything we can from ceph.conf... 2024-03-27T08:22:11.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:11 smithi164 ceph-mon[31421]: from='client.? 172.21.15.164:0/2507400562' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-27T08:22:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:11 smithi164 ceph-mon[31421]: from='client.? 172.21.15.164:0/2507400562' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-27T08:22:12.350 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:12.350 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [global] 2024-03-27T08:22:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout fsid = f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.164:3300,v1:172.21.15.164:6789] 2024-03-27T08:22:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-27T08:22:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-27T08:22:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-27T08:22:12.355 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-27T08:22:12.355 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [osd] 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.504+0000 7f0af3c00700 1 Processor -- start 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.504+0000 7f0af3c00700 1 -- start start 2024-03-27T08:22:12.356 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.504+0000 7f0af3c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.504+0000 7f0af3c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec111900 con 0x7f0aec10ef40 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.505+0000 7f0af1200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.505+0000 7f0af1200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40856/0 (socket says 172.21.15.164:40856) 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.505+0000 7f0af1200700 1 -- 172.21.15.164:0/2845565096 learned_addr learned my addr 172.21.15.164:0/2845565096 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.506+0000 7f0af1200700 1 -- 172.21.15.164:0/2845565096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec111a80 con 0x7f0aec10ef40 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.506+0000 7f0af1200700 1 --2- 172.21.15.164:0/2845565096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00098a0 tx=0x7f0ae0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4c81ba2a805d7a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0aeb400700 1 -- 172.21.15.164:0/2845565096 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae0004160 con 0x7f0aec10ef40 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0aeb400700 1 -- 172.21.15.164:0/2845565096 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae0004300 con 0x7f0aec10ef40 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0aeb400700 1 -- 172.21.15.164:0/2845565096 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae00036a0 con 0x7f0aec10ef40 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 -- 172.21.15.164:0/2845565096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 msgr2=0x7f0aec111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 --2- 172.21.15.164:0/2845565096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ae00098a0 tx=0x7f0ae0009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:12.357 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 -- 172.21.15.164:0/2845565096 shutdown_connections 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 --2- 172.21.15.164:0/2845565096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec111330 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 -- 172.21.15.164:0/2845565096 >> 172.21.15.164:0/2845565096 conn(0x7f0aec07d710 msgr2=0x7f0aec07fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.507+0000 7f0af3c00700 1 -- 172.21.15.164:0/2845565096 shutdown_connections 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.508+0000 7f0af3c00700 1 -- 172.21.15.164:0/2845565096 wait complete. 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af3c00700 1 Processor -- start 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af3c00700 1 -- start start 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af3c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af3c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0aec111f50 con 0x7f0aec10ef40 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af1200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af1200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40864/0 (socket says 172.21.15.164:40864) 2024-03-27T08:22:12.358 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.509+0000 7f0af1200700 1 -- 172.21.15.164:0/2507400562 learned_addr learned my addr 172.21.15.164:0/2507400562 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0af1200700 1 -- 172.21.15.164:0/2507400562 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0aec1a2310 con 0x7f0aec10ef40 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0af1200700 1 --2- 172.21.15.164:0/2507400562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae0004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae0003db0 con 0x7f0aec10ef40 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ae0011630 con 0x7f0aec10ef40 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ae0011950 con 0x7f0aec10ef40 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.510+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0aec1a25a0 con 0x7f0aec10ef40 2024-03-27T08:22:12.361 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.511+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0aec1a5290 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.511+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0ae0011af0 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.511+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ae001c450 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.512+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0aec063c70 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.515+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0ae0004260 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.591+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f0aec02deb0 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.596+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+458 (secure 0 0 0) 0x7f0ae001b450 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.597+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 msgr2=0x7f0aec1a1dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.597+0000 7f0af3c00700 1 --2- 172.21.15.164:0/2507400562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ae0000c00 tx=0x7f0ae0004750 comp rx=0 tx=0).stop 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.597+0000 7f0ae9600700 1 -- 172.21.15.164:0/2507400562 <== mon.0 v2:172.21.15.164:3300/0 8 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f0ae001b630 con 0x7f0aec10ef40 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.598+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 shutdown_connections 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.598+0000 7f0af3c00700 1 --2- 172.21.15.164:0/2507400562 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0aec10ef40 0x7f0aec1a1dd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:12.362 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.598+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 >> 172.21.15.164:0/2507400562 conn(0x7f0aec07d710 msgr2=0x7f0aec07e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:12.363 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.598+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 shutdown_connections 2024-03-27T08:22:12.363 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:11.598+0000 7f0af3c00700 1 -- 172.21.15.164:0/2507400562 wait complete. 2024-03-27T08:22:12.363 INFO:teuthology.orchestra.run.smithi164.stdout:Generating new minimal ceph.conf... 2024-03-27T08:22:13.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:13 smithi164 ceph-mon[31421]: from='client.? 172.21.15.164:0/2720560559' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:22:13.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.915+0000 7f741a000700 1 Processor -- start 2024-03-27T08:22:13.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.915+0000 7f741a000700 1 -- start start 2024-03-27T08:22:13.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.916+0000 7f741a000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:13.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.916+0000 7f741a000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7414111900 con 0x7f741410ef40 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.917+0000 7f7413400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.917+0000 7f7413400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40868/0 (socket says 172.21.15.164:40868) 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.917+0000 7f7413400700 1 -- 172.21.15.164:0/610383256 learned_addr learned my addr 172.21.15.164:0/610383256 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.917+0000 7f7413400700 1 -- 172.21.15.164:0/610383256 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7414111a80 con 0x7f741410ef40 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.917+0000 7f7413400700 1 --2- 172.21.15.164:0/610383256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f74040098a0 tx=0x7f7404009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76e6b8c3ef3f76dd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:13.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.918+0000 7f7412000700 1 -- 172.21.15.164:0/610383256 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7404004160 con 0x7f741410ef40 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.918+0000 7f7412000700 1 -- 172.21.15.164:0/610383256 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7404004300 con 0x7f741410ef40 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.918+0000 7f7412000700 1 -- 172.21.15.164:0/610383256 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7404011b40 con 0x7f741410ef40 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 -- 172.21.15.164:0/610383256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 msgr2=0x7f7414111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 --2- 172.21.15.164:0/610383256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f74040098a0 tx=0x7f7404009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 -- 172.21.15.164:0/610383256 shutdown_connections 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 --2- 172.21.15.164:0/610383256 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f7414111330 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 -- 172.21.15.164:0/610383256 >> 172.21.15.164:0/610383256 conn(0x7f741407d710 msgr2=0x7f741407fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:13.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 -- 172.21.15.164:0/610383256 shutdown_connections 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.919+0000 7f741a000700 1 -- 172.21.15.164:0/610383256 wait complete. 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.920+0000 7f741a000700 1 Processor -- start 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.920+0000 7f741a000700 1 -- start start 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.920+0000 7f741a000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.920+0000 7f741a000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7414112b00 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.921+0000 7f7413400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.921+0000 7f7413400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40882/0 (socket says 172.21.15.164:40882) 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.921+0000 7f7413400700 1 -- 172.21.15.164:0/2720560559 learned_addr learned my addr 172.21.15.164:0/2720560559 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.921+0000 7f7413400700 1 -- 172.21.15.164:0/2720560559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74141a2b90 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.921+0000 7f7413400700 1 --2- 172.21.15.164:0/2720560559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7404006af0 tx=0x7f7404011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7404003970 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7404003b10 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74141a2e20 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f74040196c0 con 0x7f741410ef40 2024-03-27T08:22:13.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74141a5b10 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f740402d430 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.922+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7404024780 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.923+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7414063c70 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:12.926+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7404004300 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.003+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f74141a6050 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.004+0000 7f740be00700 1 -- 172.21.15.164:0/2720560559 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7f7404003cc0 con 0x7f741410ef40 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 msgr2=0x7f74141a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 --2- 172.21.15.164:0/2720560559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f7404006af0 tx=0x7f7404011c00 comp rx=0 tx=0).stop 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 shutdown_connections 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 --2- 172.21.15.164:0/2720560559 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f741410ef40 0x7f74141a2650 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:13.685 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 >> 172.21.15.164:0/2720560559 conn(0x7f741407d710 msgr2=0x7f741407e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:13.686 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 shutdown_connections 2024-03-27T08:22:13.686 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:13.005+0000 7f741a000700 1 -- 172.21.15.164:0/2720560559 wait complete. 2024-03-27T08:22:13.686 INFO:teuthology.orchestra.run.smithi164.stdout:Restarting the monitor... 2024-03-27T08:22:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:13 smithi164 systemd[1]: Stopping Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31417]: 2024-03-27T08:22:14.167+0000 7f4d64c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31417]: 2024-03-27T08:22:14.167+0000 7f4d64c00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-03-27T08:22:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:14 smithi164 podman[31664]: 2024-03-27 08:22:14.250130203 +0000 UTC m=+0.212904329 container died 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:22:15.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 podman[31664]: 2024-03-27 08:22:15.069392059 +0000 UTC m=+1.032166135 container cleanup 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:22:15.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 bash[31664]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a 2024-03-27T08:22:15.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 podman[31678]: 2024-03-27 08:22:15.236473602 +0000 UTC m=+0.972874268 container remove 449a710b6888eff19180f5268ec4fa04488d4b38df36ef9626a0b4bee28dacea (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T08:22:16.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service: Deactivated successfully. 2024-03-27T08:22:16.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 systemd[1]: Stopped Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:22:16.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service: Consumed 1.867s CPU time. 2024-03-27T08:22:16.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:15 smithi164 systemd[1]: Starting Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:22:16.300 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 podman[31768]: 2024-03-27 08:22:15.963774123 +0000 UTC m=+0.033240839 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:22:16.300 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 podman[31768]: 2024-03-27 08:22:16.129261736 +0000 UTC m=+0.198728476 container create 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux ) 2024-03-27T08:22:16.459 INFO:teuthology.orchestra.run.smithi164.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 podman[31768]: 2024-03-27 08:22:16.374824786 +0000 UTC m=+0.444291533 container init 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 podman[31768]: 2024-03-27 08:22:16.384986747 +0000 UTC m=+0.454453456 container start 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: set uid:gid to 167:167 (ceph:ceph) 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev), process ceph-mon, pid 2 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: pidfile_write: ignore empty --pid-file 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: load: jerasure load: lrc 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: RocksDB version: 7.9.2 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Git sha 0 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Compile date 2024-03-26 18:55:08 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: DB SUMMARY 2024-03-27T08:22:16.610 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: DB Session ID: 5QPJLHTFRFMNJZDZA297 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: CURRENT file: CURRENT 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: IDENTITY file: IDENTITY 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105540 ; 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.error_if_exists: 0 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.create_if_missing: 0 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.paranoid_checks: 1 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.env: 0x562bb48a8c60 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.fs: PosixFileSystem 2024-03-27T08:22:16.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.info_log: 0x562bb6d29b20 2024-03-27T08:22:16.612 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_file_opening_threads: 16 2024-03-27T08:22:16.612 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.statistics: (nil) 2024-03-27T08:22:16.612 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.use_fsync: 0 2024-03-27T08:22:16.612 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_log_file_size: 0 2024-03-27T08:22:16.612 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.keep_log_file_num: 1000 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.recycle_log_file_num: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_fallocate: 1 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_mmap_reads: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_mmap_writes: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.use_direct_reads: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.create_missing_column_families: 0 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.db_log_dir: 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.wal_dir: 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-27T08:22:16.613 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.advise_random_on_open: 1 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.db_write_buffer_size: 0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.write_buffer_manager: 0x562bb6cfa1e0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.rate_limiter: (nil) 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-27T08:22:16.614 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.wal_recovery_mode: 2 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enable_thread_tracking: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enable_pipelined_write: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.unordered_write: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.row_cache: None 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.wal_filter: None 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_ingest_behind: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.two_write_queues: 0 2024-03-27T08:22:16.615 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.manual_wal_flush: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.wal_compression: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.atomic_flush: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.log_readahead_size: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.best_efforts_recovery: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.allow_data_in_errors: 0 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.db_host_id: __hostname__ 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-27T08:22:16.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_background_jobs: 2 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_background_compactions: -1 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_subcompactions: 1 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_total_wal_size: 0 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_open_files: -1 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bytes_per_sync: 0 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-27T08:22:16.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_readahead_size: 0 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_background_flushes: -1 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Compression algorithms supported: 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kZSTD supported: 0 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kXpressCompression supported: 0 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kLZ4HCCompression supported: 1 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kZlibCompression supported: 1 2024-03-27T08:22:16.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kSnappyCompression supported: 1 2024-03-27T08:22:16.619 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kLZ4Compression supported: 1 2024-03-27T08:22:16.619 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: kBZip2Compression supported: 0 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.merge_operator: 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_filter: None 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_filter_factory: None 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.sst_partitioner_factory: None 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562bb6d29d00) 2024-03-27T08:22:16.620 INFO:journalctl@ceph.mon.a.smithi164.stdout: cache_index_and_filter_blocks: 1 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: pin_top_level_index_and_filter: 1 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: index_type: 0 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: data_block_index_type: 0 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: index_shortening: 1 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: checksum: 4 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: no_block_cache: 0 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_cache: 0x562bb6d2d090 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_cache_name: BinnedLRUCache 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_cache_options: 2024-03-27T08:22:16.621 INFO:journalctl@ceph.mon.a.smithi164.stdout: capacity : 536870912 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: num_shard_bits : 4 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: strict_capacity_limit : 0 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: high_pri_pool_ratio: 0.000 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_cache_compressed: (nil) 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: persistent_cache: (nil) 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_size: 4096 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_size_deviation: 10 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_restart_interval: 16 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: index_block_restart_interval: 1 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: metadata_block_size: 4096 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: partition_filters: 0 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: use_delta_encoding: 1 2024-03-27T08:22:16.622 INFO:journalctl@ceph.mon.a.smithi164.stdout: filter_policy: bloomfilter 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: whole_key_filtering: 1 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: verify_compression: 0 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: read_amp_bytes_per_bit: 0 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: format_version: 5 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: enable_index_compression: 1 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: block_align: 0 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: max_auto_readahead_size: 262144 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: prepopulate_block_cache: 0 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: initial_auto_readahead_size: 8192 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout: num_file_reads_for_auto_readahead: 2 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.write_buffer_size: 33554432 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_write_buffer_number: 2 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression: NoCompression 2024-03-27T08:22:16.623 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression: Disabled 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.prefix_extractor: nullptr 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.num_levels: 7 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-27T08:22:16.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.level: 32767 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.strategy: 0 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.enabled: false 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.target_file_size_base: 67108864 2024-03-27T08:22:16.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-27T08:22:16.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.arena_block_size: 1048576 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.disable_auto_compactions: 0 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-27T08:22:16.627 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.inplace_update_support: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.bloom_locality: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.max_successive_merges: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.paranoid_file_checks: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.force_consistency_checks: 1 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.report_bg_io_stats: 0 2024-03-27T08:22:16.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.ttl: 2592000 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enable_blob_files: false 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.min_blob_size: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_file_size: 268435456 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.blob_file_starting_level: 0 2024-03-27T08:22:16.629 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ef268f29-e3ce-4a22-b517-d8dd2df0609d 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527736442639, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527736444193, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100633, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98518, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14282, "raw_average_key_size": 49, "raw_value_size": 90773, "raw_average_value_size": 316, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711527736, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ef268f29-e3ce-4a22-b517-d8dd2df0609d", "db_session_id": "5QPJLHTFRFMNJZDZA297", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527736444333, "job": 1, "event": "recovery_finished"} 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562bb6e1c000 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: DB pointer 0x562bb6e06000 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-27T08:22:16.630 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: ** DB Stats ** 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: ** Compaction Stats [default] ** 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-27T08:22:16.631 INFO:journalctl@ceph.mon.a.smithi164.stdout: L0 2/0 100.13 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Sum 2/0 100.13 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 97.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: ** Compaction Stats [default] ** 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 97.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-27T08:22:16.632 INFO:journalctl@ceph.mon.a.smithi164.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: Cumulative compaction: 0.00 GB write, 14.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: Interval compaction: 0.00 GB write, 14.53 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: Block cache BinnedLRUCache@0x562bb6d2d090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: starting mon.a rank 0 at public addrs [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] at bind addrs [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???) e1 preinit fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).mds e1 new map 2024-03-27T08:22:16.633 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).mds e1 print_map 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: e1 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: legacy client fscid: -1 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout: No filesystems configured 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 bash[31768]: 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 2024-03-27T08:22:16.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 systemd[1]: Started Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mon.a is new leader, mons a in quorum (ranks 0) 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: monmap epoch 1 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: last_changed 2024-03-27T08:22:04.813774+0000 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: min_mon_release 19 (squid) 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: election_strategy: 1 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: fsmap 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: osdmap e1: 0 total, 0 up, 0 in 2024-03-27T08:22:16.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:16 smithi164 ceph-mon[31788]: mgrmap e1: no daemons active 2024-03-27T08:22:17.892 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.211+0000 7fcecc600700 1 Processor -- start 2024-03-27T08:22:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.211+0000 7fcecc600700 1 -- start start 2024-03-27T08:22:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.211+0000 7fcecc600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.211+0000 7fcecc600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcec4108b70 con 0x7fcec4108180 2024-03-27T08:22:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.212+0000 7fcec9c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:17.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.212+0000 7fcec9c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34828/0 (socket says 172.21.15.164:34828) 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.212+0000 7fcec9c00700 1 -- 172.21.15.164:0/425035358 learned_addr learned my addr 172.21.15.164:0/425035358 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.213+0000 7fcec9c00700 1 -- 172.21.15.164:0/425035358 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec4109380 con 0x7fcec4108180 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.213+0000 7fcec9c00700 1 --2- 172.21.15.164:0/425035358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fceb80098a0 tx=0x7fceb8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f84bc4ac8ba99ba server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.213+0000 7fcec3e00700 1 -- 172.21.15.164:0/425035358 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8004160 con 0x7fcec4108180 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.213+0000 7fcec3e00700 1 -- 172.21.15.164:0/425035358 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fceb8004300 con 0x7fcec4108180 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.213+0000 7fcec3e00700 1 -- 172.21.15.164:0/425035358 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8011b40 con 0x7fcec4108180 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 -- 172.21.15.164:0/425035358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 msgr2=0x7fcec41085a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 --2- 172.21.15.164:0/425035358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fceb80098a0 tx=0x7fceb8009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 -- 172.21.15.164:0/425035358 shutdown_connections 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 --2- 172.21.15.164:0/425035358 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec41085a0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 -- 172.21.15.164:0/425035358 >> 172.21.15.164:0/425035358 conn(0x7fcec4103780 msgr2=0x7fcec4105ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 -- 172.21.15.164:0/425035358 shutdown_connections 2024-03-27T08:22:17.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.214+0000 7fcecc600700 1 -- 172.21.15.164:0/425035358 wait complete. 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.215+0000 7fcecc600700 1 Processor -- start 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.215+0000 7fcecc600700 1 -- start start 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.216+0000 7fcecc600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.216+0000 7fcecc600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcec410c730 con 0x7fcec4108180 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.216+0000 7fcec9c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.216+0000 7fcec9c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34838/0 (socket says 172.21.15.164:34838) 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.216+0000 7fcec9c00700 1 -- 172.21.15.164:0/1871092130 learned_addr learned my addr 172.21.15.164:0/1871092130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcec9c00700 1 -- 172.21.15.164:0/1871092130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec419c680 con 0x7fcec4108180 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcec9c00700 1 --2- 172.21.15.164:0/1871092130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fceb8011840 tx=0x7fceb8004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb80038b0 con 0x7fcec4108180 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fceb801a430 con 0x7fcec4108180 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec419c910 con 0x7fcec4108180 2024-03-27T08:22:17.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fceb8024650 con 0x7fcec4108180 2024-03-27T08:22:17.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.217+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec419f600 con 0x7fcec4108180 2024-03-27T08:22:17.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.218+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fceb8022020 con 0x7fcec4108180 2024-03-27T08:22:17.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.218+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fceb802dbc0 con 0x7fcec4108180 2024-03-27T08:22:17.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.219+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec4063c70 con 0x7fcec4108180 2024-03-27T08:22:17.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.222+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fceb802de10 con 0x7fcec4108180 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.298+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fcec419f7d0 con 0x7fcec4108180 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.301+0000 7fcec2000700 1 -- 172.21.15.164:0/1871092130 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fceb80042a0 con 0x7fcec4108180 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.302+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 msgr2=0x7fcec419c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.302+0000 7fcecc600700 1 --2- 172.21.15.164:0/1871092130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fceb8011840 tx=0x7fceb8004230 comp rx=0 tx=0).stop 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.303+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 shutdown_connections 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.303+0000 7fcecc600700 1 --2- 172.21.15.164:0/1871092130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcec4108180 0x7fcec419c140 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.303+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 >> 172.21.15.164:0/1871092130 conn(0x7fcec4103780 msgr2=0x7fcec4104310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.303+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 shutdown_connections 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:17.303+0000 7fcecc600700 1 -- 172.21.15.164:0/1871092130 wait complete. 2024-03-27T08:22:17.900 INFO:teuthology.orchestra.run.smithi164.stdout:Wrote config to /etc/ceph/ceph.conf 2024-03-27T08:22:17.929 INFO:teuthology.orchestra.run.smithi164.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:22:17.929 INFO:teuthology.orchestra.run.smithi164.stdout:Creating mgr... 2024-03-27T08:22:17.930 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying port 0.0.0.0:9283 ... 2024-03-27T08:22:17.931 INFO:teuthology.orchestra.run.smithi164.stdout:Verifying port 0.0.0.0:8765 ... 2024-03-27T08:22:18.336 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x 2024-03-27T08:22:18.337 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Failed to reset failed state of unit ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x.service: Unit ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x.service not loaded. 2024-03-27T08:22:18.602 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715.target.wants/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x.service → /etc/systemd/system/ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@.service. 2024-03-27T08:22:18.636 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:18 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1871092130' entity='client.admin' 2024-03-27T08:22:18.995 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:18 smithi164 systemd[1]: Starting Ceph mgr.x for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:22:19.246 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 podman[32012]: 2024-03-27 08:22:18.906507085 +0000 UTC m=+0.033077793 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:22:19.247 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 podman[32012]: 2024-03-27 08:22:19.006350504 +0000 UTC m=+0.132921221 container create 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-03-27T08:22:19.247 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 podman[32012]: 2024-03-27 08:22:19.243280078 +0000 UTC m=+0.369850814 container init 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-27T08:22:19.247 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 podman[32012]: 2024-03-27 08:22:19.253395367 +0000 UTC m=+0.379966133 container start 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-27T08:22:19.379 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T08:22:19.379 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout disabled 2024-03-27T08:22:19.396 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T08:22:19.396 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:22:19.396 INFO:teuthology.orchestra.run.smithi164.stdout:firewalld.service is not enabled 2024-03-27T08:22:19.396 INFO:teuthology.orchestra.run.smithi164.stdout:Not possible to enable service . firewalld.service is not available 2024-03-27T08:22:19.418 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T08:22:19.418 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout disabled 2024-03-27T08:22:19.435 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T08:22:19.435 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:22:19.436 INFO:teuthology.orchestra.run.smithi164.stdout:firewalld.service is not enabled 2024-03-27T08:22:19.436 INFO:teuthology.orchestra.run.smithi164.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-03-27T08:22:19.436 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mgr to start... 2024-03-27T08:22:19.436 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mgr... 2024-03-27T08:22:19.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 bash[32012]: 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f 2024-03-27T08:22:19.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:19 smithi164 systemd[1]: Started Ceph mgr.x for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:22:20.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:20 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/617116116' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T08:22:20.255 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:20.030+0000 7f77bd460200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T08:22:20.255 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:20.155+0000 7f77bd460200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T08:22:20.803 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 0 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T08:22:20.804 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T08:22:20.805 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T08:22:20.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T08:22:20.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T08:22:09.435432+0000", 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T08:22:20.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.984+0000 7f9590e00700 1 Processor -- start 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.984+0000 7f9590e00700 1 -- start start 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.985+0000 7f9590e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.985+0000 7f9590e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f958c063900 con 0x7f958c108c10 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.985+0000 7f9589e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.985+0000 7f9589e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34876/0 (socket says 172.21.15.164:34876) 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.985+0000 7f9589e00700 1 -- 172.21.15.164:0/254318496 learned_addr learned my addr 172.21.15.164:0/254318496 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.986+0000 7f9589e00700 1 -- 172.21.15.164:0/254318496 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c10b540 con 0x7f958c108c10 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.986+0000 7f9589e00700 1 --2- 172.21.15.164:0/254318496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c78199b77d22b2ad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.986+0000 7f9588a00700 1 -- 172.21.15.164:0/254318496 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c004160 con 0x7f958c108c10 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.986+0000 7f9588a00700 1 -- 172.21.15.164:0/254318496 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f957c004300 con 0x7f958c108c10 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.986+0000 7f9588a00700 1 -- 172.21.15.164:0/254318496 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c011b40 con 0x7f958c108c10 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 -- 172.21.15.164:0/254318496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 msgr2=0x7f958c10b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 --2- 172.21.15.164:0/254318496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f957c0098a0 tx=0x7f957c009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:20.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 -- 172.21.15.164:0/254318496 shutdown_connections 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 --2- 172.21.15.164:0/254318496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c10b000 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 -- 172.21.15.164:0/254318496 >> 172.21.15.164:0/254318496 conn(0x7f958c102620 msgr2=0x7f958c104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.987+0000 7f9590e00700 1 -- 172.21.15.164:0/254318496 shutdown_connections 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.988+0000 7f9590e00700 1 -- 172.21.15.164:0/254318496 wait complete. 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9590e00700 1 Processor -- start 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9590e00700 1 -- start start 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9590e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9590e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f958c10c510 con 0x7f958c108c10 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9589e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9589e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34890/0 (socket says 172.21.15.164:34890) 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.989+0000 7f9589e00700 1 -- 172.21.15.164:0/617116116 learned_addr learned my addr 172.21.15.164:0/617116116 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9589e00700 1 -- 172.21.15.164:0/617116116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c19e820 con 0x7f958c108c10 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9589e00700 1 --2- 172.21.15.164:0/617116116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f957c006af0 tx=0x7f957c011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:20.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c003970 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f957c003b10 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c19eab0 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f957c0196c0 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.990+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c1a17a0 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.991+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f957c019d00 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.991+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f957c024730 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.992+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c19ef90 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:19.995+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f958c19ef90 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.075+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f958c1a1970 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.076+0000 7f9582a00700 1 -- 172.21.15.164:0/617116116 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f957c003cc0 con 0x7f958c108c10 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 msgr2=0x7f958c19e2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 --2- 172.21.15.164:0/617116116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f957c006af0 tx=0x7f957c011c00 comp rx=0 tx=0).stop 2024-03-27T08:22:20.818 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 shutdown_connections 2024-03-27T08:22:20.819 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 --2- 172.21.15.164:0/617116116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f958c108c10 0x7f958c19e2e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:20.819 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 >> 172.21.15.164:0/617116116 conn(0x7f958c102620 msgr2=0x7f958c103180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:20.819 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 shutdown_connections 2024-03-27T08:22:20.819 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:20.077+0000 7f9590e00700 1 -- 172.21.15.164:0/617116116 wait complete. 2024-03-27T08:22:20.819 INFO:teuthology.orchestra.run.smithi164.stdout:mgr not available, waiting (1/15)... 2024-03-27T08:22:21.077 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:20.965+0000 7f77bd460200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T08:22:21.377 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.084+0000 7f77bd460200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T08:22:21.377 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.263+0000 7f77bd460200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T08:22:21.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.385+0000 7f77bd460200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T08:22:21.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.492+0000 7f77bd460200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T08:22:22.070 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.825+0000 7f77bd460200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T08:22:22.070 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:21.965+0000 7f77bd460200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T08:22:22.410 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:22.077+0000 7f77bd460200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T08:22:22.410 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:22.200+0000 7f77bd460200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T08:22:22.410 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:22.417+0000 7f77bd460200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T08:22:23.871 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:23.755+0000 7f77bd460200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T08:22:23.872 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:23 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2989932140' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T08:22:24.167 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:23.933+0000 7f77bd460200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T08:22:24.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T08:22:24.191 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 0 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T08:22:24.192 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.193 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:24.194 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T08:22:09.435432+0000", 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.431+0000 7f33dd800700 1 Processor -- start 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.431+0000 7f33dd800700 1 -- start start 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.431+0000 7f33dd800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.432+0000 7f33dd800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f33d807b790 con 0x7f33d807cd60 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.432+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.432+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34894/0 (socket says 172.21.15.164:34894) 2024-03-27T08:22:24.195 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.432+0000 7f33d7e00700 1 -- 172.21.15.164:0/3852489077 learned_addr learned my addr 172.21.15.164:0/3852489077 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.432+0000 7f33d7e00700 1 -- 172.21.15.164:0/3852489077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d807b910 con 0x7f33d807cd60 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.433+0000 7f33d7e00700 1 --2- 172.21.15.164:0/3852489077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33c80098a0 tx=0x7f33c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2403a8be4868a929 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.433+0000 7f33d6a00700 1 -- 172.21.15.164:0/3852489077 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c8004160 con 0x7f33d807cd60 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.433+0000 7f33d6a00700 1 -- 172.21.15.164:0/3852489077 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f33c8004300 con 0x7f33d807cd60 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.433+0000 7f33d6a00700 1 -- 172.21.15.164:0/3852489077 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c8011b40 con 0x7f33d807cd60 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 -- 172.21.15.164:0/3852489077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 msgr2=0x7f33d807b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 --2- 172.21.15.164:0/3852489077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f33c80098a0 tx=0x7f33c8009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 -- 172.21.15.164:0/3852489077 shutdown_connections 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 --2- 172.21.15.164:0/3852489077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d807b1c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 -- 172.21.15.164:0/3852489077 >> 172.21.15.164:0/3852489077 conn(0x7f33d81034f0 msgr2=0x7f33d8105910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 -- 172.21.15.164:0/3852489077 shutdown_connections 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.434+0000 7f33dd800700 1 -- 172.21.15.164:0/3852489077 wait complete. 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.435+0000 7f33dd800700 1 Processor -- start 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33dd800700 1 -- start start 2024-03-27T08:22:24.196 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33dd800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33dd800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f33d810e520 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33d7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34896/0 (socket says 172.21.15.164:34896) 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.436+0000 7f33d7e00700 1 -- 172.21.15.164:0/2989932140 learned_addr learned my addr 172.21.15.164:0/2989932140 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33d7e00700 1 -- 172.21.15.164:0/2989932140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33d819e610 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33d7e00700 1 --2- 172.21.15.164:0/2989932140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006af0 tx=0x7f33c8011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c8003970 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f33c8003b10 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33d819e8a0 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33c80196c0 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.437+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33d81a1590 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.438+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f33c8019d00 con 0x7f33d807cd60 2024-03-27T08:22:24.197 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.438+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f33c8024730 con 0x7f33d807cd60 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.438+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33d8063c70 con 0x7f33d807cd60 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.441+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f33c8043e50 con 0x7f33d807cd60 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.521+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f33d81a1760 con 0x7f33d807cd60 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.522+0000 7f33d4c00700 1 -- 172.21.15.164:0/2989932140 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f33c8032020 con 0x7f33d807cd60 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 msgr2=0x7f33d819e0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 --2- 172.21.15.164:0/2989932140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f33c8006af0 tx=0x7f33c8011c00 comp rx=0 tx=0).stop 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 shutdown_connections 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 --2- 172.21.15.164:0/2989932140 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f33d807cd60 0x7f33d819e0d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 >> 172.21.15.164:0/2989932140 conn(0x7f33d81034f0 msgr2=0x7f33d8104080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 shutdown_connections 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:23.524+0000 7f33dd800700 1 -- 172.21.15.164:0/2989932140 wait complete. 2024-03-27T08:22:24.198 INFO:teuthology.orchestra.run.smithi164.stdout:mgr not available, waiting (2/15)... 2024-03-27T08:22:24.468 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:24.358+0000 7f77bd460200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T08:22:24.468 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:24.475+0000 7f77bd460200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T08:22:25.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:24.730+0000 7f77bd460200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:22:25.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:24.973+0000 7f77bd460200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T08:22:25.660 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:25.350+0000 7f77bd460200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:22:25.965 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:25.668+0000 7f77bd460200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T08:22:26.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:25.972+0000 7f77bd460200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T08:22:27.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:26 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1583667033' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T08:22:27.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:27.040+0000 7f77bd460200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T08:22:27.668 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 0 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T08:22:27.669 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T08:22:27.678 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": false, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T08:22:27.679 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T08:22:09.435432+0000", 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T08:22:27.680 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.816+0000 7f1019a00700 1 Processor -- start 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.816+0000 7f1019a00700 1 -- start start 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.816+0000 7f1019a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.816+0000 7f1019a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1014108b30 con 0x7f1014108140 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.817+0000 7f1012a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.817+0000 7f1012a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52924/0 (socket says 172.21.15.164:52924) 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.817+0000 7f1012a00700 1 -- 172.21.15.164:0/3611004962 learned_addr learned my addr 172.21.15.164:0/3611004962 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.817+0000 7f1012a00700 1 -- 172.21.15.164:0/3611004962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1014109340 con 0x7f1014108140 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.818+0000 7f1012a00700 1 --2- 172.21.15.164:0/3611004962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10040098a0 tx=0x7f1004009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2e845fc12f6f38c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.818+0000 7f1011600700 1 -- 172.21.15.164:0/3611004962 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1004004160 con 0x7f1014108140 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.818+0000 7f1011600700 1 -- 172.21.15.164:0/3611004962 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f1004004300 con 0x7f1014108140 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.818+0000 7f1011600700 1 -- 172.21.15.164:0/3611004962 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1004011b40 con 0x7f1014108140 2024-03-27T08:22:27.681 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 -- 172.21.15.164:0/3611004962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 msgr2=0x7f1014108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 --2- 172.21.15.164:0/3611004962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f10040098a0 tx=0x7f1004009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 -- 172.21.15.164:0/3611004962 shutdown_connections 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 --2- 172.21.15.164:0/3611004962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f1014108560 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 -- 172.21.15.164:0/3611004962 >> 172.21.15.164:0/3611004962 conn(0x7f10141036e0 msgr2=0x7f1014105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 -- 172.21.15.164:0/3611004962 shutdown_connections 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.819+0000 7f1019a00700 1 -- 172.21.15.164:0/3611004962 wait complete. 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.821+0000 7f1019a00700 1 Processor -- start 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.821+0000 7f1019a00700 1 -- start start 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.821+0000 7f1019a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.821+0000 7f1019a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f101410c6f0 con 0x7f1014108140 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.821+0000 7f1012a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.822+0000 7f1012a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52926/0 (socket says 172.21.15.164:52926) 2024-03-27T08:22:27.682 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.822+0000 7f1012a00700 1 -- 172.21.15.164:0/1583667033 learned_addr learned my addr 172.21.15.164:0/1583667033 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.822+0000 7f1012a00700 1 -- 172.21.15.164:0/1583667033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101419e8e0 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.822+0000 7f1012a00700 1 --2- 172.21.15.164:0/1583667033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1004011840 tx=0x7f1004004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.822+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10040038b0 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f100401a430 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1004024650 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101419eb70 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10141a1860 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1004022020 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.823+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f100402db50 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.824+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1014063c70 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.826+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f100401aa50 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.907+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f10141a1d90 con 0x7f1014108140 2024-03-27T08:22:27.683 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.908+0000 7f100b400700 1 -- 172.21.15.164:0/1583667033 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f100401a5e0 con 0x7f1014108140 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 msgr2=0x7f101419e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 --2- 172.21.15.164:0/1583667033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1004011840 tx=0x7f1004004230 comp rx=0 tx=0).stop 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 shutdown_connections 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 --2- 172.21.15.164:0/1583667033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1014108140 0x7f101419e3a0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 >> 172.21.15.164:0/1583667033 conn(0x7f10141036e0 msgr2=0x7f1014104200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 shutdown_connections 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:26.910+0000 7f1019a00700 1 -- 172.21.15.164:0/1583667033 wait complete. 2024-03-27T08:22:27.684 INFO:teuthology.orchestra.run.smithi164.stdout:mgr not available, waiting (3/15)... 2024-03-27T08:22:28.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:27.754+0000 7f77bd460200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T08:22:28.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:27.881+0000 7f77bd460200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T08:22:28.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:28.158+0000 7f77bd460200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: Activating manager daemon x 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: mgrmap e2: x(active, starting, since 0.0125966s) 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: Manager daemon x is now available 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' 2024-03-27T08:22:28.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:28 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' 2024-03-27T08:22:29.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:29 smithi164 ceph-mon[31788]: from='mgr.14100 172.21.15.164:0/1852403470' entity='mgr.x' 2024-03-27T08:22:29.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:29 smithi164 ceph-mon[31788]: mgrmap e3: x(active, since 1.02246s) 2024-03-27T08:22:31.259 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:31.259 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:31.259 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:22:31.259 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "health": { 2024-03-27T08:22:31.259 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 0 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "a" 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "monmap": { 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-03-27T08:22:31.260 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-03-27T08:22:31.261 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-03-27T08:22:31.270 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-03-27T08:22:31.270 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.271 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modules": [ 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "iostat", 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "nfs", 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "restful" 2024-03-27T08:22:31.272 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ], 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "modified": "2024-03-27T08:22:09.435432+0000", 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "services": {} 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout }, 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.309+0000 7f6e96a00700 1 Processor -- start 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.309+0000 7f6e96a00700 1 -- start start 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e96a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e96a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9010ad60 con 0x7f6e9010a370 2024-03-27T08:22:31.273 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52992/0 (socket says 172.21.15.164:52992) 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e8fe00700 1 -- 172.21.15.164:0/453734648 learned_addr learned my addr 172.21.15.164:0/453734648 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.310+0000 7f6e8fe00700 1 -- 172.21.15.164:0/453734648 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9010b520 con 0x7f6e9010a370 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.311+0000 7f6e8fe00700 1 --2- 172.21.15.164:0/453734648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e800098a0 tx=0x7f6e80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ae15c73d775dbd2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.311+0000 7f6e8ea00700 1 -- 172.21.15.164:0/453734648 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e80004160 con 0x7f6e9010a370 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.311+0000 7f6e8ea00700 1 -- 172.21.15.164:0/453734648 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f6e80004300 con 0x7f6e9010a370 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.311+0000 7f6e8ea00700 1 -- 172.21.15.164:0/453734648 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e80011b40 con 0x7f6e9010a370 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 -- 172.21.15.164:0/453734648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 msgr2=0x7f6e9010a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 --2- 172.21.15.164:0/453734648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f6e800098a0 tx=0x7f6e80009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 -- 172.21.15.164:0/453734648 shutdown_connections 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 --2- 172.21.15.164:0/453734648 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9010a790 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 -- 172.21.15.164:0/453734648 >> 172.21.15.164:0/453734648 conn(0x7f6e9007d8f0 msgr2=0x7f6e901084e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 -- 172.21.15.164:0/453734648 shutdown_connections 2024-03-27T08:22:31.274 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.312+0000 7f6e96a00700 1 -- 172.21.15.164:0/453734648 wait complete. 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.313+0000 7f6e96a00700 1 Processor -- start 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.313+0000 7f6e96a00700 1 -- start start 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.313+0000 7f6e96a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.314+0000 7f6e96a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6e9010e8d0 con 0x7f6e9010a370 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.314+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.314+0000 7f6e8fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53006/0 (socket says 172.21.15.164:53006) 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.314+0000 7f6e8fe00700 1 -- 172.21.15.164:0/2298281677 learned_addr learned my addr 172.21.15.164:0/2298281677 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.314+0000 7f6e8fe00700 1 -- 172.21.15.164:0/2298281677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9019e880 con 0x7f6e9010a370 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e8fe00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e80011840 tx=0x7f6e80004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e800038b0 con 0x7f6e9010a370 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f6e8001a430 con 0x7f6e9010a370 2024-03-27T08:22:31.275 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9019eb10 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e80024650 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.315+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e901a1800 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.316+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7f6e80022020 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.316+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e90063c70 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.316+0000 7f6e8cc00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 0x7f6e7403b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.316+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e8004cf00 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.317+0000 7f6e8f400700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 0x7f6e7403b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.317+0000 7f6e8f400700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 0x7f6e7403b890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006fd0 tx=0x7f6e7c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.323+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6e8004cc60 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.630+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f6e901a19d0 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.630+0000 7f6e8cc00700 1 -- 172.21.15.164:0/2298281677 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6e901a19d0 con 0x7f6e9010a370 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.633+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 msgr2=0x7f6e7403b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.633+0000 7f6e96a00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 0x7f6e7403b890 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f6e7c006fd0 tx=0x7f6e7c006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.633+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 msgr2=0x7f6e9019e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:31.276 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.633+0000 7f6e96a00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f6e80011840 tx=0x7f6e80004230 comp rx=0 tx=0).stop 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 shutdown_connections 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f6e740393d0 0x7f6e7403b890 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 --2- 172.21.15.164:0/2298281677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6e9010a370 0x7f6e9019e340 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 >> 172.21.15.164:0/2298281677 conn(0x7f6e9007d8f0 msgr2=0x7f6e90107cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 shutdown_connections 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:30.634+0000 7f6e96a00700 1 -- 172.21.15.164:0/2298281677 wait complete. 2024-03-27T08:22:31.277 INFO:teuthology.orchestra.run.smithi164.stdout:mgr is available 2024-03-27T08:22:31.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:31 smithi164 ceph-mon[31788]: mgrmap e4: x(active, since 2s) 2024-03-27T08:22:31.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:31 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2298281677' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-27T08:22:32.467 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:32 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/456235564' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [global] 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout fsid = f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [mgr] 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-03-27T08:22:32.827 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout [osd] 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout bdev_async_discard = True 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.888+0000 7fc1eb400700 1 Processor -- start 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.889+0000 7fc1eb400700 1 -- start start 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.889+0000 7fc1eb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.889+0000 7fc1eb400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4111900 con 0x7fc1e410ef40 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.890+0000 7fc1e8a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:32.828 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.890+0000 7fc1e8a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53018/0 (socket says 172.21.15.164:53018) 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.890+0000 7fc1e8a00700 1 -- 172.21.15.164:0/1807696273 learned_addr learned my addr 172.21.15.164:0/1807696273 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.890+0000 7fc1e8a00700 1 -- 172.21.15.164:0/1807696273 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e4111a80 con 0x7fc1e410ef40 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.890+0000 7fc1e8a00700 1 --2- 172.21.15.164:0/1807696273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a35b82690c451c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.891+0000 7fc1e3400700 1 -- 172.21.15.164:0/1807696273 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8004160 con 0x7fc1e410ef40 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.891+0000 7fc1e3400700 1 -- 172.21.15.164:0/1807696273 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc1d8004300 con 0x7fc1e410ef40 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.891+0000 7fc1e3400700 1 -- 172.21.15.164:0/1807696273 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d8011b40 con 0x7fc1e410ef40 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 -- 172.21.15.164:0/1807696273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 msgr2=0x7fc1e4111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 --2- 172.21.15.164:0/1807696273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc1d80098a0 tx=0x7fc1d8009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 -- 172.21.15.164:0/1807696273 shutdown_connections 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 --2- 172.21.15.164:0/1807696273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e4111330 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 -- 172.21.15.164:0/1807696273 >> 172.21.15.164:0/1807696273 conn(0x7fc1e407d710 msgr2=0x7fc1e407fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 -- 172.21.15.164:0/1807696273 shutdown_connections 2024-03-27T08:22:32.829 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.892+0000 7fc1eb400700 1 -- 172.21.15.164:0/1807696273 wait complete. 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.893+0000 7fc1eb400700 1 Processor -- start 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.893+0000 7fc1eb400700 1 -- start start 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.893+0000 7fc1eb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.893+0000 7fc1eb400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e4112b00 con 0x7fc1e410ef40 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.894+0000 7fc1e8a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.894+0000 7fc1e8a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53024/0 (socket says 172.21.15.164:53024) 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.894+0000 7fc1e8a00700 1 -- 172.21.15.164:0/456235564 learned_addr learned my addr 172.21.15.164:0/456235564 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.894+0000 7fc1e8a00700 1 -- 172.21.15.164:0/456235564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e41a2b90 con 0x7fc1e410ef40 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.894+0000 7fc1e8a00700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011840 tx=0x7fc1d80119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.895+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d80039e0 con 0x7fc1e410ef40 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.895+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc1d8020070 con 0x7fc1e410ef40 2024-03-27T08:22:32.830 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.895+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e41a2e20 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.895+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc1d80193c0 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.895+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e41a5b10 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.896+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7fc1d801a430 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.896+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e4063c70 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.897+0000 7fc1e1600700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 0x7fc1cc03b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.897+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc1d804d4c0 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.897+0000 7fc1e3e00700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 0x7fc1cc03b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.898+0000 7fc1e3e00700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 0x7fc1cc03b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0006fd0 tx=0x7fc1d0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:31.902+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc1d800e260 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.126+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7fc1e41a5ce0 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.128+0000 7fc1e1600700 1 -- 172.21.15.164:0/456235564 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+400 (secure 0 0 0) 0x7fc1e41a5ce0 con 0x7fc1e410ef40 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 msgr2=0x7fc1cc03b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:32.831 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 0x7fc1cc03b890 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0006fd0 tx=0x7fc1d0006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 msgr2=0x7fc1e41a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fc1d8011840 tx=0x7fc1d80119d0 comp rx=0 tx=0).stop 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 shutdown_connections 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7fc1cc0393d0 0x7fc1cc03b890 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 --2- 172.21.15.164:0/456235564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e410ef40 0x7fc1e41a2650 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 >> 172.21.15.164:0/456235564 conn(0x7fc1e407d710 msgr2=0x7fc1e407e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 shutdown_connections 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:32.131+0000 7fc1eb400700 1 -- 172.21.15.164:0/456235564 wait complete. 2024-03-27T08:22:32.832 INFO:teuthology.orchestra.run.smithi164.stdout:Enabling cephadm module... 2024-03-27T08:22:34.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:33 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3570381365' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-27T08:22:34.005 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: ignoring --setuser ceph since I am not root 2024-03-27T08:22:34.005 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: ignoring --setgroup ceph since I am not root 2024-03-27T08:22:34.469 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.443+0000 7f8805400700 1 Processor -- start 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f8805400700 1 -- start start 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f8805400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f8805400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f880010ab30 con 0x7f880010a140 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f87ffe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f87ffe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53038/0 (socket says 172.21.15.164:53038) 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.444+0000 7f87ffe00700 1 -- 172.21.15.164:0/809546215 learned_addr learned my addr 172.21.15.164:0/809546215 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.445+0000 7f87ffe00700 1 -- 172.21.15.164:0/809546215 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880010b340 con 0x7f880010a140 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.445+0000 7f87ffe00700 1 --2- 172.21.15.164:0/809546215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87f00098a0 tx=0x7f87f0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9267d18d72405d1f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.445+0000 7f87fea00700 1 -- 172.21.15.164:0/809546215 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0004160 con 0x7f880010a140 2024-03-27T08:22:34.470 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f87fea00700 1 -- 172.21.15.164:0/809546215 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f87f0004300 con 0x7f880010a140 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f87fea00700 1 -- 172.21.15.164:0/809546215 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0011b40 con 0x7f880010a140 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f8805400700 1 -- 172.21.15.164:0/809546215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 msgr2=0x7f880010a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f8805400700 1 --2- 172.21.15.164:0/809546215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f87f00098a0 tx=0x7f87f0009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f8805400700 1 -- 172.21.15.164:0/809546215 shutdown_connections 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f8805400700 1 --2- 172.21.15.164:0/809546215 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880010a560 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.446+0000 7f8805400700 1 -- 172.21.15.164:0/809546215 >> 172.21.15.164:0/809546215 conn(0x7f880007d530 msgr2=0x7f880007d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.447+0000 7f8805400700 1 -- 172.21.15.164:0/809546215 shutdown_connections 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.447+0000 7f8805400700 1 -- 172.21.15.164:0/809546215 wait complete. 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.448+0000 7f8805400700 1 Processor -- start 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.448+0000 7f8805400700 1 -- start start 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.448+0000 7f8805400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.448+0000 7f8805400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f880010e6f0 con 0x7f880010a140 2024-03-27T08:22:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.448+0000 7f87ffe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87ffe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53050/0 (socket says 172.21.15.164:53050) 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87ffe00700 1 -- 172.21.15.164:0/3570381365 learned_addr learned my addr 172.21.15.164:0/3570381365 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87ffe00700 1 -- 172.21.15.164:0/3570381365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f880019e700 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87ffe00700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87f0011840 tx=0x7f87f0004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f00038b0 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f87f001a430 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.449+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f87f0024650 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.450+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f880019e990 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.450+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88001a1680 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.451+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 4) ==== 46455+0+0 (secure 0 0 0) 0x7f87f0022020 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.451+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8800063c70 con 0x7f880010a140 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.451+0000 7f87fcc00700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 0x7f87e403b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:34.472 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.451+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f87f004cf20 con 0x7f880010a140 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.451+0000 7f87ff400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 0x7f87e403b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.452+0000 7f87ff400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 0x7f87e403b890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006fd0 tx=0x7f87ec006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.456+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f87f00042a0 con 0x7f880010a140 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.738+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f88001a1850 con 0x7f880010a140 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.792+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f88001a1850 con 0x7f880010a140 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.795+0000 7f87fcc00700 1 -- 172.21.15.164:0/3570381365 <== mon.0 v2:172.21.15.164:3300/0 8 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7f87f001aa50 con 0x7f880010a140 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.796+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 msgr2=0x7f87e403b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.796+0000 7f8805400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 0x7f87e403b890 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f87ec006fd0 tx=0x7f87ec006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.796+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 msgr2=0x7f880019e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.796+0000 7f8805400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f87f0011840 tx=0x7f87f0004230 comp rx=0 tx=0).stop 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 shutdown_connections 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f87e40393d0 0x7f87e403b890 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:34.473 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 --2- 172.21.15.164:0/3570381365 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f880010a140 0x7f880019e1c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:34.474 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 >> 172.21.15.164:0/3570381365 conn(0x7f880007d530 msgr2=0x7f8800107590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:34.474 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 shutdown_connections 2024-03-27T08:22:34.474 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:33.797+0000 7f8805400700 1 -- 172.21.15.164:0/3570381365 wait complete. 2024-03-27T08:22:34.701 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:34.577+0000 7feccc87c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T08:22:35.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:34.707+0000 7feccc87c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T08:22:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:34 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3570381365' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-27T08:22:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:34 smithi164 ceph-mon[31788]: mgrmap e5: x(active, since 5s) 2024-03-27T08:22:35.645 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:35.529+0000 7feccc87c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T08:22:35.956 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:35 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3550261175' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-27T08:22:35.956 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:35.651+0000 7feccc87c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T08:22:35.956 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:35.836+0000 7feccc87c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.065+0000 7f7e57600700 1 Processor -- start 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.066+0000 7f7e57600700 1 -- start start 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.066+0000 7f7e57600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:36.123 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.066+0000 7f7e57600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e50063920 con 0x7f7e50108bf0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.066+0000 7f7e54c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.067+0000 7f7e54c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53080/0 (socket says 172.21.15.164:53080) 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.067+0000 7f7e54c00700 1 -- 172.21.15.164:0/2892103894 learned_addr learned my addr 172.21.15.164:0/2892103894 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.067+0000 7f7e54c00700 1 -- 172.21.15.164:0/2892103894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5010b520 con 0x7f7e50108bf0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.067+0000 7f7e54c00700 1 --2- 172.21.15.164:0/2892103894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098a0 tx=0x7f7e44009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32d7dccaa862297c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e4f400700 1 -- 172.21.15.164:0/2892103894 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e44004160 con 0x7f7e50108bf0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e4f400700 1 -- 172.21.15.164:0/2892103894 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7e44004300 con 0x7f7e50108bf0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e4f400700 1 -- 172.21.15.164:0/2892103894 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e44011b40 con 0x7f7e50108bf0 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e57600700 1 -- 172.21.15.164:0/2892103894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 msgr2=0x7f7e5010afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e57600700 1 --2- 172.21.15.164:0/2892103894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7e440098a0 tx=0x7f7e44009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e57600700 1 -- 172.21.15.164:0/2892103894 shutdown_connections 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e57600700 1 --2- 172.21.15.164:0/2892103894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5010afe0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.124 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.068+0000 7f7e57600700 1 -- 172.21.15.164:0/2892103894 >> 172.21.15.164:0/2892103894 conn(0x7f7e50102620 msgr2=0x7f7e50104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.069+0000 7f7e57600700 1 -- 172.21.15.164:0/2892103894 shutdown_connections 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.069+0000 7f7e57600700 1 -- 172.21.15.164:0/2892103894 wait complete. 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e57600700 1 Processor -- start 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e57600700 1 -- start start 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e57600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e57600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e5010c540 con 0x7f7e50108bf0 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e54c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e54c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53090/0 (socket says 172.21.15.164:53090) 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.070+0000 7f7e54c00700 1 -- 172.21.15.164:0/3550261175 learned_addr learned my addr 172.21.15.164:0/3550261175 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e54c00700 1 -- 172.21.15.164:0/3550261175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5019e830 con 0x7f7e50108bf0 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e54c00700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011840 tx=0x7f7e440119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e440039e0 con 0x7f7e50108bf0 2024-03-27T08:22:36.125 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7e44020070 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5019eac0 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.071+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e440193c0 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.072+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e501a17b0 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.073+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7f7e4401a430 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.073+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e50063c70 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.073+0000 7f7e4d600700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 0x7f7e3803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.074+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7e4404d0d0 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.074+0000 7f7e4fe00700 1 -- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 msgr2=0x7f7e3803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.074+0000 7f7e4fe00700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 0x7f7e3803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.079+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7e4402a070 con 0x7f7e50108bf0 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.275+0000 7f7e4fe00700 1 -- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 msgr2=0x7f7e3803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:36.126 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.275+0000 7f7e4fe00700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 0x7f7e3803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.352+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7e501a1980 con 0x7f7e50108bf0 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.353+0000 7f7e4d600700 1 -- 172.21.15.164:0/3550261175 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f7e501a1980 con 0x7f7e50108bf0 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 msgr2=0x7f7e3803b8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 0x7f7e3803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 msgr2=0x7f7e5019e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7e44011840 tx=0x7f7e440119d0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 shutdown_connections 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7f7e38039420 0x7f7e3803b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 --2- 172.21.15.164:0/3550261175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e50108bf0 0x7f7e5019e2f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.357+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 >> 172.21.15.164:0/3550261175 conn(0x7f7e50102620 msgr2=0x7f7e50103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.358+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 shutdown_connections 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:35.358+0000 7f7e57600700 1 -- 172.21.15.164:0/3550261175 wait complete. 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for the mgr to restart... 2024-03-27T08:22:36.127 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mgr epoch 5... 2024-03-27T08:22:36.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:35.962+0000 7feccc87c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T08:22:36.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:36.073+0000 7feccc87c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T08:22:36.551 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:36.450+0000 7feccc87c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T08:22:36.801 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:36.612+0000 7feccc87c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T08:22:36.802 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:36.737+0000 7feccc87c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T08:22:37.078 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:36.864+0000 7feccc87c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T08:22:37.406 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:37.084+0000 7feccc87c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T08:22:38.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:38.341+0000 7feccc87c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T08:22:38.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:38.510+0000 7feccc87c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T08:22:39.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:38.927+0000 7feccc87c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T08:22:39.255 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:39.047+0000 7feccc87c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T08:22:39.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:39.303+0000 7feccc87c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:22:39.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:39.544+0000 7feccc87c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T08:22:40.232 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:39.920+0000 7feccc87c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:22:40.505 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:40.238+0000 7feccc87c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T08:22:41.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:40.543+0000 7feccc87c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T08:22:42.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:41.561+0000 7feccc87c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T08:22:42.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:42.259+0000 7feccc87c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T08:22:42.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:42.387+0000 7feccc87c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T08:22:43.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:22:42.669+0000 7feccc87c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: Active manager daemon x restarted 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: Activating manager daemon x 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: osdmap e2: 0 total, 0 up, 0 in 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: mgrmap e6: x(active, starting, since 0.00635633s) 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: Manager daemon x is now available 2024-03-27T08:22:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:43.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:42 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:44.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: Found migration_current of "None". Setting to last migration. 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:44.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:43 smithi164 ceph-mon[31788]: mgrmap e7: x(active, since 1.01615s) 2024-03-27T08:22:44.415 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.804+0000 7ff5b8e00700 1 Processor -- start 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.804+0000 7ff5b8e00700 1 -- start start 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.804+0000 7ff5b8e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.804+0000 7ff5b8e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b4063960 con 0x7ff5b4108bb0 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.805+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.805+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57308/0 (socket says 172.21.15.164:57308) 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.805+0000 7ff5b1e00700 1 -- 172.21.15.164:0/2747090452 learned_addr learned my addr 172.21.15.164:0/2747090452 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.805+0000 7ff5b1e00700 1 -- 172.21.15.164:0/2747090452 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b410b4e0 con 0x7ff5b4108bb0 2024-03-27T08:22:44.416 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.805+0000 7ff5b1e00700 1 --2- 172.21.15.164:0/2747090452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529e673e70a02ee9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b0a00700 1 -- 172.21.15.164:0/2747090452 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4004160 con 0x7ff5b4108bb0 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b0a00700 1 -- 172.21.15.164:0/2747090452 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ff5a4004300 con 0x7ff5b4108bb0 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b0a00700 1 -- 172.21.15.164:0/2747090452 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a4011b40 con 0x7ff5b4108bb0 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b8e00700 1 -- 172.21.15.164:0/2747090452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 msgr2=0x7ff5b410afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/2747090452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff5a40098a0 tx=0x7ff5a4009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b8e00700 1 -- 172.21.15.164:0/2747090452 shutdown_connections 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/2747090452 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b410afa0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.806+0000 7ff5b8e00700 1 -- 172.21.15.164:0/2747090452 >> 172.21.15.164:0/2747090452 conn(0x7ff5b4102620 msgr2=0x7ff5b4104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.807+0000 7ff5b8e00700 1 -- 172.21.15.164:0/2747090452 shutdown_connections 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.807+0000 7ff5b8e00700 1 -- 172.21.15.164:0/2747090452 wait complete. 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b8e00700 1 Processor -- start 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b8e00700 1 -- start start 2024-03-27T08:22:44.417 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b8e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b8e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b410c510 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57314/0 (socket says 172.21.15.164:57314) 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.808+0000 7ff5b1e00700 1 -- 172.21.15.164:0/3898849977 learned_addr learned my addr 172.21.15.164:0/3898849977 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5b1e00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b419e830 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5b1e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4011840 tx=0x7ff5a40119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a40039e0 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ff5a4020070 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a40193c0 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.809+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b419eac0 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.810+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b41a17b0 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 5) ==== 46466+0+0 (secure 0 0 0) 0x7ff5a401a430 con 0x7ff5b4108bb0 2024-03-27T08:22:44.418 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5aaa00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff59803bff0 con 0x7ff598039420 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff5a404d550 con 0x7ff5b4108bb0 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5b1400700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:36.811+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:37.012+0000 7ff5b1400700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:37.012+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:37.413+0000 7ff5b1400700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:37.413+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:38.214+0000 7ff5b1400700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:38.214+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:39.816+0000 7ff5b1400700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/460797646 2024-03-27T08:22:44.419 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:39.816+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:42.677+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mgrmap(e 6) ==== 46233+0+0 (secure 0 0 0) 0x7ff5a402d350 con 0x7ff5b4108bb0 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:42.678+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 msgr2=0x7ff59803b8e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:42.678+0000 7ff5aaa00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.682+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mgrmap(e 7) ==== 46360+0+0 (secure 0 0 0) 0x7ff5a404f140 con 0x7ff5b4108bb0 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.683+0000 7ff5aaa00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 0x7ff59803f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.683+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ff5a4001d30 con 0x7ff59803cd10 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.684+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 0x7ff59803f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.686+0000 7ff5b1400700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 0x7ff59803f100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0003a10 tx=0x7ff5a00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.687+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7ff5a4001d30 con 0x7ff59803cd10 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.695+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ff5b4063c70 con 0x7ff59803cd10 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.695+0000 7ff5aaa00700 1 -- 172.21.15.164:0/3898849977 <== mgr.14120 v2:172.21.15.164:6800/3452126215 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7ff5b4063c70 con 0x7ff59803cd10 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 msgr2=0x7ff59803f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 0x7ff59803f100 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0003a10 tx=0x7ff5a00092b0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 msgr2=0x7ff5b419e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:44.420 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4011840 tx=0x7ff5a40119d0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 shutdown_connections 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff5b4108bb0 0x7ff5b419e2f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff59803cd10 0x7ff59803f100 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 --2- 172.21.15.164:0/3898849977 >> [v2:172.21.15.164:6800/460797646,v1:172.21.15.164:6801/460797646] conn(0x7ff598039420 0x7ff59803b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.696+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 >> 172.21.15.164:0/3898849977 conn(0x7ff5b4102620 msgr2=0x7ff5b4103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.697+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 shutdown_connections 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:43.697+0000 7ff5b8e00700 1 -- 172.21.15.164:0/3898849977 wait complete. 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:mgr epoch 5 is available 2024-03-27T08:22:44.421 INFO:teuthology.orchestra.run.smithi164.stdout:Setting orchestrator backend to cephadm... 2024-03-27T08:22:44.975 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:44 smithi164 ceph-mon[31788]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-27T08:22:44.976 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:44 smithi164 ceph-mon[31788]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-27T08:22:45.988 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:45 smithi164 ceph-mon[31788]: mgrmap e8: x(active, since 2s) 2024-03-27T08:22:45.989 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:45 smithi164 ceph-mon[31788]: [27/Mar/2024:08:22:44] ENGINE Bus STARTING 2024-03-27T08:22:45.989 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:45 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:22:45.989 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:45 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:45.989 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:45 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:22:46.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.020+0000 7ff51a400700 1 Processor -- start 2024-03-27T08:22:46.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff51a400700 1 -- start start 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff51a400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff51a400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff514111900 con 0x7ff51410ef40 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff513400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff513400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57394/0 (socket says 172.21.15.164:57394) 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.021+0000 7ff513400700 1 -- 172.21.15.164:0/739063036 learned_addr learned my addr 172.21.15.164:0/739063036 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.022+0000 7ff513400700 1 -- 172.21.15.164:0/739063036 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff514111a80 con 0x7ff51410ef40 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.022+0000 7ff513400700 1 --2- 172.21.15.164:0/739063036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098a0 tx=0x7ff504009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64744dc28d6ab102 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.022+0000 7ff512000700 1 -- 172.21.15.164:0/739063036 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504004160 con 0x7ff51410ef40 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.022+0000 7ff512000700 1 -- 172.21.15.164:0/739063036 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ff504004300 con 0x7ff51410ef40 2024-03-27T08:22:46.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.022+0000 7ff512000700 1 -- 172.21.15.164:0/739063036 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff504011b40 con 0x7ff51410ef40 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 -- 172.21.15.164:0/739063036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 msgr2=0x7ff514111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 --2- 172.21.15.164:0/739063036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff5040098a0 tx=0x7ff504009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 -- 172.21.15.164:0/739063036 shutdown_connections 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 --2- 172.21.15.164:0/739063036 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff514111330 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 -- 172.21.15.164:0/739063036 >> 172.21.15.164:0/739063036 conn(0x7ff51407d710 msgr2=0x7ff51407fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 -- 172.21.15.164:0/739063036 shutdown_connections 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.023+0000 7ff51a400700 1 -- 172.21.15.164:0/739063036 wait complete. 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.024+0000 7ff51a400700 1 Processor -- start 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.024+0000 7ff51a400700 1 -- start start 2024-03-27T08:22:46.007 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.024+0000 7ff51a400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.024+0000 7ff51a400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff514112b00 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.025+0000 7ff513400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.025+0000 7ff513400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57402/0 (socket says 172.21.15.164:57402) 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.025+0000 7ff513400700 1 -- 172.21.15.164:0/3832082373 learned_addr learned my addr 172.21.15.164:0/3832082373 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.025+0000 7ff513400700 1 -- 172.21.15.164:0/3832082373 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5141a2b90 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.025+0000 7ff513400700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff504011840 tx=0x7ff5040119d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.026+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5040039e0 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.026+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ff504020070 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.026+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5040193c0 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.026+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5141a2e20 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.026+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5141a5b10 con 0x7ff51410ef40 2024-03-27T08:22:46.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.027+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7ff50401a430 con 0x7ff51410ef40 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.027+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff514063c70 con 0x7ff51410ef40 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.027+0000 7ff50be00700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 0x7ff4f803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.027+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff50404d5f0 con 0x7ff51410ef40 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.028+0000 7ff512a00700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 0x7ff4f803b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.028+0000 7ff512a00700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 0x7ff4f803b8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff500006fd0 tx=0x7ff500006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.034+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff50400e260 con 0x7ff51410ef40 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.273+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff51407e940 con 0x7ff4f8039420 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.282+0000 7ff50be00700 1 -- 172.21.15.164:0/3832082373 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff51407e940 con 0x7ff4f8039420 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 msgr2=0x7ff4f803b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 0x7ff4f803b8e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff500006fd0 tx=0x7ff500006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 msgr2=0x7ff5141a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:46.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff504011840 tx=0x7ff5040119d0 comp rx=0 tx=0).stop 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 shutdown_connections 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7ff4f8039420 0x7ff4f803b8e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 --2- 172.21.15.164:0/3832082373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff51410ef40 0x7ff5141a2650 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.285+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 >> 172.21.15.164:0/3832082373 conn(0x7ff51407d710 msgr2=0x7ff51407e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.286+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 shutdown_connections 2024-03-27T08:22:46.010 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:45.286+0000 7ff51a400700 1 -- 172.21.15.164:0/3832082373 wait complete. 2024-03-27T08:22:46.838 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:46 smithi164 ceph-mon[31788]: [27/Mar/2024:08:22:44] ENGINE Serving on https://172.21.15.164:7150 2024-03-27T08:22:46.839 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:46 smithi164 ceph-mon[31788]: [27/Mar/2024:08:22:45] ENGINE Serving on http://172.21.15.164:8765 2024-03-27T08:22:46.839 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:46 smithi164 ceph-mon[31788]: [27/Mar/2024:08:22:45] ENGINE Bus STARTED 2024-03-27T08:22:46.839 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:46 smithi164 ceph-mon[31788]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:22:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout value unchanged 2024-03-27T08:22:47.495 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.603+0000 7f9faa200700 1 Processor -- start 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.603+0000 7f9faa200700 1 -- start start 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.604+0000 7f9faa200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.604+0000 7f9faa200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa407be40 con 0x7f9fa4106ac0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.604+0000 7f9fa3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.604+0000 7f9fa3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41744/0 (socket says 172.21.15.164:41744) 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.604+0000 7f9fa3400700 1 -- 172.21.15.164:0/1803798168 learned_addr learned my addr 172.21.15.164:0/1803798168 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.605+0000 7f9fa3400700 1 -- 172.21.15.164:0/1803798168 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa4107420 con 0x7f9fa4106ac0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.605+0000 7f9fa3400700 1 --2- 172.21.15.164:0/1803798168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f940098a0 tx=0x7f9f94009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72d182e0668a746a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.605+0000 7f9fa2000700 1 -- 172.21.15.164:0/1803798168 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f94004160 con 0x7f9fa4106ac0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.605+0000 7f9fa2000700 1 -- 172.21.15.164:0/1803798168 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f9f94004300 con 0x7f9fa4106ac0 2024-03-27T08:22:47.496 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.605+0000 7f9fa2000700 1 -- 172.21.15.164:0/1803798168 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f94011b40 con 0x7f9fa4106ac0 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 -- 172.21.15.164:0/1803798168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 msgr2=0x7f9fa4106ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 --2- 172.21.15.164:0/1803798168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f9f940098a0 tx=0x7f9f94009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 -- 172.21.15.164:0/1803798168 shutdown_connections 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 --2- 172.21.15.164:0/1803798168 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa4106ee0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 -- 172.21.15.164:0/1803798168 >> 172.21.15.164:0/1803798168 conn(0x7f9fa4102680 msgr2=0x7f9fa4104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 -- 172.21.15.164:0/1803798168 shutdown_connections 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.606+0000 7f9faa200700 1 -- 172.21.15.164:0/1803798168 wait complete. 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.607+0000 7f9faa200700 1 Processor -- start 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.607+0000 7f9faa200700 1 -- start start 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9faa200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9faa200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa4108440 con 0x7f9fa4106ac0 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9fa3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:47.497 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9fa3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41750/0 (socket says 172.21.15.164:41750) 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9fa3400700 1 -- 172.21.15.164:0/3109264141 learned_addr learned my addr 172.21.15.164:0/3109264141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.608+0000 7f9fa3400700 1 -- 172.21.15.164:0/3109264141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa419e8a0 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9fa3400700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f94004180 tx=0x7f9f940046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f940039e0 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f9f94020070 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa419eb30 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9f940193c0 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.609+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41a1820 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.610+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa4063c70 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.610+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f9f9401a430 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.611+0000 7f9f9be00700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 0x7f9f8803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.611+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9f9404d650 con 0x7f9fa4106ac0 2024-03-27T08:22:47.498 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.611+0000 7f9fa2a00700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 0x7f9f8803b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.612+0000 7f9fa2a00700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 0x7f9f8803b8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f90006fd0 tx=0x7f9f90006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.617+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9f9400e260 con 0x7f9fa4106ac0 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.846+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f9fa40008d0 con 0x7f9f88039420 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.847+0000 7f9f9be00700 1 -- 172.21.15.164:0/3109264141 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f9fa40008d0 con 0x7f9f88039420 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.850+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 msgr2=0x7f9f8803b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.850+0000 7f9faa200700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 0x7f9f8803b8e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9f90006fd0 tx=0x7f9f90006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.850+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 msgr2=0x7f9fa419e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.850+0000 7f9faa200700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f9f94004180 tx=0x7f9f940046a0 comp rx=0 tx=0).stop 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 shutdown_connections 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9f88039420 0x7f9f8803b8e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 --2- 172.21.15.164:0/3109264141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fa4106ac0 0x7f9fa419e360 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 >> 172.21.15.164:0/3109264141 conn(0x7f9fa4102680 msgr2=0x7f9fa4194fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 shutdown_connections 2024-03-27T08:22:47.499 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:46.851+0000 7f9faa200700 1 -- 172.21.15.164:0/3109264141 wait complete. 2024-03-27T08:22:47.500 INFO:teuthology.orchestra.run.smithi164.stdout:Generating ssh key... 2024-03-27T08:22:48.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:47 smithi164 ceph-mon[31788]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: Generating public/private rsa key pair. 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: Your identification has been saved in /tmp/tmphtu5q7pg/key. 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: Your public key has been saved in /tmp/tmphtu5q7pg/key.pub. 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: The key fingerprint is: 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: SHA256:GJRHvcWB6xoJQCuulJZ7+La3qewvKDYl3xhTcWBGuRM ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: The key's randomart image is: 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: +---[RSA 3072]----+ 2024-03-27T08:22:49.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: | .o=+o.. o.. | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: | +E... o o | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: | . ..*. + | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: | .o. +.o o | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: | =. . o.So | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: |ooo+ o . | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: |.o=.= o | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: |.++= o. . | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: |o +**+. | 2024-03-27T08:22:49.007 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:22:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: +----[SHA256]-----+ 2024-03-27T08:22:49.444 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.116+0000 7feb8ac00700 1 Processor -- start 2024-03-27T08:22:49.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.116+0000 7feb8ac00700 1 -- start start 2024-03-27T08:22:49.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.117+0000 7feb8ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:49.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.117+0000 7feb8ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb84106e30 con 0x7feb84106440 2024-03-27T08:22:49.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.117+0000 7feb83e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:49.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.117+0000 7feb83e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41758/0 (socket says 172.21.15.164:41758) 2024-03-27T08:22:49.448 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.117+0000 7feb83e00700 1 -- 172.21.15.164:0/935022755 learned_addr learned my addr 172.21.15.164:0/935022755 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:49.448 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.118+0000 7feb83e00700 1 -- 172.21.15.164:0/935022755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb84107160 con 0x7feb84106440 2024-03-27T08:22:49.448 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.118+0000 7feb83e00700 1 --2- 172.21.15.164:0/935022755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb740098a0 tx=0x7feb74009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c74bc52161e1d32 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.118+0000 7feb82a00700 1 -- 172.21.15.164:0/935022755 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74004160 con 0x7feb84106440 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.118+0000 7feb82a00700 1 -- 172.21.15.164:0/935022755 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7feb74004300 con 0x7feb84106440 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.118+0000 7feb82a00700 1 -- 172.21.15.164:0/935022755 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74011b40 con 0x7feb84106440 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 -- 172.21.15.164:0/935022755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 msgr2=0x7feb84106860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 --2- 172.21.15.164:0/935022755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feb740098a0 tx=0x7feb74009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 -- 172.21.15.164:0/935022755 shutdown_connections 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 --2- 172.21.15.164:0/935022755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb84106860 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 -- 172.21.15.164:0/935022755 >> 172.21.15.164:0/935022755 conn(0x7feb84101e10 msgr2=0x7feb84104230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 -- 172.21.15.164:0/935022755 shutdown_connections 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.119+0000 7feb8ac00700 1 -- 172.21.15.164:0/935022755 wait complete. 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.120+0000 7feb8ac00700 1 Processor -- start 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.120+0000 7feb8ac00700 1 -- start start 2024-03-27T08:22:49.449 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb8ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb8ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb8410a530 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb83e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb83e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41772/0 (socket says 172.21.15.164:41772) 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb83e00700 1 -- 172.21.15.164:0/1160182286 learned_addr learned my addr 172.21.15.164:0/1160182286 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.121+0000 7feb83e00700 1 -- 172.21.15.164:0/1160182286 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb841a2c50 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb83e00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb74011840 tx=0x7feb74004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb740038b0 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7feb7401a430 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb841a2ee0 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feb74024650 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.122+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb841a5bd0 con 0x7feb84106440 2024-03-27T08:22:49.450 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.123+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7feb74022020 con 0x7feb84106440 2024-03-27T08:22:49.451 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.123+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb84063c70 con 0x7feb84106440 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.124+0000 7feb80c00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 0x7feb6803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.124+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7feb7404d3a0 con 0x7feb84106440 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.124+0000 7feb83400700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 0x7feb6803b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.125+0000 7feb83400700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 0x7feb6803b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb70006fd0 tx=0x7feb70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.129+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7feb740042a0 con 0x7feb84106440 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.353+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7feb840008d0 con 0x7feb68039420 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.637+0000 7feb80c00700 1 -- 172.21.15.164:0/1160182286 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7feb840008d0 con 0x7feb68039420 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 msgr2=0x7feb6803b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 0x7feb6803b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7feb70006fd0 tx=0x7feb70006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 msgr2=0x7feb841a2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7feb74011840 tx=0x7feb74004230 comp rx=0 tx=0).stop 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 shutdown_connections 2024-03-27T08:22:49.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7feb68039420 0x7feb6803b8e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:49.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 --2- 172.21.15.164:0/1160182286 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb84106440 0x7feb841a2710 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:49.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 >> 172.21.15.164:0/1160182286 conn(0x7feb84101e10 msgr2=0x7feb8410cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:49.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 shutdown_connections 2024-03-27T08:22:49.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:48.641+0000 7feb8ac00700 1 -- 172.21.15.164:0/1160182286 wait complete. 2024-03-27T08:22:49.746 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:49 smithi164 ceph-mon[31788]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:22:49.746 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:49 smithi164 ceph-mon[31788]: Generating ssh key... 2024-03-27T08:22:49.746 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:49 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:49.746 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:49 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:51.008 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:22:51.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.057+0000 7f4c2ea00700 1 Processor -- start 2024-03-27T08:22:51.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.057+0000 7f4c2ea00700 1 -- start start 2024-03-27T08:22:51.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.058+0000 7f4c2ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:51.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.058+0000 7f4c2ea00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2810ab30 con 0x7f4c2810a140 2024-03-27T08:22:51.009 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.058+0000 7f4c2d600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:51.011 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.058+0000 7f4c2d600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41784/0 (socket says 172.21.15.164:41784) 2024-03-27T08:22:51.011 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.058+0000 7f4c2d600700 1 -- 172.21.15.164:0/3403182717 learned_addr learned my addr 172.21.15.164:0/3403182717 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:51.011 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.059+0000 7f4c2d600700 1 -- 172.21.15.164:0/3403182717 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2810b340 con 0x7f4c2810a140 2024-03-27T08:22:51.011 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.059+0000 7f4c2d600700 1 --2- 172.21.15.164:0/3403182717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0098a0 tx=0x7f4c1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=854282148dcc6ba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:51.011 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.059+0000 7f4c27e00700 1 -- 172.21.15.164:0/3403182717 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c004160 con 0x7f4c2810a140 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.059+0000 7f4c27e00700 1 -- 172.21.15.164:0/3403182717 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f4c1c004300 con 0x7f4c2810a140 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.059+0000 7f4c27e00700 1 -- 172.21.15.164:0/3403182717 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c011b40 con 0x7f4c2810a140 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 -- 172.21.15.164:0/3403182717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 msgr2=0x7f4c2810a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/3403182717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0098a0 tx=0x7f4c1c009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 -- 172.21.15.164:0/3403182717 shutdown_connections 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/3403182717 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2810a560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 -- 172.21.15.164:0/3403182717 >> 172.21.15.164:0/3403182717 conn(0x7f4c2807d530 msgr2=0x7f4c2807d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 -- 172.21.15.164:0/3403182717 shutdown_connections 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.060+0000 7f4c2ea00700 1 -- 172.21.15.164:0/3403182717 wait complete. 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.061+0000 7f4c2ea00700 1 Processor -- start 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.061+0000 7f4c2ea00700 1 -- start start 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.061+0000 7f4c2ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.061+0000 7f4c2ea00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c2810e6f0 con 0x7f4c2810a140 2024-03-27T08:22:51.012 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.062+0000 7f4c2d600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:51.013 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.062+0000 7f4c2d600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41800/0 (socket says 172.21.15.164:41800) 2024-03-27T08:22:51.015 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.062+0000 7f4c2d600700 1 -- 172.21.15.164:0/167753543 learned_addr learned my addr 172.21.15.164:0/167753543 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.062+0000 7f4c2d600700 1 -- 172.21.15.164:0/167753543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c2819e6d0 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.062+0000 7f4c2d600700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c011840 tx=0x7f4c1c004230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.063+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c0038b0 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.063+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f4c1c01a430 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.063+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c2819e960 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.063+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c1c024650 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.063+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c281a1650 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.064+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c28063c70 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.064+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f4c1c022020 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.065+0000 7f4c26000700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 0x7f4c1003b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.065+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4c1c04d370 con 0x7f4c2810a140 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.065+0000 7f4c2cc00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 0x7f4c1003b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:51.016 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.066+0000 7f4c2cc00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 0x7f4c1003b8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c14006fd0 tx=0x7f4c14006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.071+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4c1c04ccc0 con 0x7f4c2810a140 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.295+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f4c28107c70 con 0x7f4c10039420 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.297+0000 7f4c26000700 1 -- 172.21.15.164:0/167753543 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f4c28107c70 con 0x7f4c10039420 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.299+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 msgr2=0x7f4c1003b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 0x7f4c1003b8e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f4c14006fd0 tx=0x7f4c14006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 msgr2=0x7f4c2819e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c011840 tx=0x7f4c1c004230 comp rx=0 tx=0).stop 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 shutdown_connections 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f4c10039420 0x7f4c1003b8e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 --2- 172.21.15.164:0/167753543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c2810a140 0x7f4c2819e190 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 >> 172.21.15.164:0/167753543 conn(0x7f4c2807d530 msgr2=0x7f4c28107560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 shutdown_connections 2024-03-27T08:22:51.017 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:50.300+0000 7f4c2ea00700 1 -- 172.21.15.164:0/167753543 wait complete. 2024-03-27T08:22:51.018 INFO:teuthology.orchestra.run.smithi164.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-27T08:22:51.018 INFO:teuthology.orchestra.run.smithi164.stdout:Adding key to root@localhost authorized_keys... 2024-03-27T08:22:51.018 INFO:teuthology.orchestra.run.smithi164.stdout:Adding host smithi164... 2024-03-27T08:22:51.204 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:50 smithi164 ceph-mon[31788]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:22:52.136 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:51 smithi164 ceph-mon[31788]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi164", "addr": "172.21.15.164", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:22:54.219 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:53 smithi164 ceph-mon[31788]: Deploying cephadm binary to smithi164 2024-03-27T08:22:59.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout Added host 'smithi164' with addr '172.21.15.164' 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.644+0000 7f89c8c00700 1 Processor -- start 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.644+0000 7f89c8c00700 1 -- start start 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.645+0000 7f89c8c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.645+0000 7f89c8c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89c4108b30 con 0x7f89c4108140 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.645+0000 7f89c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.645+0000 7f89c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41814/0 (socket says 172.21.15.164:41814) 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.645+0000 7f89c1e00700 1 -- 172.21.15.164:0/341901303 learned_addr learned my addr 172.21.15.164:0/341901303 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.646+0000 7f89c1e00700 1 -- 172.21.15.164:0/341901303 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c4109340 con 0x7f89c4108140 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.646+0000 7f89c1e00700 1 --2- 172.21.15.164:0/341901303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098a0 tx=0x7f89b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2b6c4f26fa06e3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.646+0000 7f89c0a00700 1 -- 172.21.15.164:0/341901303 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89b4004160 con 0x7f89c4108140 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.646+0000 7f89c0a00700 1 -- 172.21.15.164:0/341901303 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f89b4004300 con 0x7f89c4108140 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.646+0000 7f89c0a00700 1 -- 172.21.15.164:0/341901303 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89b4011b40 con 0x7f89c4108140 2024-03-27T08:22:59.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.647+0000 7f89c8c00700 1 -- 172.21.15.164:0/341901303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 msgr2=0x7f89c4108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.647+0000 7f89c8c00700 1 --2- 172.21.15.164:0/341901303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f89b40098a0 tx=0x7f89b4009bb0 comp rx=0 tx=0).stop 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.647+0000 7f89c8c00700 1 -- 172.21.15.164:0/341901303 shutdown_connections 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.647+0000 7f89c8c00700 1 --2- 172.21.15.164:0/341901303 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c4108560 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.647+0000 7f89c8c00700 1 -- 172.21.15.164:0/341901303 >> 172.21.15.164:0/341901303 conn(0x7f89c41036e0 msgr2=0x7f89c4105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.648+0000 7f89c8c00700 1 -- 172.21.15.164:0/341901303 shutdown_connections 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.648+0000 7f89c8c00700 1 -- 172.21.15.164:0/341901303 wait complete. 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c8c00700 1 Processor -- start 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c8c00700 1 -- start start 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c8c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c8c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89c410c6f0 con 0x7f89c4108140 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41826/0 (socket says 172.21.15.164:41826) 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.649+0000 7f89c1e00700 1 -- 172.21.15.164:0/3079899732 learned_addr learned my addr 172.21.15.164:0/3079899732 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89c1e00700 1 -- 172.21.15.164:0/3079899732 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c419e8a0 con 0x7f89c4108140 2024-03-27T08:22:59.004 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89c1e00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89b4011670 tx=0x7f89b4011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89b40038b0 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f89b401a430 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f89b4019550 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89c419eb30 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.650+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89c41a1820 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.651+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f89b401aa50 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.651+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89c4063c70 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.652+0000 7f89baa00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 0x7f89a803b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.652+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f89b404d7b0 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.652+0000 7f89c1400700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 0x7f89a803b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.653+0000 7f89c1400700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 0x7f89a803b890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89b0006fd0 tx=0x7f89b0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.658+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f89b4023e50 con 0x7f89c4108140 2024-03-27T08:22:59.005 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:51.886+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi164", "addr": "172.21.15.164", "target": ["mon-mgr", ""]}) -- 0x7f89c4104970 con 0x7f89a80393d0 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.107+0000 7f89baa00700 1 -- 172.21.15.164:0/3079899732 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f89c4104970 con 0x7f89a80393d0 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.112+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 msgr2=0x7f89a803b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.112+0000 7f89c8c00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 0x7f89a803b890 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f89b0006fd0 tx=0x7f89b0006e40 comp rx=0 tx=0).stop 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.112+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 msgr2=0x7f89c419e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.112+0000 7f89c8c00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f89b4011670 tx=0x7f89b4011b50 comp rx=0 tx=0).stop 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 shutdown_connections 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f89a80393d0 0x7f89a803b890 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 --2- 172.21.15.164:0/3079899732 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89c4108140 0x7f89c419e360 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 >> 172.21.15.164:0/3079899732 conn(0x7f89c41036e0 msgr2=0x7f89c4104260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 shutdown_connections 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:58.113+0000 7f89c8c00700 1 -- 172.21.15.164:0/3079899732 wait complete. 2024-03-27T08:22:59.006 INFO:teuthology.orchestra.run.smithi164.stdout:Deploying unmanaged mon service... 2024-03-27T08:22:59.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:59 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:22:59.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:59 smithi164 ceph-mon[31788]: Added host smithi164 2024-03-27T08:22:59.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:22:59 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:01.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:00 smithi164 ceph-mon[31788]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:01.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:00 smithi164 ceph-mon[31788]: Saving service mon spec with placement count:5 2024-03-27T08:23:01.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:00 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:01.699 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.679+0000 7f00ca800700 1 Processor -- start 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.679+0000 7f00ca800700 1 -- start start 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00ca800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00ca800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4107a30 con 0x7f00c4107040 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00c3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00c3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41482/0 (socket says 172.21.15.164:41482) 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00c3400700 1 -- 172.21.15.164:0/2719805999 learned_addr learned my addr 172.21.15.164:0/2719805999 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.680+0000 7f00c3400700 1 -- 172.21.15.164:0/2719805999 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c4108240 con 0x7f00c4107040 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.681+0000 7f00c3400700 1 --2- 172.21.15.164:0/2719805999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f00b400d180 tx=0x7f00b400d490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a11474a6879d9e0c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.681+0000 7f00c2a00700 1 -- 172.21.15.164:0/2719805999 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b4019070 con 0x7f00c4107040 2024-03-27T08:23:01.700 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.681+0000 7f00c2a00700 1 -- 172.21.15.164:0/2719805999 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f00b400de20 con 0x7f00c4107040 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.681+0000 7f00c2a00700 1 -- 172.21.15.164:0/2719805999 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b4009b70 con 0x7f00c4107040 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 -- 172.21.15.164:0/2719805999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 msgr2=0x7f00c4107460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 --2- 172.21.15.164:0/2719805999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f00b400d180 tx=0x7f00b400d490 comp rx=0 tx=0).stop 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 -- 172.21.15.164:0/2719805999 shutdown_connections 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 --2- 172.21.15.164:0/2719805999 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c4107460 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 -- 172.21.15.164:0/2719805999 >> 172.21.15.164:0/2719805999 conn(0x7f00c4102620 msgr2=0x7f00c4104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 -- 172.21.15.164:0/2719805999 shutdown_connections 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.682+0000 7f00ca800700 1 -- 172.21.15.164:0/2719805999 wait complete. 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.683+0000 7f00ca800700 1 Processor -- start 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.684+0000 7f00ca800700 1 -- start start 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.684+0000 7f00ca800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.684+0000 7f00ca800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f00c4062a80 con 0x7f00c4107040 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.685+0000 7f00c3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:01.701 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.685+0000 7f00c3400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41486/0 (socket says 172.21.15.164:41486) 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.685+0000 7f00c3400700 1 -- 172.21.15.164:0/1966157127 learned_addr learned my addr 172.21.15.164:0/1966157127 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.685+0000 7f00c3400700 1 -- 172.21.15.164:0/1966157127 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c419e830 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.685+0000 7f00c3400700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00b400bd10 tx=0x7f00b4009370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.686+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b4019040 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.686+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f00b4003d10 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.686+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c419eac0 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.686+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f00b401f920 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.686+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c41a17b0 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.687+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00c4063c70 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.687+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f00b4004750 con 0x7f00c4107040 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.688+0000 7f00c0c00700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 0x7f00a803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:01.702 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.688+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f00b4011050 con 0x7f00c4107040 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.688+0000 7f00bbe00700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 0x7f00a803b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.689+0000 7f00bbe00700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 0x7f00a803b8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006fd0 tx=0x7f00ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.693+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f00b404d900 con 0x7f00c4107040 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.955+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f00c4074fd0 con 0x7f00a8039420 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.964+0000 7f00c0c00700 1 -- 172.21.15.164:0/1966157127 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f00c4074fd0 con 0x7f00a8039420 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 msgr2=0x7f00a803b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 0x7f00a803b8e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f00ac006fd0 tx=0x7f00ac006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 msgr2=0x7f00c419e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f00b400bd10 tx=0x7f00b4009370 comp rx=0 tx=0).stop 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 shutdown_connections 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f00a8039420 0x7f00a803b8e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 --2- 172.21.15.164:0/1966157127 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f00c4107040 0x7f00c419e2f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:01.703 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 >> 172.21.15.164:0/1966157127 conn(0x7f00c4102620 msgr2=0x7f00c4194930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:01.704 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 shutdown_connections 2024-03-27T08:23:01.704 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:22:59.967+0000 7f00ca800700 1 -- 172.21.15.164:0/1966157127 wait complete. 2024-03-27T08:23:01.704 INFO:teuthology.orchestra.run.smithi164.stdout:Deploying unmanaged mgr service... 2024-03-27T08:23:02.601 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:02 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:03.341 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-03-27T08:23:03.341 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.343+0000 7f9e3d000700 1 Processor -- start 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e3d000700 1 -- start start 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e3d000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e3d000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e38108b30 con 0x7f9e38108140 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e35e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e35e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41498/0 (socket says 172.21.15.164:41498) 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.344+0000 7f9e35e00700 1 -- 172.21.15.164:0/1466628910 learned_addr learned my addr 172.21.15.164:0/1466628910 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.345+0000 7f9e35e00700 1 -- 172.21.15.164:0/1466628910 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e38109340 con 0x7f9e38108140 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.345+0000 7f9e35e00700 1 --2- 172.21.15.164:0/1466628910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e280098a0 tx=0x7f9e28009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5893dab843ab044a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.345+0000 7f9e34a00700 1 -- 172.21.15.164:0/1466628910 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28004160 con 0x7f9e38108140 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.345+0000 7f9e34a00700 1 -- 172.21.15.164:0/1466628910 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9e28004300 con 0x7f9e38108140 2024-03-27T08:23:03.342 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.345+0000 7f9e34a00700 1 -- 172.21.15.164:0/1466628910 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28011b10 con 0x7f9e38108140 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 -- 172.21.15.164:0/1466628910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 msgr2=0x7f9e38108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 --2- 172.21.15.164:0/1466628910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f9e280098a0 tx=0x7f9e28009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 -- 172.21.15.164:0/1466628910 shutdown_connections 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 --2- 172.21.15.164:0/1466628910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e38108560 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 -- 172.21.15.164:0/1466628910 >> 172.21.15.164:0/1466628910 conn(0x7f9e381036e0 msgr2=0x7f9e38105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 -- 172.21.15.164:0/1466628910 shutdown_connections 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.346+0000 7f9e3d000700 1 -- 172.21.15.164:0/1466628910 wait complete. 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.347+0000 7f9e3d000700 1 Processor -- start 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e3d000700 1 -- start start 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e3d000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e3d000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e3810c6f0 con 0x7f9e38108140 2024-03-27T08:23:03.343 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e35e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e35e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41514/0 (socket says 172.21.15.164:41514) 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e35e00700 1 -- 172.21.15.164:0/2924547592 learned_addr learned my addr 172.21.15.164:0/2924547592 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.348+0000 7f9e35e00700 1 -- 172.21.15.164:0/2924547592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e3819e8f0 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e35e00700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006af0 tx=0x7f9e28011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28003af0 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9e28003c90 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e3819eb80 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e28024830 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.349+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e381a1870 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.350+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f9e28022020 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.350+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e38063c70 con 0x7f9e38108140 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.351+0000 7f9e2ea00700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 0x7f9e1c03b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:03.344 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.351+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9e2804d4b0 con 0x7f9e38108140 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.351+0000 7f9e35400700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 0x7f9e1c03b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.352+0000 7f9e35400700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 0x7f9e1c03b890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9e24006fd0 tx=0x7f9e24006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.356+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9e2804ce00 con 0x7f9e38108140 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.608+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f9e38104930 con 0x7f9e1c0393d0 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.616+0000 7f9e2ea00700 1 -- 172.21.15.164:0/2924547592 <== mgr.14120 v2:172.21.15.164:6800/3452126215 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f9e38104930 con 0x7f9e1c0393d0 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 msgr2=0x7f9e1c03b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 0x7f9e1c03b890 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9e24006fd0 tx=0x7f9e24006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 msgr2=0x7f9e3819e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e28006af0 tx=0x7f9e28011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 shutdown_connections 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f9e1c0393d0 0x7f9e1c03b890 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 --2- 172.21.15.164:0/2924547592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e38108140 0x7f9e3819e3b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:03.345 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.619+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 >> 172.21.15.164:0/2924547592 conn(0x7f9e381036e0 msgr2=0x7f9e38104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:03.346 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.620+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 shutdown_connections 2024-03-27T08:23:03.346 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:02.620+0000 7f9e3d000700 1 -- 172.21.15.164:0/2924547592 wait complete. 2024-03-27T08:23:03.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:03 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:03.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:03 smithi164 ceph-mon[31788]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:03.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:03 smithi164 ceph-mon[31788]: Saving service mgr spec with placement count:2 2024-03-27T08:23:03.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:03 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:03.617 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:03 smithi164 ceph-mon[31788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:05.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:05 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1726302307' entity='client.admin' 2024-03-27T08:23:05.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:05 smithi164 ceph-mon[31788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:05.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:05 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:05.367 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.945+0000 7f594ac00700 1 Processor -- start 2024-03-27T08:23:05.367 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.946+0000 7f594ac00700 1 -- start start 2024-03-27T08:23:05.367 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.946+0000 7f594ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:05.367 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.946+0000 7f594ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f594407be80 con 0x7f5944108c90 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.946+0000 7f5943e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.947+0000 7f5943e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41518/0 (socket says 172.21.15.164:41518) 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.947+0000 7f5943e00700 1 -- 172.21.15.164:0/2205750341 learned_addr learned my addr 172.21.15.164:0/2205750341 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.947+0000 7f5943e00700 1 -- 172.21.15.164:0/2205750341 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594410b5c0 con 0x7f5944108c90 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.947+0000 7f5943e00700 1 --2- 172.21.15.164:0/2205750341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59340098a0 tx=0x7f5934009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d2755ba4e3df970 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.948+0000 7f5942a00700 1 -- 172.21.15.164:0/2205750341 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934004160 con 0x7f5944108c90 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.948+0000 7f5942a00700 1 -- 172.21.15.164:0/2205750341 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5934004300 con 0x7f5944108c90 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.948+0000 7f5942a00700 1 -- 172.21.15.164:0/2205750341 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934011b10 con 0x7f5944108c90 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 -- 172.21.15.164:0/2205750341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 msgr2=0x7f594410b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 --2- 172.21.15.164:0/2205750341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f59340098a0 tx=0x7f5934009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 -- 172.21.15.164:0/2205750341 shutdown_connections 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 --2- 172.21.15.164:0/2205750341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594410b080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:05.368 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 -- 172.21.15.164:0/2205750341 >> 172.21.15.164:0/2205750341 conn(0x7f5944102680 msgr2=0x7f5944104ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 -- 172.21.15.164:0/2205750341 shutdown_connections 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.949+0000 7f594ac00700 1 -- 172.21.15.164:0/2205750341 wait complete. 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.950+0000 7f594ac00700 1 Processor -- start 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f594ac00700 1 -- start start 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f594ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f594ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f594410c620 con 0x7f5944108c90 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f5943e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f5943e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41522/0 (socket says 172.21.15.164:41522) 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.951+0000 7f5943e00700 1 -- 172.21.15.164:0/1726302307 learned_addr learned my addr 172.21.15.164:0/1726302307 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.952+0000 7f5943e00700 1 -- 172.21.15.164:0/1726302307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594419c680 con 0x7f5944108c90 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.952+0000 7f5943e00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5934006af0 tx=0x7f5934011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.952+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934003af0 con 0x7f5944108c90 2024-03-27T08:23:05.369 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.953+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5934003c90 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.953+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5934024830 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.953+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594419c910 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.953+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594419f600 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.954+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5944063c70 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.954+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7f5934022020 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.955+0000 7f5940c00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 0x7f592803b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.955+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f593404d580 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.955+0000 7f5943400700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 0x7f592803b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.956+0000 7f5943400700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 0x7f592803b890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5930006fd0 tx=0x7f5930006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:03.960+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f593400f2e0 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.206+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f594419fbb0 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.210+0000 7f5940c00700 1 -- 172.21.15.164:0/1726302307 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f593404ced0 con 0x7f5944108c90 2024-03-27T08:23:05.370 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 msgr2=0x7f592803b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 0x7f592803b890 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5930006fd0 tx=0x7f5930006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 msgr2=0x7f594419c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f5934006af0 tx=0x7f5934011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 shutdown_connections 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f59280393d0 0x7f592803b890 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 --2- 172.21.15.164:0/1726302307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5944108c90 0x7f594419c140 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.214+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 >> 172.21.15.164:0/1726302307 conn(0x7f5944102680 msgr2=0x7f5944103210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.215+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 shutdown_connections 2024-03-27T08:23:05.371 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:04.215+0000 7f594ac00700 1 -- 172.21.15.164:0/1726302307 wait complete. 2024-03-27T08:23:06.992 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.044+0000 7fed1b000700 1 Processor -- start 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.044+0000 7fed1b000700 1 -- start start 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.044+0000 7fed1b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.044+0000 7fed1b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed14108b30 con 0x7fed14108140 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.045+0000 7fed13e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.045+0000 7fed13e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56648/0 (socket says 172.21.15.164:56648) 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.045+0000 7fed13e00700 1 -- 172.21.15.164:0/511460028 learned_addr learned my addr 172.21.15.164:0/511460028 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.045+0000 7fed13e00700 1 -- 172.21.15.164:0/511460028 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed14109340 con 0x7fed14108140 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed13e00700 1 --2- 172.21.15.164:0/511460028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed040098a0 tx=0x7fed04009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac1494fb46323f41 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed12a00700 1 -- 172.21.15.164:0/511460028 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04004160 con 0x7fed14108140 2024-03-27T08:23:06.999 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed12a00700 1 -- 172.21.15.164:0/511460028 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fed04004300 con 0x7fed14108140 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed12a00700 1 -- 172.21.15.164:0/511460028 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04011b10 con 0x7fed14108140 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed1b000700 1 -- 172.21.15.164:0/511460028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 msgr2=0x7fed14108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.046+0000 7fed1b000700 1 --2- 172.21.15.164:0/511460028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fed040098a0 tx=0x7fed04009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.047+0000 7fed1b000700 1 -- 172.21.15.164:0/511460028 shutdown_connections 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.047+0000 7fed1b000700 1 --2- 172.21.15.164:0/511460028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed14108560 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.047+0000 7fed1b000700 1 -- 172.21.15.164:0/511460028 >> 172.21.15.164:0/511460028 conn(0x7fed141036e0 msgr2=0x7fed14105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.047+0000 7fed1b000700 1 -- 172.21.15.164:0/511460028 shutdown_connections 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.047+0000 7fed1b000700 1 -- 172.21.15.164:0/511460028 wait complete. 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.048+0000 7fed1b000700 1 Processor -- start 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.048+0000 7fed1b000700 1 -- start start 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed1b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:07.000 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed1b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fed1410c6f0 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed13e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed13e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56662/0 (socket says 172.21.15.164:56662) 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed13e00700 1 -- 172.21.15.164:0/910428978 learned_addr learned my addr 172.21.15.164:0/910428978 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.049+0000 7fed13e00700 1 -- 172.21.15.164:0/910428978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1419e8e0 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed13e00700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed04006af0 tx=0x7fed04011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04003af0 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fed04003c90 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fed04024830 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1419eb70 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.050+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed141a1860 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.051+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7fed04022020 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.051+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed14063c70 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.052+0000 7fed10c00700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 0x7fecf803b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.052+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fed0404d390 con 0x7fed14108140 2024-03-27T08:23:07.001 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.052+0000 7fed13400700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 0x7fecf803b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.053+0000 7fed13400700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 0x7fecf803b8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.057+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fed0402d3f0 con 0x7fed14108140 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.281+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fed141a1a30 con 0x7fed14108140 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.285+0000 7fed10c00700 1 -- 172.21.15.164:0/910428978 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fed0400f2e0 con 0x7fed14108140 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 msgr2=0x7fecf803b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 0x7fecf803b8e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fed00006fd0 tx=0x7fed00006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 msgr2=0x7fed1419e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fed04006af0 tx=0x7fed04011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 shutdown_connections 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fecf8039420 0x7fecf803b8e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 --2- 172.21.15.164:0/910428978 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fed14108140 0x7fed1419e3a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.289+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 >> 172.21.15.164:0/910428978 conn(0x7fed141036e0 msgr2=0x7fed141042c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:07.002 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.290+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 shutdown_connections 2024-03-27T08:23:07.003 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:06.290+0000 7fed1b000700 1 -- 172.21.15.164:0/910428978 wait complete. 2024-03-27T08:23:07.003 INFO:teuthology.orchestra.run.smithi164.stdout:Enabling the dashboard module... 2024-03-27T08:23:07.571 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:07 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/910428978' entity='client.admin' 2024-03-27T08:23:07.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:07 smithi164 ceph-mon[31788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:07.618 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:07 smithi164 ceph-mon[31788]: from='mgr.14120 172.21.15.164:0/4008797648' entity='mgr.x' 2024-03-27T08:23:08.432 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/770776758' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-27T08:23:08.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: ignoring --setuser ceph since I am not root 2024-03-27T08:23:08.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: ignoring --setgroup ceph since I am not root 2024-03-27T08:23:09.227 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:09.114+0000 7fc5a246e200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T08:23:09.227 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:09.234+0000 7fc5a246e200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T08:23:09.494 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:09 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/770776758' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-27T08:23:09.495 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:09 smithi164 ceph-mon[31788]: mgrmap e9: x(active, since 25s) 2024-03-27T08:23:09.806 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.577+0000 7fd6d1000700 1 Processor -- start 2024-03-27T08:23:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.577+0000 7fd6d1000700 1 -- start start 2024-03-27T08:23:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.577+0000 7fd6d1000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.577+0000 7fd6d1000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc108b30 con 0x7fd6cc108140 2024-03-27T08:23:09.807 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.578+0000 7fd6c9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:09.808 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.578+0000 7fd6c9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56666/0 (socket says 172.21.15.164:56666) 2024-03-27T08:23:09.808 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.578+0000 7fd6c9e00700 1 -- 172.21.15.164:0/1025394698 learned_addr learned my addr 172.21.15.164:0/1025394698 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:09.808 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.578+0000 7fd6c9e00700 1 -- 172.21.15.164:0/1025394698 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc109340 con 0x7fd6cc108140 2024-03-27T08:23:09.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.579+0000 7fd6c9e00700 1 --2- 172.21.15.164:0/1025394698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098a0 tx=0x7fd6bc009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfeee093d7fc0c8f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:09.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.579+0000 7fd6c9400700 1 -- 172.21.15.164:0/1025394698 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6bc004160 con 0x7fd6cc108140 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.579+0000 7fd6c9400700 1 -- 172.21.15.164:0/1025394698 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd6bc004300 con 0x7fd6cc108140 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.579+0000 7fd6c9400700 1 -- 172.21.15.164:0/1025394698 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6bc011b10 con 0x7fd6cc108140 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 -- 172.21.15.164:0/1025394698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 msgr2=0x7fd6cc108560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 --2- 172.21.15.164:0/1025394698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc0098a0 tx=0x7fd6bc009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 -- 172.21.15.164:0/1025394698 shutdown_connections 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 --2- 172.21.15.164:0/1025394698 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc108560 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:09.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 -- 172.21.15.164:0/1025394698 >> 172.21.15.164:0/1025394698 conn(0x7fd6cc1036e0 msgr2=0x7fd6cc105b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:09.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 -- 172.21.15.164:0/1025394698 shutdown_connections 2024-03-27T08:23:09.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.580+0000 7fd6d1000700 1 -- 172.21.15.164:0/1025394698 wait complete. 2024-03-27T08:23:09.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.581+0000 7fd6d1000700 1 Processor -- start 2024-03-27T08:23:09.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.581+0000 7fd6d1000700 1 -- start start 2024-03-27T08:23:09.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6d1000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:09.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6d1000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd6cc10c6f0 con 0x7fd6cc108140 2024-03-27T08:23:09.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6c9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:09.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6c9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56670/0 (socket says 172.21.15.164:56670) 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6c9e00700 1 -- 172.21.15.164:0/770776758 learned_addr learned my addr 172.21.15.164:0/770776758 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.582+0000 7fd6c9e00700 1 -- 172.21.15.164:0/770776758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6cc19e8d0 con 0x7fd6cc108140 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6c9e00700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006af0 tx=0x7fd6bc011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6bc003af0 con 0x7fd6cc108140 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd6bc003c90 con 0x7fd6cc108140 2024-03-27T08:23:09.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6cc19eb60 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6bc024830 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.583+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6cc1a1850 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.584+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6cc063c70 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.584+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 8) ==== 46466+0+0 (secure 0 0 0) 0x7fd6bc022020 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.585+0000 7fd6c2a00700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 0x7fd6b003b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.585+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fd6bc056760 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.585+0000 7fd6c3e00700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 0x7fd6b003b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.586+0000 7fd6c3e00700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 0x7fd6b003b890 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.590+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd6bc010380 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:07.895+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fd6cc1a1a20 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.300+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fd6bc0172b0 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.303+0000 7fd6c2a00700 1 -- 172.21.15.164:0/770776758 <== mon.0 v2:172.21.15.164:3300/0 8 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7fd6bc019c60 con 0x7fd6cc108140 2024-03-27T08:23:09.816 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.306+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 msgr2=0x7fd6b003b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.306+0000 7fd6d1000700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 0x7fd6b003b890 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd6b4006fd0 tx=0x7fd6b4006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.306+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 msgr2=0x7fd6cc19e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.306+0000 7fd6d1000700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fd6bc006af0 tx=0x7fd6bc011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 shutdown_connections 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7fd6b00393d0 0x7fd6b003b890 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 --2- 172.21.15.164:0/770776758 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd6cc108140 0x7fd6cc19e390 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 >> 172.21.15.164:0/770776758 conn(0x7fd6cc1036e0 msgr2=0x7fd6cc104280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 shutdown_connections 2024-03-27T08:23:09.817 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:08.307+0000 7fd6d1000700 1 -- 172.21.15.164:0/770776758 wait complete. 2024-03-27T08:23:10.100 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.039+0000 7fc5a246e200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T08:23:10.365 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.165+0000 7fc5a246e200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T08:23:10.366 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.346+0000 7fc5a246e200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T08:23:10.634 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.475+0000 7fc5a246e200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T08:23:10.635 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.587+0000 7fc5a246e200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T08:23:10.914 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3835593923' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-27T08:23:11.171 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:10.921+0000 7fc5a246e200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T08:23:11.171 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:11.064+0000 7fc5a246e200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T08:23:11.171 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:11.178+0000 7fc5a246e200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T08:23:11.427 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:11.302+0000 7fc5a246e200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T08:23:11.428 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:23:11.434 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-03-27T08:23:11.434 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "available": true, 2024-03-27T08:23:11.434 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-03-27T08:23:11.434 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-03-27T08:23:11.434 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.433+0000 7f7b32e00700 1 Processor -- start 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.433+0000 7f7b32e00700 1 -- start start 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.434+0000 7f7b32e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.434+0000 7f7b32e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c108b40 con 0x7f7b2c108150 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.434+0000 7f7b2be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.434+0000 7f7b2be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56684/0 (socket says 172.21.15.164:56684) 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.434+0000 7f7b2be00700 1 -- 172.21.15.164:0/3722685395 learned_addr learned my addr 172.21.15.164:0/3722685395 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.435+0000 7f7b2be00700 1 -- 172.21.15.164:0/3722685395 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c109350 con 0x7f7b2c108150 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.435+0000 7f7b2be00700 1 --2- 172.21.15.164:0/3722685395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0098a0 tx=0x7f7b1c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bffed0afe4753501 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.435+0000 7f7b2aa00700 1 -- 172.21.15.164:0/3722685395 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c004160 con 0x7f7b2c108150 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.435+0000 7f7b2aa00700 1 -- 172.21.15.164:0/3722685395 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7b1c004300 con 0x7f7b2c108150 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.435+0000 7f7b2aa00700 1 -- 172.21.15.164:0/3722685395 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c011b10 con 0x7f7b2c108150 2024-03-27T08:23:11.435 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 -- 172.21.15.164:0/3722685395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 msgr2=0x7f7b2c108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3722685395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c0098a0 tx=0x7f7b1c009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 -- 172.21.15.164:0/3722685395 shutdown_connections 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3722685395 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c108570 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 -- 172.21.15.164:0/3722685395 >> 172.21.15.164:0/3722685395 conn(0x7f7b2c1036f0 msgr2=0x7f7b2c105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 -- 172.21.15.164:0/3722685395 shutdown_connections 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.436+0000 7f7b32e00700 1 -- 172.21.15.164:0/3722685395 wait complete. 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.437+0000 7f7b32e00700 1 Processor -- start 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.437+0000 7f7b32e00700 1 -- start start 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b32e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b32e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7b2c10c700 con 0x7f7b2c108150 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b2be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b2be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56698/0 (socket says 172.21.15.164:56698) 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b2be00700 1 -- 172.21.15.164:0/3835593923 learned_addr learned my addr 172.21.15.164:0/3835593923 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:11.436 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.438+0000 7f7b2be00700 1 -- 172.21.15.164:0/3835593923 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b2c19c6c0 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b2be00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c006af0 tx=0x7f7b1c011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c003af0 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7b1c003c90 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b1c024830 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b2c19c950 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.439+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b2c19f640 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.440+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7f7b1c022020 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.440+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b2c063c70 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.441+0000 7f7b28c00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 0x7f7b1003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.441+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b1c04d3e0 con 0x7f7b2c108150 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.441+0000 7f7b2b400700 1 -- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 msgr2=0x7f7b1003b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.441+0000 7f7b2b400700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 0x7f7b1003b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:23:11.437 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.446+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7b1c02a2a0 con 0x7f7b2c108150 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.642+0000 7f7b2b400700 1 -- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 msgr2=0x7f7b1003b940 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.642+0000 7f7b2b400700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 0x7f7b1003b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.722+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7b2c19fc30 con 0x7f7b2c108150 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.723+0000 7f7b28c00700 1 -- 172.21.15.164:0/3835593923 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7b1c02d3f0 con 0x7f7b2c108150 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 msgr2=0x7f7b1003b940 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 0x7f7b1003b940 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 msgr2=0x7f7b2c19c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c006af0 tx=0x7f7b1c011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 shutdown_connections 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7b10039480 0x7f7b1003b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 --2- 172.21.15.164:0/3835593923 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7b2c108150 0x7f7b2c19c180 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 >> 172.21.15.164:0/3835593923 conn(0x7f7b2c1036f0 msgr2=0x7f7b2c1042d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:11.438 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 shutdown_connections 2024-03-27T08:23:11.439 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:10.726+0000 7f7b32e00700 1 -- 172.21.15.164:0/3835593923 wait complete. 2024-03-27T08:23:11.439 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for the mgr to restart... 2024-03-27T08:23:11.439 INFO:teuthology.orchestra.run.smithi164.stdout:Waiting for mgr epoch 9... 2024-03-27T08:23:11.746 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:11.536+0000 7fc5a246e200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T08:23:12.987 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:12.827+0000 7fc5a246e200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T08:23:12.987 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:12.994+0000 7fc5a246e200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T08:23:13.754 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:13.409+0000 7fc5a246e200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T08:23:13.757 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:13.527+0000 7fc5a246e200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T08:23:14.254 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:13.785+0000 7fc5a246e200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:23:14.255 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:14.024+0000 7fc5a246e200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T08:23:14.706 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:14.395+0000 7fc5a246e200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:23:15.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:14.713+0000 7fc5a246e200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T08:23:15.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:15.014+0000 7fc5a246e200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T08:23:16.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:16.027+0000 7fc5a246e200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T08:23:17.004 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:16.721+0000 7fc5a246e200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T08:23:17.005 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:16.849+0000 7fc5a246e200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T08:23:17.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:23:17.131+0000 7fc5a246e200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T08:23:17.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: Active manager daemon x restarted 2024-03-27T08:23:17.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: Activating manager daemon x 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: osdmap e3: 0 total, 0 up, 0 in 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: mgrmap e10: x(active, starting, since 0.0100229s) 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-27T08:23:17.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:17 smithi164 ceph-mon[31788]: Manager daemon x is now available 2024-03-27T08:23:18.496 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:18.496 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-03-27T08:23:18.496 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-03-27T08:23:18.496 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:18 smithi164 ceph-mon[31788]: mgrmap e11: x(active, since 1.0159s) 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout { 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout "initialized": true 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout } 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.057+0000 7f801b000700 1 Processor -- start 2024-03-27T08:23:18.809 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.059+0000 7f801b000700 1 -- start start 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.060+0000 7f801b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.061+0000 7f8019c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.061+0000 7f8019c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56706/0 (socket says 172.21.15.164:56706) 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.061+0000 7f8019c00700 1 -- 172.21.15.164:0/797119128 learned_addr learned my addr 172.21.15.164:0/797119128 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.062+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8014073d00 con 0x7f8014073310 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.063+0000 7f8019c00700 1 -- 172.21.15.164:0/797119128 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8014073e80 con 0x7f8014073310 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.063+0000 7f8019c00700 1 --2- 172.21.15.164:0/797119128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8000007390 tx=0x7f80000076a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d231dad24812e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.064+0000 7f8013e00700 1 -- 172.21.15.164:0/797119128 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8000018070 con 0x7f8014073310 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.065+0000 7f8013e00700 1 -- 172.21.15.164:0/797119128 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8000004500 con 0x7f8014073310 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.065+0000 7f8013e00700 1 -- 172.21.15.164:0/797119128 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f80000036a0 con 0x7f8014073310 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.066+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 msgr2=0x7f8014073730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:18.810 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.066+0000 7f801b000700 1 --2- 172.21.15.164:0/797119128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8000007390 tx=0x7f80000076a0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.067+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 shutdown_connections 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.067+0000 7f801b000700 1 --2- 172.21.15.164:0/797119128 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f8014073730 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.067+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 >> 172.21.15.164:0/797119128 conn(0x7f801406e5e0 msgr2=0x7f8014070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.067+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 shutdown_connections 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.067+0000 7f801b000700 1 -- 172.21.15.164:0/797119128 wait complete. 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.068+0000 7f801b000700 1 Processor -- start 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.068+0000 7f801b000700 1 -- start start 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.069+0000 7f801b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.069+0000 7f801b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8014112910 con 0x7f8014073310 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.069+0000 7f8019c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.069+0000 7f8019c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56712/0 (socket says 172.21.15.164:56712) 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.069+0000 7f8019c00700 1 -- 172.21.15.164:0/671844540 learned_addr learned my addr 172.21.15.164:0/671844540 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:18.811 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f8019c00700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80141a2a60 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f8019c00700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8000006b20 tx=0x7f8000007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8000021020 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80141a2cf0 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80141a59e0 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8000008510 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.070+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8000018040 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.072+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 9) ==== 46479+0+0 (secure 0 0 0) 0x7f8000024020 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.072+0000 7f8012000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.072+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7ffc03c030 con 0x7f7ffc039460 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.073+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f8000010050 con 0x7f8014073310 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.073+0000 7f8019200700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:18.812 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.073+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.274+0000 7f8019200700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.274+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.675+0000 7f8019200700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:12.675+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:13.476+0000 7f8019200700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:13.476+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:15.078+0000 7f8019200700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.164:6800/3452126215 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:15.078+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:17.143+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mgrmap(e 10) ==== 46246+0+0 (secure 0 0 0) 0x7f800000cc60 con 0x7f8014073310 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:17.143+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 msgr2=0x7f7ffc03b920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:17.143+0000 7f8012000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.813 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.145+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mgrmap(e 11) ==== 46373+0+0 (secure 0 0 0) 0x7f8000008210 con 0x7f8014073310 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.145+0000 7f8012000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 0x7f7ffc03f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.145+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f800003b6a0 con 0x7f7ffc03cee0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.147+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 0x7f7ffc03f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.149+0000 7f8019200700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 0x7f7ffc03f2d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f800c003d90 tx=0x7f800c007310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.150+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== command_reply(tid 0: 0 ) ==== 8+0+7774 (secure 0 0 0) 0x7f800003b6a0 con 0x7f7ffc03cee0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.158+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f7ff4002600 con 0x7f7ffc03cee0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f8012000700 1 -- 172.21.15.164:0/671844540 <== mgr.14152 v2:172.21.15.164:6800/2033158356 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f7ff4002600 con 0x7f7ffc03cee0 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 msgr2=0x7f7ffc03f2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 0x7f7ffc03f2d0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f800c003d90 tx=0x7f800c007310 comp rx=0 tx=0).stop 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 msgr2=0x7f80141a2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:18.814 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8000006b20 tx=0x7f8000007ee0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 shutdown_connections 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7ffc03cee0 0x7f7ffc03f2d0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8014073310 0x7f80141a2520 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 --2- 172.21.15.164:0/671844540 >> [v2:172.21.15.164:6800/3452126215,v1:172.21.15.164:6801/3452126215] conn(0x7f7ffc039460 0x7f7ffc03b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.159+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 >> 172.21.15.164:0/671844540 conn(0x7f801406e5e0 msgr2=0x7f801406f0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.160+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 shutdown_connections 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:18.160+0000 7f801b000700 1 -- 172.21.15.164:0/671844540 wait complete. 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:mgr epoch 9 is available 2024-03-27T08:23:18.815 INFO:teuthology.orchestra.run.smithi164.stdout:Generating a dashboard self-signed certificate... 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: [27/Mar/2024:08:23:17] ENGINE Bus STARTING 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: [27/Mar/2024:08:23:17] ENGINE Serving on https://172.21.15.164:7150 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: [27/Mar/2024:08:23:17] ENGINE Serving on http://172.21.15.164:8765 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: [27/Mar/2024:08:23:17] ENGINE Bus STARTED 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-27T08:23:19.330 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:19 smithi164 ceph-mon[31788]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-27T08:23:20.449 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:20 smithi164 ceph-mon[31788]: mgrmap e12: x(active, since 2s) 2024-03-27T08:23:20.449 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.055+0000 7fe9c6800700 1 Processor -- start 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.055+0000 7fe9c6800700 1 -- start start 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.055+0000 7fe9c6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.055+0000 7fe9c6800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c0063960 con 0x7fe9c0108bb0 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.055+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.056+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54260/0 (socket says 172.21.15.164:54260) 2024-03-27T08:23:21.176 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.056+0000 7fe9bf400700 1 -- 172.21.15.164:0/3768331654 learned_addr learned my addr 172.21.15.164:0/3768331654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.056+0000 7fe9bf400700 1 -- 172.21.15.164:0/3768331654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c010b4e0 con 0x7fe9c0108bb0 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.056+0000 7fe9bf400700 1 --2- 172.21.15.164:0/3768331654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00098a0 tx=0x7fe9b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10409194bd2964bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.057+0000 7fe9be000700 1 -- 172.21.15.164:0/3768331654 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0004160 con 0x7fe9c0108bb0 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.057+0000 7fe9be000700 1 -- 172.21.15.164:0/3768331654 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe9b0004300 con 0x7fe9c0108bb0 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.057+0000 7fe9be000700 1 -- 172.21.15.164:0/3768331654 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0011b10 con 0x7fe9c0108bb0 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 -- 172.21.15.164:0/3768331654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 msgr2=0x7fe9c010afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 --2- 172.21.15.164:0/3768331654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe9b00098a0 tx=0x7fe9b0009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 -- 172.21.15.164:0/3768331654 shutdown_connections 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 --2- 172.21.15.164:0/3768331654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c010afa0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 -- 172.21.15.164:0/3768331654 >> 172.21.15.164:0/3768331654 conn(0x7fe9c0102620 msgr2=0x7fe9c0104a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 -- 172.21.15.164:0/3768331654 shutdown_connections 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.058+0000 7fe9c6800700 1 -- 172.21.15.164:0/3768331654 wait complete. 2024-03-27T08:23:21.177 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.059+0000 7fe9c6800700 1 Processor -- start 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.059+0000 7fe9c6800700 1 -- start start 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.059+0000 7fe9c6800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.059+0000 7fe9c6800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c010c550 con 0x7fe9c0108bb0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.060+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.060+0000 7fe9bf400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54272/0 (socket says 172.21.15.164:54272) 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.060+0000 7fe9bf400700 1 -- 172.21.15.164:0/529900026 learned_addr learned my addr 172.21.15.164:0/529900026 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.060+0000 7fe9bf400700 1 -- 172.21.15.164:0/529900026 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c019c630 con 0x7fe9c0108bb0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9bf400700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0011670 tx=0x7fe9b0011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0003930 con 0x7fe9c0108bb0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe9b0003ad0 con 0x7fe9c0108bb0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c019c8c0 con 0x7fe9c0108bb0 2024-03-27T08:23:21.178 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9b0019550 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.061+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c019f5b0 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.062+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c0063c70 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.062+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7fe9b001a430 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.063+0000 7fe9b7e00700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 0x7fe9a403b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.063+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe9b004d9d0 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.063+0000 7fe9bea00700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 0x7fe9a403b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.064+0000 7fe9bea00700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 0x7fe9a403b8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fd0 tx=0x7fe9ac006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.069+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe9b001a720 con 0x7fe9c0108bb0 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.314+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fe9c0103870 con 0x7fe9a4039430 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.435+0000 7fe9b7e00700 1 -- 172.21.15.164:0/529900026 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fe9c0103870 con 0x7fe9a4039430 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 msgr2=0x7fe9a403b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 0x7fe9a403b8f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac006fd0 tx=0x7fe9ac006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:21.179 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 msgr2=0x7fe9c019c0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe9b0011670 tx=0x7fe9b0011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 shutdown_connections 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9a4039430 0x7fe9a403b8f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 --2- 172.21.15.164:0/529900026 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe9c0108bb0 0x7fe9c019c0f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.438+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 >> 172.21.15.164:0/529900026 conn(0x7fe9c0102620 msgr2=0x7fe9c0103160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.439+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 shutdown_connections 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:20.439+0000 7fe9c6800700 1 -- 172.21.15.164:0/529900026 wait complete. 2024-03-27T08:23:21.180 INFO:teuthology.orchestra.run.smithi164.stdout:Creating initial admin user... 2024-03-27T08:23:21.678 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:21 smithi164 ceph-mon[31788]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:21.678 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:21.678 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:22.957 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$VES2it/cywwMyXLDKQf3FOAOL.tsHEk/RrkFbyQLss5IGciMTxftW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1711527802, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-27T08:23:22.957 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.756+0000 7f48d7c00700 1 Processor -- start 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.756+0000 7f48d7c00700 1 -- start start 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.756+0000 7f48d7c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.756+0000 7f48d7c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48d0106e90 con 0x7f48d01064a0 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.757+0000 7f48d5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.757+0000 7f48d5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54282/0 (socket says 172.21.15.164:54282) 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.757+0000 7f48d5200700 1 -- 172.21.15.164:0/2596282989 learned_addr learned my addr 172.21.15.164:0/2596282989 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:22.958 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.757+0000 7f48d5200700 1 -- 172.21.15.164:0/2596282989 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d0109430 con 0x7f48d01064a0 2024-03-27T08:23:22.963 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.758+0000 7f48d5200700 1 --2- 172.21.15.164:0/2596282989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48c40098a0 tx=0x7f48c4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17d81b327a659ec server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:22.963 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.758+0000 7f48cf400700 1 -- 172.21.15.164:0/2596282989 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c4004160 con 0x7f48d01064a0 2024-03-27T08:23:22.963 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.758+0000 7f48cf400700 1 -- 172.21.15.164:0/2596282989 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48c4004300 con 0x7f48d01064a0 2024-03-27T08:23:22.963 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.758+0000 7f48cf400700 1 -- 172.21.15.164:0/2596282989 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c4011b10 con 0x7f48d01064a0 2024-03-27T08:23:22.963 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 -- 172.21.15.164:0/2596282989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 msgr2=0x7f48d01068c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2596282989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f48c40098a0 tx=0x7f48c4009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 -- 172.21.15.164:0/2596282989 shutdown_connections 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2596282989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d01068c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 -- 172.21.15.164:0/2596282989 >> 172.21.15.164:0/2596282989 conn(0x7f48d0101e50 msgr2=0x7f48d0104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 -- 172.21.15.164:0/2596282989 shutdown_connections 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.759+0000 7f48d7c00700 1 -- 172.21.15.164:0/2596282989 wait complete. 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.760+0000 7f48d7c00700 1 Processor -- start 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.760+0000 7f48d7c00700 1 -- start start 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.760+0000 7f48d7c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d7c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48d010c7e0 con 0x7f48d01064a0 2024-03-27T08:23:22.964 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54284/0 (socket says 172.21.15.164:54284) 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d5200700 1 -- 172.21.15.164:0/2461044057 learned_addr learned my addr 172.21.15.164:0/2461044057 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d5200700 1 -- 172.21.15.164:0/2461044057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d019c6b0 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.761+0000 7f48d5200700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48c4006af0 tx=0x7f48c4011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.762+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c40038b0 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.762+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48c401a430 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.762+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48c4019530 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.762+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d019c940 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.762+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d019f630 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.763+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7f48c401a9e0 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.763+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d0063c70 con 0x7f48d01064a0 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.764+0000 7f48cd600700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 0x7f48b803b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:22.965 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.764+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f48c404d970 con 0x7f48d01064a0 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.764+0000 7f48cfe00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 0x7f48b803b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.765+0000 7f48cfe00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 0x7f48b803b8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:21.769+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f48c401a690 con 0x7f48d01064a0 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.015+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f48d019ce20 con 0x7f48b8039430 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.259+0000 7f48cd600700 1 -- 172.21.15.164:0/2461044057 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f48d019ce20 con 0x7f48b8039430 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.261+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 msgr2=0x7f48b803b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.261+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 0x7f48b803b8f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006fd0 tx=0x7f48bc006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.261+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 msgr2=0x7f48d019c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.261+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f48c4006af0 tx=0x7f48c4011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 shutdown_connections 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b8039430 0x7f48b803b8f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:22.966 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 --2- 172.21.15.164:0/2461044057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d01064a0 0x7f48d019c170 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:22.967 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 >> 172.21.15.164:0/2461044057 conn(0x7f48d0101e50 msgr2=0x7f48d01029c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:22.967 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 shutdown_connections 2024-03-27T08:23:22.967 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:22.262+0000 7f48d7c00700 1 -- 172.21.15.164:0/2461044057 wait complete. 2024-03-27T08:23:22.967 INFO:teuthology.orchestra.run.smithi164.stdout:Fetching dashboard port number... 2024-03-27T08:23:23.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:23 smithi164 ceph-mon[31788]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:23.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:23.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:24.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1324666602' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-27T08:23:24.892 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stdout 8443 2024-03-27T08:23:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.564+0000 7fbd56200700 1 Processor -- start 2024-03-27T08:23:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.564+0000 7fbd56200700 1 -- start start 2024-03-27T08:23:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.565+0000 7fbd56200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.565+0000 7fbd56200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501090b0 con 0x7fbd501086c0 2024-03-27T08:23:24.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.565+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.565+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54298/0 (socket says 172.21.15.164:54298) 2024-03-27T08:23:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.565+0000 7fbd4f400700 1 -- 172.21.15.164:0/3759090141 learned_addr learned my addr 172.21.15.164:0/3759090141 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.566+0000 7fbd4f400700 1 -- 172.21.15.164:0/3759090141 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd50109230 con 0x7fbd501086c0 2024-03-27T08:23:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.566+0000 7fbd4f400700 1 --2- 172.21.15.164:0/3759090141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd400098a0 tx=0x7fbd40009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feb574107afdaf5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:24.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.566+0000 7fbd4e000700 1 -- 172.21.15.164:0/3759090141 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40004160 con 0x7fbd501086c0 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.566+0000 7fbd4e000700 1 -- 172.21.15.164:0/3759090141 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd40004300 con 0x7fbd501086c0 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.566+0000 7fbd4e000700 1 -- 172.21.15.164:0/3759090141 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40011b10 con 0x7fbd501086c0 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 -- 172.21.15.164:0/3759090141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 msgr2=0x7fbd50108ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 --2- 172.21.15.164:0/3759090141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fbd400098a0 tx=0x7fbd40009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 -- 172.21.15.164:0/3759090141 shutdown_connections 2024-03-27T08:23:24.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 --2- 172.21.15.164:0/3759090141 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd50108ae0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 -- 172.21.15.164:0/3759090141 >> 172.21.15.164:0/3759090141 conn(0x7fbd50101e50 msgr2=0x7fbd50104270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 -- 172.21.15.164:0/3759090141 shutdown_connections 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.567+0000 7fbd56200700 1 -- 172.21.15.164:0/3759090141 wait complete. 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.568+0000 7fbd56200700 1 Processor -- start 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.568+0000 7fbd56200700 1 -- start start 2024-03-27T08:23:24.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd56200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:24.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd56200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd501070e0 con 0x7fbd501086c0 2024-03-27T08:23:24.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:24.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd4f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54312/0 (socket says 172.21.15.164:54312) 2024-03-27T08:23:24.897 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd4f400700 1 -- 172.21.15.164:0/1324666602 learned_addr learned my addr 172.21.15.164:0/1324666602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:24.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.569+0000 7fbd4f400700 1 -- 172.21.15.164:0/1324666602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd5019e840 con 0x7fbd501086c0 2024-03-27T08:23:24.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd4f400700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fb0 tx=0x7fbd40011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:24.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd40003b20 con 0x7fbd501086c0 2024-03-27T08:23:24.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd40003cc0 con 0x7fbd501086c0 2024-03-27T08:23:24.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd5019eb30 con 0x7fbd501086c0 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbd400247a0 con 0x7fbd501086c0 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.570+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd501a17c0 con 0x7fbd501086c0 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.572+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd50063c70 con 0x7fbd501086c0 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.572+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 12) ==== 46479+0+0 (secure 0 0 0) 0x7fbd40022020 con 0x7fbd501086c0 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.573+0000 7fbd47e00700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 0x7fbd3403b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:24.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.573+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fbd4004d830 con 0x7fbd501086c0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.573+0000 7fbd4ea00700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 0x7fbd3403b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.574+0000 7fbd4ea00700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 0x7fbd3403b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.578+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fbd4001acd0 con 0x7fbd501086c0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.790+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7fbd50197860 con 0x7fbd501086c0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.791+0000 7fbd47e00700 1 -- 172.21.15.164:0/1324666602 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7fbd50197860 con 0x7fbd501086c0 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 msgr2=0x7fbd3403b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:24.900 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 0x7fbd3403b8e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fbd3c006fd0 tx=0x7fbd3c006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 msgr2=0x7fbd5019e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009fb0 tx=0x7fbd40011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 shutdown_connections 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd34039420 0x7fbd3403b8e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 --2- 172.21.15.164:0/1324666602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd501086c0 0x7fbd5019e300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:24.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.794+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 >> 172.21.15.164:0/1324666602 conn(0x7fbd50101e50 msgr2=0x7fbd50194940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:24.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.795+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 shutdown_connections 2024-03-27T08:23:24.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:23.795+0000 7fbd56200700 1 -- 172.21.15.164:0/1324666602 wait complete. 2024-03-27T08:23:24.927 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-03-27T08:23:24.928 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout disabled 2024-03-27T08:23:24.955 INFO:teuthology.orchestra.run.smithi164.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-03-27T08:23:24.956 INFO:teuthology.orchestra.run.smithi164.stdout:systemctl: stdout inactive 2024-03-27T08:23:24.957 INFO:teuthology.orchestra.run.smithi164.stdout:firewalld.service is not enabled 2024-03-27T08:23:24.957 INFO:teuthology.orchestra.run.smithi164.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-27T08:23:24.964 INFO:teuthology.orchestra.run.smithi164.stdout:Ceph Dashboard is now available at: 2024-03-27T08:23:24.964 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:24.964 INFO:teuthology.orchestra.run.smithi164.stdout: URL: https://smithi164.front.sepia.ceph.com:8443/ 2024-03-27T08:23:24.964 INFO:teuthology.orchestra.run.smithi164.stdout: User: admin 2024-03-27T08:23:24.964 INFO:teuthology.orchestra.run.smithi164.stdout: Password: 9us7zjwtqa 2024-03-27T08:23:24.965 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:24.965 INFO:teuthology.orchestra.run.smithi164.stdout:Saving cluster configuration to /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config directory 2024-03-27T08:23:24.967 INFO:teuthology.orchestra.run.smithi164.stdout:Enabling autotune for osd_memory_target 2024-03-27T08:23:25.152 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:25 smithi164 ceph-mon[31788]: mgrmap e13: x(active, since 6s) 2024-03-27T08:23:26.893 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.964+0000 7ff2ae800700 1 Processor -- start 2024-03-27T08:23:26.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.964+0000 7ff2ae800700 1 -- start start 2024-03-27T08:23:26.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.964+0000 7ff2ae800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:26.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.964+0000 7ff2ae800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8111730 con 0x7ff2a810ed70 2024-03-27T08:23:26.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.965+0000 7ff2ad400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:26.894 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.965+0000 7ff2ad400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43866/0 (socket says 172.21.15.164:43866) 2024-03-27T08:23:26.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.965+0000 7ff2ad400700 1 -- 172.21.15.164:0/3434524033 learned_addr learned my addr 172.21.15.164:0/3434524033 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:26.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.965+0000 7ff2ad400700 1 -- 172.21.15.164:0/3434524033 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a81118b0 con 0x7ff2a810ed70 2024-03-27T08:23:26.895 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.965+0000 7ff2ad400700 1 --2- 172.21.15.164:0/3434524033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098a0 tx=0x7ff29c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a6b0def6b15ffab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.966+0000 7ff2a7e00700 1 -- 172.21.15.164:0/3434524033 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff29c004160 con 0x7ff2a810ed70 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.966+0000 7ff2a7e00700 1 -- 172.21.15.164:0/3434524033 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff29c004300 con 0x7ff2a810ed70 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.966+0000 7ff2a7e00700 1 -- 172.21.15.164:0/3434524033 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff29c011b10 con 0x7ff2a810ed70 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.966+0000 7ff2ae800700 1 -- 172.21.15.164:0/3434524033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 msgr2=0x7ff2a8111160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.966+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3434524033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff29c0098a0 tx=0x7ff29c009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:26.896 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.967+0000 7ff2ae800700 1 -- 172.21.15.164:0/3434524033 shutdown_connections 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.967+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3434524033 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a8111160 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.967+0000 7ff2ae800700 1 -- 172.21.15.164:0/3434524033 >> 172.21.15.164:0/3434524033 conn(0x7ff2a807d530 msgr2=0x7ff2a807f950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.967+0000 7ff2ae800700 1 -- 172.21.15.164:0/3434524033 shutdown_connections 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.967+0000 7ff2ae800700 1 -- 172.21.15.164:0/3434524033 wait complete. 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.968+0000 7ff2ae800700 1 Processor -- start 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.968+0000 7ff2ae800700 1 -- start start 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.968+0000 7ff2ae800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.968+0000 7ff2ae800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a8112970 con 0x7ff2a810ed70 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.969+0000 7ff2ad400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:26.898 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.969+0000 7ff2ad400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43882/0 (socket says 172.21.15.164:43882) 2024-03-27T08:23:26.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.969+0000 7ff2ad400700 1 -- 172.21.15.164:0/3166005225 learned_addr learned my addr 172.21.15.164:0/3166005225 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:26.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.969+0000 7ff2ad400700 1 -- 172.21.15.164:0/3166005225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a81a2ac0 con 0x7ff2a810ed70 2024-03-27T08:23:26.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.969+0000 7ff2ad400700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff29c003fa0 tx=0x7ff29c0046a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:26.899 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.970+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff29c0038b0 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.970+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff29c01a430 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.970+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a81a2d50 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.970+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff29c019550 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.970+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a81a5a40 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.971+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7ff29c01a9c0 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.971+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2a8063c70 con 0x7ff2a810ed70 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.971+0000 7ff2a6000700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 0x7ff29003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:26.901 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.971+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff29c04da70 con 0x7ff2a810ed70 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.972+0000 7ff2aca00700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 0x7ff29003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.972+0000 7ff2aca00700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 0x7ff29003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff294006fd0 tx=0x7ff294006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:25.977+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff29c01a690 con 0x7ff2a810ed70 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.199+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7ff2a81a6060 con 0x7ff2a810ed70 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.200+0000 7ff2a6000700 1 -- 172.21.15.164:0/3166005225 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7ff29c00fda0 con 0x7ff2a810ed70 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 msgr2=0x7ff29003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 0x7ff29003b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7ff294006fd0 tx=0x7ff294006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 msgr2=0x7ff2a81a2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff29c003fa0 tx=0x7ff29c0046a0 comp rx=0 tx=0).stop 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 shutdown_connections 2024-03-27T08:23:26.902 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff2900394d0 0x7ff29003b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:26.903 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 --2- 172.21.15.164:0/3166005225 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff2a810ed70 0x7ff2a81a2580 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:26.903 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 >> 172.21.15.164:0/3166005225 conn(0x7ff2a807d530 msgr2=0x7ff2a807e0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:26.903 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 shutdown_connections 2024-03-27T08:23:26.903 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:26.203+0000 7ff2ae800700 1 -- 172.21.15.164:0/3166005225 wait complete. 2024-03-27T08:23:28.445 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.484+0000 7fe2eba00700 1 Processor -- start 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.485+0000 7fe2eba00700 1 -- start start 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.485+0000 7fe2eba00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.485+0000 7fe2eba00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4111900 con 0x7fe2e410ef40 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.486+0000 7fe2e9000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.486+0000 7fe2e9000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43896/0 (socket says 172.21.15.164:43896) 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.486+0000 7fe2e9000700 1 -- 172.21.15.164:0/1766006553 learned_addr learned my addr 172.21.15.164:0/1766006553 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.486+0000 7fe2e9000700 1 -- 172.21.15.164:0/1766006553 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e4111a80 con 0x7fe2e410ef40 2024-03-27T08:23:28.446 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.486+0000 7fe2e9000700 1 --2- 172.21.15.164:0/1766006553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40098a0 tx=0x7fe2d4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e688a9d2126b4b4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.487+0000 7fe2e3e00700 1 -- 172.21.15.164:0/1766006553 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4004160 con 0x7fe2e410ef40 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.487+0000 7fe2e3e00700 1 -- 172.21.15.164:0/1766006553 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2d4004300 con 0x7fe2e410ef40 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.487+0000 7fe2e3e00700 1 -- 172.21.15.164:0/1766006553 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4011b10 con 0x7fe2e410ef40 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.487+0000 7fe2eba00700 1 -- 172.21.15.164:0/1766006553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 msgr2=0x7fe2e4111330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.487+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1766006553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2d40098a0 tx=0x7fe2d4009bb0 comp rx=0 tx=0).stop 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.488+0000 7fe2eba00700 1 -- 172.21.15.164:0/1766006553 shutdown_connections 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.488+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1766006553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e4111330 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:28.452 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.488+0000 7fe2eba00700 1 -- 172.21.15.164:0/1766006553 >> 172.21.15.164:0/1766006553 conn(0x7fe2e407d710 msgr2=0x7fe2e407fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.488+0000 7fe2eba00700 1 -- 172.21.15.164:0/1766006553 shutdown_connections 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.488+0000 7fe2eba00700 1 -- 172.21.15.164:0/1766006553 wait complete. 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.489+0000 7fe2eba00700 1 Processor -- start 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.489+0000 7fe2eba00700 1 -- start start 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.489+0000 7fe2eba00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.489+0000 7fe2eba00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2e4112b40 con 0x7fe2e410ef40 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.489+0000 7fe2e9000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.490+0000 7fe2e9000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43904/0 (socket says 172.21.15.164:43904) 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.490+0000 7fe2e9000700 1 -- 172.21.15.164:0/1359696451 learned_addr learned my addr 172.21.15.164:0/1359696451 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.490+0000 7fe2e9000700 1 -- 172.21.15.164:0/1359696451 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2e41a2bb0 con 0x7fe2e410ef40 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.490+0000 7fe2e9000700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fb0 tx=0x7fe2d4011bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:28.453 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.491+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4003b20 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.491+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2d4003cc0 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.491+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2e41a2e40 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.491+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe2d4024830 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.491+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2e41a5b30 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.492+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2e4063c70 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.492+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fe2d4022020 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.492+0000 7fe2e2000700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 0x7fe2c803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.492+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fe2d404d730 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.493+0000 7fe2dbe00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 0x7fe2c803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.493+0000 7fe2dbe00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 0x7fe2c803b9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.498+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe2d4010380 con 0x7fe2e410ef40 2024-03-27T08:23:28.454 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.837+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fe2e41a5d00 con 0x7fe2e410ef40 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.841+0000 7fe2e2000700 1 -- 172.21.15.164:0/1359696451 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fe2d402a2a0 con 0x7fe2e410ef40 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 msgr2=0x7fe2c803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 0x7fe2c803b9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc006fd0 tx=0x7fe2cc006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 msgr2=0x7fe2e41a2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fe2d4009fb0 tx=0x7fe2d4011bd0 comp rx=0 tx=0).stop 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 shutdown_connections 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2c8039520 0x7fe2c803b9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 --2- 172.21.15.164:0/1359696451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2e410ef40 0x7fe2e41a2670 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 >> 172.21.15.164:0/1359696451 conn(0x7fe2e407d710 msgr2=0x7fe2e407e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 shutdown_connections 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr 2024-03-27T08:23:27.844+0000 7fe2eba00700 1 -- 172.21.15.164:0/1359696451 wait complete. 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-27T08:23:28.455 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout:Or, if you are only running a single cluster on this host: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout:Please consider enabling telemetry to help improve Ceph: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: ceph telemetry on 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout:For more information see: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:28.456 INFO:teuthology.orchestra.run.smithi164.stdout:Bootstrap complete. 2024-03-27T08:23:28.574 INFO:tasks.cephadm:Fetching config... 2024-03-27T08:23:28.574 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:23:28.574 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-27T08:23:28.624 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-27T08:23:28.624 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:23:28.624 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-27T08:23:28.708 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-27T08:23:28.708 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:23:28.708 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/keyring of=/dev/stdout 2024-03-27T08:23:28.836 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-27T08:23:28.836 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:23:28.836 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-27T08:23:28.937 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-27T08:23:28.938 DEBUG:teuthology.orchestra.run.smithi164:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T08:23:29.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:28 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1359696451' entity='client.admin' 2024-03-27T08:23:29.051 INFO:teuthology.orchestra.run.smithi164.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:23:29.109 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T08:23:29.246 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:23:29.317 DEBUG:teuthology.orchestra.run.smithi173:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-27T08:23:29.451 INFO:teuthology.orchestra.run.smithi173.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDT07pGlc6x/3NodJFmBAb7USZ5mrudnkbOcXzITmJgagYLolRvr6lRtBC0I2aPqLApLv+nKNYlHI8kA3Thz0Yz/ZSQJQI7NgI1MOWfmVKF/BIz/8Zs8lHkonmle2j24+cZVKOdaKbToqDByrFSygCxP8LiTxA4/vmEBTpvQUxftpL3ekrl+tA0APvvOXRgQ5zatbIYNj9dUGgkr6B6FGeqOrRG9mj3+lX7kk1YO82J9VrBnZ6c07Ro+VAKsJobKPjQT9IHOYpFL0cGR+uXFBS7qBQJxK549XGQNnO+EA8JD+6Mc4mbAoVoMmS5phg62tO5uV0VzWjlYzSwJG1sc92XDZZxKiuT8ktGUu8ZyZzHpfvUQl0/LVPKIxOH81D2jJtpmNxV+jCvEdCX82wxCbYbrUIMeMsKJ6xpFJtIgCb618jy04Y0iMRulsXgsNjGcBHhK0oPKVT4zbHJn3s8txj2sPrYYmfVYSicFKPAQdpsgF2nJL56XMCzJcwbUZ1tlW8= ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:23:29.513 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-27T08:23:29.932 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:23:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi164", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:23:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 -- 172.21.15.164:0/1172802699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 msgr2=0x7fa284074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 --2- 172.21.15.164:0/1172802699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284074ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa278009910 tx=0x7fa278009c20 comp rx=0 tx=0).stop 2024-03-27T08:23:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 -- 172.21.15.164:0/1172802699 shutdown_connections 2024-03-27T08:23:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 --2- 172.21.15.164:0/1172802699 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284074ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:32.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 -- 172.21.15.164:0/1172802699 >> 172.21.15.164:0/1172802699 conn(0x7fa2840fd600 msgr2=0x7fa2840ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 -- 172.21.15.164:0/1172802699 shutdown_connections 2024-03-27T08:23:32.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.968+0000 7fa28b600700 1 -- 172.21.15.164:0/1172802699 wait complete. 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.969+0000 7fa28b600700 1 Processor -- start 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa28b600700 1 -- start start 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa28b600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa28b600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa28410a2e0 con 0x7fa284076670 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa288c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa288c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43930/0 (socket says 172.21.15.164:43930) 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.970+0000 7fa288c00700 1 -- 172.21.15.164:0/3732088070 learned_addr learned my addr 172.21.15.164:0/3732088070 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa288c00700 1 -- 172.21.15.164:0/3732088070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa284199ed0 con 0x7fa284076670 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa288c00700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa278005950 tx=0x7fa278009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:32.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa278027070 con 0x7fa284076670 2024-03-27T08:23:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa27800be30 con 0x7fa284076670 2024-03-27T08:23:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa27800f460 con 0x7fa284076670 2024-03-27T08:23:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.971+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa28419a160 con 0x7fa284076670 2024-03-27T08:23:32.965 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.972+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa28419ce50 con 0x7fa284076670 2024-03-27T08:23:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.973+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fa27802a070 con 0x7fa284076670 2024-03-27T08:23:32.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.973+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa28410aa60 con 0x7fa284076670 2024-03-27T08:23:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.973+0000 7fa281600700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 0x7fa26c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.973+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa27801e030 con 0x7fa284076670 2024-03-27T08:23:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.974+0000 7fa283e00700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 0x7fa26c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:32.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.974+0000 7fa283e00700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 0x7fa26c03b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa270006fd0 tx=0x7fa270006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:32.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:32.979+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa278013070 con 0x7fa284076670 2024-03-27T08:23:33.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.206+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7fa28402de40 con 0x7fa284076670 2024-03-27T08:23:33.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.210+0000 7fa281600700 1 -- 172.21.15.164:0/3732088070 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7fa2780292c0 con 0x7fa284076670 2024-03-27T08:23:33.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 msgr2=0x7fa26c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:33.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 0x7fa26c03b990 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa270006fd0 tx=0x7fa270006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:33.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 msgr2=0x7fa284199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fa278005950 tx=0x7fa278009f10 comp rx=0 tx=0).stop 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 shutdown_connections 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa26c0394d0 0x7fa26c03b990 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 --2- 172.21.15.164:0/3732088070 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa284076670 0x7fa284199990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 >> 172.21.15.164:0/3732088070 conn(0x7fa2840fd600 msgr2=0x7fa2840fe0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:33.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 shutdown_connections 2024-03-27T08:23:33.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:33.214+0000 7fa28b600700 1 -- 172.21.15.164:0/3732088070 wait complete. 2024-03-27T08:23:33.933 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-27T08:23:33.934 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-27T08:23:34.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:34 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3732088070' entity='client.admin' 2024-03-27T08:23:34.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:34.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:34.712 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:23:36.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 -- 172.21.15.164:0/1117852816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 msgr2=0x7f5c54074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 --2- 172.21.15.164:0/1117852816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54074ad0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5c4400b0a0 tx=0x7f5c4400b3b0 comp rx=0 tx=0).stop 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 -- 172.21.15.164:0/1117852816 shutdown_connections 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 --2- 172.21.15.164:0/1117852816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54074ad0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 -- 172.21.15.164:0/1117852816 >> 172.21.15.164:0/1117852816 conn(0x7f5c540fd630 msgr2=0x7f5c540ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 -- 172.21.15.164:0/1117852816 shutdown_connections 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.657+0000 7f5c5b200700 1 -- 172.21.15.164:0/1117852816 wait complete. 2024-03-27T08:23:36.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.659+0000 7f5c5b200700 1 Processor -- start 2024-03-27T08:23:36.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.659+0000 7f5c5b200700 1 -- start start 2024-03-27T08:23:36.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.659+0000 7f5c5b200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:36.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.659+0000 7f5c5b200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5410a2f0 con 0x7f5c54076670 2024-03-27T08:23:36.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c53e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:36.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c53e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48582/0 (socket says 172.21.15.164:48582) 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c53e00700 1 -- 172.21.15.164:0/954985713 learned_addr learned my addr 172.21.15.164:0/954985713 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c53e00700 1 -- 172.21.15.164:0/954985713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c54199f40 con 0x7f5c54076670 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c53e00700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c44015040 tx=0x7f5c4400bd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c44017050 con 0x7f5c54076670 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5c44018040 con 0x7f5c54076670 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c5419a1d0 con 0x7f5c54076670 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.660+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c4401c5d0 con 0x7f5c54076670 2024-03-27T08:23:36.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.661+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c5419ce70 con 0x7f5c54076670 2024-03-27T08:23:36.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.662+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f5c44004040 con 0x7f5c54076670 2024-03-27T08:23:36.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.662+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c5410aa70 con 0x7f5c54076670 2024-03-27T08:23:36.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.662+0000 7f5c51600700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 0x7f5c3803b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:36.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.662+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5c4400f050 con 0x7f5c54076670 2024-03-27T08:23:36.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.663+0000 7f5c4b400700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 0x7f5c3803b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:36.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.663+0000 7f5c4b400700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 0x7f5c3803b980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:36.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.668+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5c4401d3b0 con 0x7f5c54076670 2024-03-27T08:23:36.886 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.893+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f5c5402de40 con 0x7f5c380394c0 2024-03-27T08:23:36.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.901+0000 7f5c51600700 1 -- 172.21.15.164:0/954985713 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5c5402de40 con 0x7f5c380394c0 2024-03-27T08:23:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.903+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 msgr2=0x7f5c3803b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 0x7f5c3803b980 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c006fd0 tx=0x7f5c3c006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 msgr2=0x7f5c54199a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:36.897 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5c44015040 tx=0x7f5c4400bd20 comp rx=0 tx=0).stop 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 shutdown_connections 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5c380394c0 0x7f5c3803b980 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 --2- 172.21.15.164:0/954985713 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5c54076670 0x7f5c54199a00 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 >> 172.21.15.164:0/954985713 conn(0x7f5c540fd630 msgr2=0x7f5c540fe130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 shutdown_connections 2024-03-27T08:23:36.898 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:36.904+0000 7f5c5b200700 1 -- 172.21.15.164:0/954985713 wait complete. 2024-03-27T08:23:37.749 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-03-27T08:23:37.749 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:23:37.749 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-03-27T08:23:37.805 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:23:37.805 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:23:37.900 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-03-27T08:23:37.900 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch host add smithi167 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: Updating smithi164:/etc/ceph/ceph.conf 2024-03-27T08:23:37.972 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:37 smithi164 ceph-mon[31788]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:38.320 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:23:39.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:38 smithi164 ceph-mon[31788]: Updating smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:23:39.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:38 smithi164 ceph-mon[31788]: Updating smithi164:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 -- 172.21.15.164:0/159735870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 msgr2=0x7fa87c074d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 --2- 172.21.15.164:0/159735870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c074d40 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fa86c009910 tx=0x7fa86c009c20 comp rx=0 tx=0).stop 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 -- 172.21.15.164:0/159735870 shutdown_connections 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 --2- 172.21.15.164:0/159735870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c074d40 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 -- 172.21.15.164:0/159735870 >> 172.21.15.164:0/159735870 conn(0x7fa87c0fdb20 msgr2=0x7fa87c0fff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 -- 172.21.15.164:0/159735870 shutdown_connections 2024-03-27T08:23:40.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.427+0000 7fa881e00700 1 -- 172.21.15.164:0/159735870 wait complete. 2024-03-27T08:23:40.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.428+0000 7fa881e00700 1 Processor -- start 2024-03-27T08:23:40.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.428+0000 7fa881e00700 1 -- start start 2024-03-27T08:23:40.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.428+0000 7fa881e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.428+0000 7fa881e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa87c10e8a0 con 0x7fa87c074960 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.429+0000 7fa87aa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.429+0000 7fa87aa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48608/0 (socket says 172.21.15.164:48608) 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.429+0000 7fa87aa00700 1 -- 172.21.15.164:0/1491609415 learned_addr learned my addr 172.21.15.164:0/1491609415 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.429+0000 7fa87aa00700 1 -- 172.21.15.164:0/1491609415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87c19a2e0 con 0x7fa87c074960 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.429+0000 7fa87aa00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.430+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c026070 con 0x7fa87c074960 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.430+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa86c00bc20 con 0x7fa87c074960 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.430+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa86c003a50 con 0x7fa87c074960 2024-03-27T08:23:40.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.430+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87c19a570 con 0x7fa87c074960 2024-03-27T08:23:40.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.430+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87c19a9d0 con 0x7fa87c074960 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.431+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fa86c029070 con 0x7fa87c074960 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.431+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa87c0760a0 con 0x7fa87c074960 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.432+0000 7fa880a00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 0x7fa86003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.432+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa86c01e070 con 0x7fa87c074960 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.432+0000 7fa87a000700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 0x7fa86003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:40.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.433+0000 7fa87a000700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 0x7fa86003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:40.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.437+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa86c013070 con 0x7fa87c074960 2024-03-27T08:23:40.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:40 smithi164 ceph-mon[31788]: Updating smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:23:40.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:40 smithi164 ceph-mon[31788]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:40.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:40.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:40.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:40.662 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:40.668+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) -- 0x7fa87c19b170 con 0x7fa8600394d0 2024-03-27T08:23:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:42 smithi164 ceph-mon[31788]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:42 smithi164 ceph-mon[31788]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:43.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:43 smithi164 ceph-mon[31788]: Deploying cephadm binary to smithi167 2024-03-27T08:23:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:44 smithi164 ceph-mon[31788]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:46.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:46 smithi164 ceph-mon[31788]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:46.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.004+0000 7fa880a00700 1 -- 172.21.15.164:0/1491609415 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fa87c19b170 con 0x7fa8600394d0 2024-03-27T08:23:46.997 INFO:teuthology.orchestra.run.smithi164.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 msgr2=0x7fa86003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 0x7fa86003b990 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa868006fd0 tx=0x7fa868006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 msgr2=0x7fa87c199da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa86c006010 tx=0x7fa86c005810 comp rx=0 tx=0).stop 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 shutdown_connections 2024-03-27T08:23:47.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa8600394d0 0x7fa86003b990 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 --2- 172.21.15.164:0/1491609415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa87c074960 0x7fa87c199da0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.008+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 >> 172.21.15.164:0/1491609415 conn(0x7fa87c0fdb20 msgr2=0x7fa87c106330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.009+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 shutdown_connections 2024-03-27T08:23:47.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:47.009+0000 7fa881e00700 1 -- 172.21.15.164:0/1491609415 wait complete. 2024-03-27T08:23:47.786 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-27T08:23:48.225 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:23:48.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:48 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:48 smithi164 ceph-mon[31788]: Added host smithi167 2024-03-27T08:23:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:48 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:23:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:48 smithi164 ceph-mon[31788]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:48 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:50.078 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:50.079 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:49 smithi164 ceph-mon[31788]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:50.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 -- 172.21.15.164:0/2318057895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 msgr2=0x7f41841035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:50.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 --2- 172.21.15.164:0/2318057895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f41841035e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f4174009910 tx=0x7f4174009c20 comp rx=0 tx=0).stop 2024-03-27T08:23:50.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 -- 172.21.15.164:0/2318057895 shutdown_connections 2024-03-27T08:23:50.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 --2- 172.21.15.164:0/2318057895 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f41841035e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:50.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 -- 172.21.15.164:0/2318057895 >> 172.21.15.164:0/2318057895 conn(0x7f4184077ce0 msgr2=0x7f41840ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:50.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 -- 172.21.15.164:0/2318057895 shutdown_connections 2024-03-27T08:23:50.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.252+0000 7f4189400700 1 -- 172.21.15.164:0/2318057895 wait complete. 2024-03-27T08:23:50.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.254+0000 7f4189400700 1 Processor -- start 2024-03-27T08:23:50.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.254+0000 7f4189400700 1 -- start start 2024-03-27T08:23:50.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4189400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:50.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4189400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f418410c690 con 0x7f4184103200 2024-03-27T08:23:50.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4182800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:50.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4182800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47492/0 (socket says 172.21.15.164:47492) 2024-03-27T08:23:50.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4182800700 1 -- 172.21.15.164:0/610176712 learned_addr learned my addr 172.21.15.164:0/610176712 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.255+0000 7f4182800700 1 -- 172.21.15.164:0/610176712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f418419dda0 con 0x7f4184103200 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f4182800700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4174006010 tx=0x7f4174005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4174026070 con 0x7f4184103200 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f417400bc20 con 0x7f4184103200 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f418419e030 con 0x7f4184103200 2024-03-27T08:23:50.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4174003a50 con 0x7f4184103200 2024-03-27T08:23:50.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.256+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4184197a20 con 0x7f4184103200 2024-03-27T08:23:50.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.257+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418406a2d0 con 0x7f4184103200 2024-03-27T08:23:50.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.257+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f4174029070 con 0x7f4184103200 2024-03-27T08:23:50.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.258+0000 7f417be00700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 0x7f416803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:50.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.258+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f417401e070 con 0x7f4184103200 2024-03-27T08:23:50.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.258+0000 7f4179e00700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 0x7f416803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:50.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.258+0000 7f4179e00700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 0x7f416803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f416c006fd0 tx=0x7f416c006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:50.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.263+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4174013070 con 0x7f4184103200 2024-03-27T08:23:50.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.494+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4184198f50 con 0x7f41680394d0 2024-03-27T08:23:50.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.496+0000 7f417be00700 1 -- 172.21.15.164:0/610176712 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f4184198f50 con 0x7f41680394d0 2024-03-27T08:23:50.489 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:23:50.489 INFO:teuthology.orchestra.run.smithi164.stdout:[{"addr": "172.21.15.164", "hostname": "smithi164", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-03-27T08:23:50.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 msgr2=0x7f416803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:50.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 0x7f416803b990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f416c006fd0 tx=0x7f416c006e40 comp rx=0 tx=0).stop 2024-03-27T08:23:50.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 msgr2=0x7f418419d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4174006010 tx=0x7f4174005810 comp rx=0 tx=0).stop 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 shutdown_connections 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41680394d0 0x7f416803b990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 --2- 172.21.15.164:0/610176712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4184103200 0x7f418419d860 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 >> 172.21.15.164:0/610176712 conn(0x7f4184077ce0 msgr2=0x7f4184103f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 shutdown_connections 2024-03-27T08:23:50.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:50.499+0000 7f4189400700 1 -- 172.21.15.164:0/610176712 wait complete. 2024-03-27T08:23:51.218 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi173 2024-03-27T08:23:51.218 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:23:51.218 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.conf 2024-03-27T08:23:51.274 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:23:51.274 DEBUG:teuthology.orchestra.run.smithi173:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:23:51.369 INFO:tasks.cephadm:Adding host smithi173 to orchestrator... 2024-03-27T08:23:51.370 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch host add smithi173 2024-03-27T08:23:51.799 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:23:52.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:51 smithi164 ceph-mon[31788]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:23:52.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:52.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:51 smithi164 ceph-mon[31788]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.773+0000 7f243b000700 1 -- 172.21.15.164:0/444228202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 msgr2=0x7f2434102640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.773+0000 7f243b000700 1 --2- 172.21.15.164:0/444228202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434102640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f2424009910 tx=0x7f2424009c20 comp rx=0 tx=0).stop 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.774+0000 7f243b000700 1 -- 172.21.15.164:0/444228202 shutdown_connections 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.774+0000 7f243b000700 1 --2- 172.21.15.164:0/444228202 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434102640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.774+0000 7f243b000700 1 -- 172.21.15.164:0/444228202 >> 172.21.15.164:0/444228202 conn(0x7f24340fdb10 msgr2=0x7f24340fff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.774+0000 7f243b000700 1 -- 172.21.15.164:0/444228202 shutdown_connections 2024-03-27T08:23:53.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.774+0000 7f243b000700 1 -- 172.21.15.164:0/444228202 wait complete. 2024-03-27T08:23:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.775+0000 7f243b000700 1 Processor -- start 2024-03-27T08:23:53.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.775+0000 7f243b000700 1 -- start start 2024-03-27T08:23:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.776+0000 7f243b000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.776+0000 7f243b000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f243410c620 con 0x7f2434102260 2024-03-27T08:23:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.776+0000 7f2433e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.776+0000 7f2433e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47508/0 (socket says 172.21.15.164:47508) 2024-03-27T08:23:53.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.776+0000 7f2433e00700 1 -- 172.21.15.164:0/4031817051 learned_addr learned my addr 172.21.15.164:0/4031817051 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f2433e00700 1 -- 172.21.15.164:0/4031817051 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2434076790 con 0x7f2434102260 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f2433e00700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2424006010 tx=0x7f2424005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2424026070 con 0x7f2434102260 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f242400bbc0 con 0x7f2434102260 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2434074e80 con 0x7f2434102260 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.777+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f24240038a0 con 0x7f2434102260 2024-03-27T08:23:53.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.778+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2434075340 con 0x7f2434102260 2024-03-27T08:23:53.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.779+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f2424029070 con 0x7f2434102260 2024-03-27T08:23:53.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.779+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2434103740 con 0x7f2434102260 2024-03-27T08:23:53.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.780+0000 7f2430c00700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 0x7f241803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:23:53.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.780+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f242401e070 con 0x7f2434102260 2024-03-27T08:23:53.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.780+0000 7f2433400700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 0x7f241803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:23:53.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.781+0000 7f2433400700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 0x7f241803b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:23:53.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:53.785+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2424013070 con 0x7f2434102260 2024-03-27T08:23:54.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:23:54.017+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}) -- 0x7f2434075e20 con 0x7f24180394d0 2024-03-27T08:23:54.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:54 smithi164 ceph-mon[31788]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:55.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:55 smithi164 ceph-mon[31788]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: Deploying cephadm binary to smithi173 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:23:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:23:57.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:57 smithi164 ceph-mon[31788]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:23:58.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:23:58 smithi164 ceph-mon[31788]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:00.460 INFO:teuthology.orchestra.run.smithi164.stdout:Added host 'smithi173' with addr '172.21.15.173' 2024-03-27T08:24:00.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.467+0000 7f2430c00700 1 -- 172.21.15.164:0/4031817051 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2434075e20 con 0x7f24180394d0 2024-03-27T08:24:00.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 msgr2=0x7f241803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 0x7f241803b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2420006fd0 tx=0x7f2420006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 msgr2=0x7f2434074940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2424006010 tx=0x7f2424005810 comp rx=0 tx=0).stop 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 shutdown_connections 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24180394d0 0x7f241803b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:00.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 --2- 172.21.15.164:0/4031817051 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2434102260 0x7f2434074940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.471+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 >> 172.21.15.164:0/4031817051 conn(0x7f24340fdb10 msgr2=0x7f2434103c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.472+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 shutdown_connections 2024-03-27T08:24:00.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:00.472+0000 7f243b000700 1 -- 172.21.15.164:0/4031817051 wait complete. 2024-03-27T08:24:00.485 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:00 smithi164 ceph-mon[31788]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:00.485 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:00 smithi164 ceph-mon[31788]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:01.210 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch host ls --format=json 2024-03-27T08:24:01.634 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:24:01.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:01 smithi164 ceph-mon[31788]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:01.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: Added host smithi173 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:02.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:03.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 -- 172.21.15.164:0/1903444329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 msgr2=0x7fc2b41035e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 --2- 172.21.15.164:0/1903444329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b41035e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8009910 tx=0x7fc2a8009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 -- 172.21.15.164:0/1903444329 shutdown_connections 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 --2- 172.21.15.164:0/1903444329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b41035e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 -- 172.21.15.164:0/1903444329 >> 172.21.15.164:0/1903444329 conn(0x7fc2b4077ce0 msgr2=0x7fc2b40ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 -- 172.21.15.164:0/1903444329 shutdown_connections 2024-03-27T08:24:03.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.679+0000 7fc2bc800700 1 -- 172.21.15.164:0/1903444329 wait complete. 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.680+0000 7fc2bc800700 1 Processor -- start 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.680+0000 7fc2bc800700 1 -- start start 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.681+0000 7fc2bc800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.681+0000 7fc2bc800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc2b410c690 con 0x7fc2b4103200 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.681+0000 7fc2b9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:03.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.681+0000 7fc2b9e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:38230/0 (socket says 172.21.15.164:38230) 2024-03-27T08:24:03.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.681+0000 7fc2b9e00700 1 -- 172.21.15.164:0/4114319519 learned_addr learned my addr 172.21.15.164:0/4114319519 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:24:03.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2b9e00700 1 -- 172.21.15.164:0/4114319519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2b419a330 con 0x7fc2b4103200 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2b9e00700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8006010 tx=0x7fc2a8005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a8026070 con 0x7fc2b4103200 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2a800bc20 con 0x7fc2b4103200 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2a8003a50 con 0x7fc2b4103200 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2b419a5c0 con 0x7fc2b4103200 2024-03-27T08:24:03.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.682+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2b419aa20 con 0x7fc2b4103200 2024-03-27T08:24:03.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.684+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fc2a8029070 con 0x7fc2b4103200 2024-03-27T08:24:03.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.684+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2b406a2d0 con 0x7fc2b4103200 2024-03-27T08:24:03.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.684+0000 7fc2aea00700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 0x7fc29c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:03.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.684+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc2a801e070 con 0x7fc2b4103200 2024-03-27T08:24:03.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.684+0000 7fc2b9400700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 0x7fc29c03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:03.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.685+0000 7fc2b9400700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 0x7fc29c03b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006fd0 tx=0x7fc2a4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:03.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.690+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc2a8013070 con 0x7fc2b4103200 2024-03-27T08:24:03.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.920+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc2b419b150 con 0x7fc29c0394d0 2024-03-27T08:24:03.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.923+0000 7fc2aea00700 1 -- 172.21.15.164:0/4114319519 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7fc2b419b150 con 0x7fc29c0394d0 2024-03-27T08:24:03.915 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:24:03.915 INFO:teuthology.orchestra.run.smithi164.stdout:[{"addr": "172.21.15.164", "hostname": "smithi164", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}, {"addr": "172.21.15.173", "hostname": "smithi173", "labels": [], "status": ""}] 2024-03-27T08:24:03.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 msgr2=0x7fc29c03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 0x7fc29c03b990 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fc2a4006fd0 tx=0x7fc2a4006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 msgr2=0x7fc2b4199df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fc2a8006010 tx=0x7fc2a8005810 comp rx=0 tx=0).stop 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 shutdown_connections 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc29c0394d0 0x7fc29c03b990 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 --2- 172.21.15.164:0/4114319519 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2b4103200 0x7fc2b4199df0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 >> 172.21.15.164:0/4114319519 conn(0x7fc2b4077ce0 msgr2=0x7fc2b41083a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 shutdown_connections 2024-03-27T08:24:03.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:03.926+0000 7fc2bc800700 1 -- 172.21.15.164:0/4114319519 wait complete. 2024-03-27T08:24:04.238 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:04.238 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:04 smithi164 ceph-mon[31788]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:04.239 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:04.666 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-27T08:24:04.666 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd crush tunables default 2024-03-27T08:24:05.096 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:24:05.332 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:05 smithi164 ceph-mon[31788]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:24:06.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:06 smithi164 ceph-mon[31788]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:06.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:07.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.056+0000 7feebb000700 1 -- 172.21.15.164:0/614819776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 msgr2=0x7feeb41035a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:07.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.056+0000 7feebb000700 1 --2- 172.21.15.164:0/614819776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb41035a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feea400b0a0 tx=0x7feea400b3b0 comp rx=0 tx=0).stop 2024-03-27T08:24:07.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.057+0000 7feebb000700 1 -- 172.21.15.164:0/614819776 shutdown_connections 2024-03-27T08:24:07.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.057+0000 7feebb000700 1 --2- 172.21.15.164:0/614819776 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb41035a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.057+0000 7feebb000700 1 -- 172.21.15.164:0/614819776 >> 172.21.15.164:0/614819776 conn(0x7feeb40fca30 msgr2=0x7feeb40fee50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.057+0000 7feebb000700 1 -- 172.21.15.164:0/614819776 shutdown_connections 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.057+0000 7feebb000700 1 -- 172.21.15.164:0/614819776 wait complete. 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.058+0000 7feebb000700 1 Processor -- start 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.058+0000 7feebb000700 1 -- start start 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.058+0000 7feebb000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.058+0000 7feebb000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feeb410c6a0 con 0x7feeb41031c0 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.058+0000 7feeb3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.059+0000 7feeb3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34894/0 (socket says 172.21.15.164:34894) 2024-03-27T08:24:07.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.059+0000 7feeb3e00700 1 -- 172.21.15.164:0/340014416 learned_addr learned my addr 172.21.15.164:0/340014416 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:24:07.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.059+0000 7feeb3e00700 1 -- 172.21.15.164:0/340014416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feeb4102d10 con 0x7feeb41031c0 2024-03-27T08:24:07.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.059+0000 7feeb3e00700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feea4015040 tx=0x7feea4003d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:07.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.059+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea4017040 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.060+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feea4022070 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.060+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feea401b430 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.060+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feeb4101360 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.060+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feeb4101820 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.061+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feeb406abb0 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.061+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7feea4004260 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.061+0000 7feeb0c00700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 0x7fee9803b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.061+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7feea400f050 con 0x7feeb41031c0 2024-03-27T08:24:07.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.062+0000 7feeb3400700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 0x7fee9803b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:07.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.062+0000 7feeb3400700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 0x7fee9803b9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feea0006fd0 tx=0x7feea0006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:07.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.067+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7feea4023270 con 0x7feeb41031c0 2024-03-27T08:24:07.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:07.299+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7feeb4102350 con 0x7feeb41031c0 2024-03-27T08:24:08.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.223+0000 7feeb0c00700 1 -- 172.21.15.164:0/340014416 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7feea40093e0 con 0x7feeb41031c0 2024-03-27T08:24:08.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 msgr2=0x7fee9803b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:08.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 0x7fee9803b9e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7feea0006fd0 tx=0x7feea0006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:08.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 msgr2=0x7feeb4100e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:08.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feea4015040 tx=0x7feea4003d50 comp rx=0 tx=0).stop 2024-03-27T08:24:08.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 shutdown_connections 2024-03-27T08:24:08.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fee98039520 0x7fee9803b9e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:08.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 --2- 172.21.15.164:0/340014416 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feeb41031c0 0x7feeb4100e20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:08.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 >> 172.21.15.164:0/340014416 conn(0x7feeb40fca30 msgr2=0x7feeb4103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:08.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.227+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 shutdown_connections 2024-03-27T08:24:08.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:08.228+0000 7feebb000700 1 -- 172.21.15.164:0/340014416 wait complete. 2024-03-27T08:24:08.221 INFO:teuthology.orchestra.run.smithi164.stderr:adjusted tunables profile to default 2024-03-27T08:24:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:08 smithi164 ceph-mon[31788]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-27T08:24:08.960 INFO:tasks.cephadm:Adding mon.a on smithi164 2024-03-27T08:24:08.960 INFO:tasks.cephadm:Adding mon.b on smithi167 2024-03-27T08:24:08.960 INFO:tasks.cephadm:Adding mon.c on smithi173 2024-03-27T08:24:08.960 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch apply mon '3;smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c' 2024-03-27T08:24:09.363 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-27T08:24:09.485 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /etc/ceph/ceph.conf 2024-03-27T08:24:09.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:09 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-27T08:24:09.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:09 smithi164 ceph-mon[31788]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:10.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:10 smithi164 ceph-mon[31788]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:11.979 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 -- 172.21.15.173:0/2946120302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 msgr2=0x7fc6d8102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 --2- 172.21.15.173:0/2946120302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8102480 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc009910 tx=0x7fc6cc009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 -- 172.21.15.173:0/2946120302 shutdown_connections 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 --2- 172.21.15.173:0/2946120302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8102480 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 -- 172.21.15.173:0/2946120302 >> 172.21.15.173:0/2946120302 conn(0x7fc6d80fd600 msgr2=0x7fc6d80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 -- 172.21.15.173:0/2946120302 shutdown_connections 2024-03-27T08:24:11.980 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.986+0000 7fc6e0800700 1 -- 172.21.15.173:0/2946120302 wait complete. 2024-03-27T08:24:11.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.988+0000 7fc6e0800700 1 Processor -- start 2024-03-27T08:24:11.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.988+0000 7fc6e0800700 1 -- start start 2024-03-27T08:24:11.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.988+0000 7fc6e0800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:11.981 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.988+0000 7fc6e0800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc6d81080e0 con 0x7fc6d8102060 2024-03-27T08:24:11.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.989+0000 7fc6dde00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:11.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.989+0000 7fc6dde00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.173:43668/0 (socket says 172.21.15.173:43668) 2024-03-27T08:24:11.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.989+0000 7fc6dde00700 1 -- 172.21.15.173:0/3264188189 learned_addr learned my addr 172.21.15.173:0/3264188189 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:11.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.989+0000 7fc6dde00700 1 -- 172.21.15.173:0/3264188189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6d8199ec0 con 0x7fc6d8102060 2024-03-27T08:24:11.982 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6dde00700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc004f80 tx=0x7fc6cc009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:11.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc027070 con 0x7fc6d8102060 2024-03-27T08:24:11.983 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6d819a150 con 0x7fc6d8102060 2024-03-27T08:24:11.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6d819ce40 con 0x7fc6d8102060 2024-03-27T08:24:11.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc6cc00be30 con 0x7fc6d8102060 2024-03-27T08:24:11.984 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.990+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6cc00f460 con 0x7fc6d8102060 2024-03-27T08:24:11.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.992+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6d8108860 con 0x7fc6d8102060 2024-03-27T08:24:11.985 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.992+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fc6cc02a070 con 0x7fc6d8102060 2024-03-27T08:24:11.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.993+0000 7fc6d2a00700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 0x7fc6c003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:11.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.993+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fc6cc01e030 con 0x7fc6d8102060 2024-03-27T08:24:11.986 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.994+0000 7fc6dd400700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 0x7fc6c003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:11.987 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:11.995+0000 7fc6dd400700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 0x7fc6c003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8006fd0 tx=0x7fc6c8006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:12.002 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.010+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc6cc013070 con 0x7fc6d8102060 2024-03-27T08:24:12.241 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.249+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}) -- 0x7fc6d802dfc0 con 0x7fc6c00394d0 2024-03-27T08:24:12.256 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.263+0000 7fc6d2a00700 1 -- 172.21.15.173:0/3264188189 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fc6d802dfc0 con 0x7fc6c00394d0 2024-03-27T08:24:12.256 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mon update... 2024-03-27T08:24:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 msgr2=0x7fc6c003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 0x7fc6c003b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fc6c8006fd0 tx=0x7fc6c8006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:12.259 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 msgr2=0x7fc6d8199980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc6cc004f80 tx=0x7fc6cc009f90 comp rx=0 tx=0).stop 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 shutdown_connections 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc6c00394d0 0x7fc6c003b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 --2- 172.21.15.173:0/3264188189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc6d8102060 0x7fc6d8199980 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 >> 172.21.15.173:0/3264188189 conn(0x7fc6d80fd600 msgr2=0x7fc6d80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 shutdown_connections 2024-03-27T08:24:12.260 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:12.266+0000 7fc6e0800700 1 -- 172.21.15.173:0/3264188189 wait complete. 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:24:12.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:12.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:12.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:13.018 DEBUG:teuthology.orchestra.run.smithi167:mon.b> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.b.service 2024-03-27T08:24:13.026 DEBUG:teuthology.orchestra.run.smithi173:mon.c> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.c.service 2024-03-27T08:24:13.031 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T08:24:13.031 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T08:24:13.455 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:13.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:13 smithi164 ceph-mon[31788]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:13.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:13 smithi164 ceph-mon[31788]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:13.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:13 smithi164 ceph-mon[31788]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:13.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:13 smithi164 ceph-mon[31788]: Saving service mon spec with placement smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c;count:3 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:14.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:14 smithi164 ceph-mon[31788]: Deploying daemon mon.c on smithi173 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.521+0000 7fb833400700 1 -- 172.21.15.173:0/1518739324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 msgr2=0x7fb82c10ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.521+0000 7fb833400700 1 --2- 172.21.15.173:0/1518739324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c10ea10 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb820009910 tx=0x7fb820009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.521+0000 7fb833400700 1 -- 172.21.15.173:0/1518739324 shutdown_connections 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.521+0000 7fb833400700 1 --2- 172.21.15.173:0/1518739324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c10ea10 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.521+0000 7fb833400700 1 -- 172.21.15.173:0/1518739324 >> 172.21.15.173:0/1518739324 conn(0x7fb82c077ea0 msgr2=0x7fb82c07a2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:15.515 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.522+0000 7fb833400700 1 -- 172.21.15.173:0/1518739324 shutdown_connections 2024-03-27T08:24:15.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.522+0000 7fb833400700 1 -- 172.21.15.173:0/1518739324 wait complete. 2024-03-27T08:24:15.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.523+0000 7fb833400700 1 Processor -- start 2024-03-27T08:24:15.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.523+0000 7fb833400700 1 -- start start 2024-03-27T08:24:15.516 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.524+0000 7fb833400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:15.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.524+0000 7fb833400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb82c112c60 con 0x7fb82c10e630 2024-03-27T08:24:15.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.524+0000 7fb830a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:15.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.524+0000 7fb830a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.173:43682/0 (socket says 172.21.15.173:43682) 2024-03-27T08:24:15.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.524+0000 7fb830a00700 1 -- 172.21.15.173:0/2299377971 learned_addr learned my addr 172.21.15.173:0/2299377971 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:15.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.525+0000 7fb830a00700 1 -- 172.21.15.173:0/2299377971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82c19e6e0 con 0x7fb82c10e630 2024-03-27T08:24:15.518 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.526+0000 7fb830a00700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb820006010 tx=0x7fb820005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:15.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.526+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb820026070 con 0x7fb82c10e630 2024-03-27T08:24:15.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.526+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb82000bbc0 con 0x7fb82c10e630 2024-03-27T08:24:15.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.526+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8200038a0 con 0x7fb82c10e630 2024-03-27T08:24:15.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.526+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82c19e9d0 con 0x7fb82c10e630 2024-03-27T08:24:15.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.527+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb82c1a2a70 con 0x7fb82c10e630 2024-03-27T08:24:15.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.528+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb82c109d70 con 0x7fb82c10e630 2024-03-27T08:24:15.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.528+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fb820029070 con 0x7fb82c10e630 2024-03-27T08:24:15.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.529+0000 7fb829600700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 0x7fb81403b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:15.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.529+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb82001e070 con 0x7fb82c10e630 2024-03-27T08:24:15.522 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.529+0000 7fb82be00700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 0x7fb81403b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:15.523 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.531+0000 7fb82be00700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 0x7fb81403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb818006fd0 tx=0x7fb818006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:15.536 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.543+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb820013070 con 0x7fb82c10e630 2024-03-27T08:24:15.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:15 smithi164 ceph-mon[31788]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:15.858 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.865+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb82c19f500 con 0x7fb82c10e630 2024-03-27T08:24:15.859 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.866+0000 7fb829600700 1 -- 172.21.15.173:0/2299377971 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7fb820034020 con 0x7fb82c10e630 2024-03-27T08:24:15.859 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:24:15.859 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":1,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","modified":"2024-03-27T08:22:04.813774Z","created":"2024-03-27T08:22:04.813774Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-27T08:24:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 msgr2=0x7fb81403b930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 0x7fb81403b930 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb818006fd0 tx=0x7fb818006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 msgr2=0x7fb82c19e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:15.862 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb820006010 tx=0x7fb820005810 comp rx=0 tx=0).stop 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 shutdown_connections 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb814039470 0x7fb81403b930 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 --2- 172.21.15.173:0/2299377971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb82c10e630 0x7fb82c19e1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 >> 172.21.15.173:0/2299377971 conn(0x7fb82c077ea0 msgr2=0x7fb82c1100e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 shutdown_connections 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:15.869+0000 7fb833400700 1 -- 172.21.15.173:0/2299377971 wait complete. 2024-03-27T08:24:15.863 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 1 2024-03-27T08:24:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:16 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/2299377971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:17 smithi164 ceph-mon[31788]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:18.755 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T08:24:18.756 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T08:24:19.250 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:24:20.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:20 smithi164 ceph-mon[31788]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:21.266 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:21 smithi173 systemd[1]: Starting Ceph mon.c for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:24:21.794 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:21 smithi173 podman[35351]: 2024-03-27 08:24:21.672510809 +0000 UTC m=+0.212104884 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:24:21.794 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:21 smithi173 podman[35351]: 2024-03-27 08:24:21.800748516 +0000 UTC m=+0.340342623 container create 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-27T08:24:22.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.160+0000 7fb0d1600700 1 -- 172.21.15.173:0/1825348721 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 msgr2=0x7fb0cc102770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:22.154 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.160+0000 7fb0d1600700 1 --2- 172.21.15.173:0/1825348721 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc102770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc009910 tx=0x7fb0bc009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.160+0000 7fb0d1600700 1 -- 172.21.15.173:0/1825348721 shutdown_connections 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.160+0000 7fb0d1600700 1 --2- 172.21.15.173:0/1825348721 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc102770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.160+0000 7fb0d1600700 1 -- 172.21.15.173:0/1825348721 >> 172.21.15.173:0/1825348721 conn(0x7fb0cc0fdc40 msgr2=0x7fb0cc100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.161+0000 7fb0d1600700 1 -- 172.21.15.173:0/1825348721 shutdown_connections 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.161+0000 7fb0d1600700 1 -- 172.21.15.173:0/1825348721 wait complete. 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.162+0000 7fb0d1600700 1 Processor -- start 2024-03-27T08:24:22.155 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.162+0000 7fb0d1600700 1 -- start start 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.162+0000 7fb0d1600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.162+0000 7fb0d1600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0cc10c750 con 0x7fb0cc102390 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.163+0000 7fb0caa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.163+0000 7fb0caa00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.173:60592/0 (socket says 172.21.15.173:60592) 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.163+0000 7fb0caa00700 1 -- 172.21.15.173:0/4066139153 learned_addr learned my addr 172.21.15.173:0/4066139153 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.163+0000 7fb0caa00700 1 -- 172.21.15.173:0/4066139153 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0cc076830 con 0x7fb0cc102390 2024-03-27T08:24:22.156 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.164+0000 7fb0caa00700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:22.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.164+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc027070 con 0x7fb0cc102390 2024-03-27T08:24:22.157 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.164+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb0bc00be30 con 0x7fb0cc102390 2024-03-27T08:24:22.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.164+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0bc022d70 con 0x7fb0cc102390 2024-03-27T08:24:22.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.165+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0cc074ee0 con 0x7fb0cc102390 2024-03-27T08:24:22.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.165+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0cc0753a0 con 0x7fb0cc102390 2024-03-27T08:24:22.158 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.166+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0cc103870 con 0x7fb0cc102390 2024-03-27T08:24:22.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.166+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fb0bc02a070 con 0x7fb0cc102390 2024-03-27T08:24:22.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.167+0000 7fb0c3e00700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 0x7fb0b003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:22.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.167+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb0bc01e030 con 0x7fb0cc102390 2024-03-27T08:24:22.160 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.167+0000 7fb0c2000700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 0x7fb0b003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:22.161 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.168+0000 7fb0c2000700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 0x7fb0b003b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006fd0 tx=0x7fb0b4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:22.175 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.183+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb0bc013070 con 0x7fb0cc102390 2024-03-27T08:24:22.325 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.332+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fb0bc00e3e0 con 0x7fb0cc102390 2024-03-27T08:24:22.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:22 smithi164 ceph-mon[31788]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.511 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:22.518+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fb0cc075e70 con 0x7fb0cc102390 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 podman[35351]: 2024-03-27 08:24:22.213993561 +0000 UTC m=+0.753587668 container init 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 podman[35351]: 2024-03-27 08:24:22.223419112 +0000 UTC m=+0.763013216 container start 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: set uid:gid to 167:167 (ceph:ceph) 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev), process ceph-mon, pid 2 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pidfile_write: ignore empty --pid-file 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: load: jerasure load: lrc 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: RocksDB version: 7.9.2 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Git sha 0 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Compile date 2024-03-26 18:55:08 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: DB SUMMARY 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: DB Session ID: 1A02JDDABQGXO2Z1ZFCR 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: CURRENT file: CURRENT 2024-03-27T08:24:22.512 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: IDENTITY file: IDENTITY 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.error_if_exists: 0 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.create_if_missing: 0 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.paranoid_checks: 1 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.env: 0x564a642d1c60 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.fs: PosixFileSystem 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.info_log: 0x564a655fdb20 2024-03-27T08:24:22.513 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_file_opening_threads: 16 2024-03-27T08:24:22.515 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.statistics: (nil) 2024-03-27T08:24:22.515 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.use_fsync: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_log_file_size: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.keep_log_file_num: 1000 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.recycle_log_file_num: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_fallocate: 1 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_mmap_reads: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_mmap_writes: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.use_direct_reads: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.create_missing_column_families: 0 2024-03-27T08:24:22.516 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.db_log_dir: 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.wal_dir: 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.advise_random_on_open: 1 2024-03-27T08:24:22.517 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.db_write_buffer_size: 0 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.write_buffer_manager: 0x564a655ce1e0 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.rate_limiter: (nil) 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.wal_recovery_mode: 2 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enable_thread_tracking: 0 2024-03-27T08:24:22.518 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enable_pipelined_write: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.unordered_write: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.row_cache: None 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.wal_filter: None 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_ingest_behind: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.two_write_queues: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.manual_wal_flush: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.wal_compression: 0 2024-03-27T08:24:22.519 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.atomic_flush: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.log_readahead_size: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.best_efforts_recovery: 0 2024-03-27T08:24:22.520 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.allow_data_in_errors: 0 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.db_host_id: __hostname__ 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_background_jobs: 2 2024-03-27T08:24:22.521 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_background_compactions: -1 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_subcompactions: 1 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_total_wal_size: 0 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-27T08:24:22.522 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_open_files: -1 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bytes_per_sync: 0 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_readahead_size: 0 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_background_flushes: -1 2024-03-27T08:24:22.523 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Compression algorithms supported: 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kZSTD supported: 0 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kXpressCompression supported: 0 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kLZ4HCCompression supported: 1 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kZlibCompression supported: 1 2024-03-27T08:24:22.524 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kSnappyCompression supported: 1 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kLZ4Compression supported: 1 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: kBZip2Compression supported: 0 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-03-27T08:24:22.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.merge_operator: 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_filter: None 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_filter_factory: None 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.sst_partitioner_factory: None 2024-03-27T08:24:22.526 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564a655fdd00) 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks: 1 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout: pin_top_level_index_and_filter: 1 2024-03-27T08:24:22.527 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_type: 0 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_index_type: 0 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_shortening: 1 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: checksum: 4 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: no_block_cache: 0 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache: 0x564a65601090 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_name: BinnedLRUCache 2024-03-27T08:24:22.528 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_options: 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: capacity : 536870912 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_shard_bits : 4 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: strict_capacity_limit : 0 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: high_pri_pool_ratio: 0.000 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_cache_compressed: (nil) 2024-03-27T08:24:22.529 INFO:journalctl@ceph.mon.c.smithi173.stdout: persistent_cache: (nil) 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size: 4096 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_size_deviation: 10 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_restart_interval: 16 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: index_block_restart_interval: 1 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: metadata_block_size: 4096 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: partition_filters: 0 2024-03-27T08:24:22.530 INFO:journalctl@ceph.mon.c.smithi173.stdout: use_delta_encoding: 1 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: filter_policy: bloomfilter 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: whole_key_filtering: 1 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: verify_compression: 0 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: read_amp_bytes_per_bit: 0 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: format_version: 5 2024-03-27T08:24:22.531 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_index_compression: 1 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout: block_align: 0 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout: max_auto_readahead_size: 262144 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout: prepopulate_block_cache: 0 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout: initial_auto_readahead_size: 8192 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout: num_file_reads_for_auto_readahead: 2 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.write_buffer_size: 33554432 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_write_buffer_number: 2 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression: NoCompression 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression: Disabled 2024-03-27T08:24:22.532 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.prefix_extractor: nullptr 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.num_levels: 7 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-27T08:24:22.533 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.level: 32767 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.strategy: 0 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.enabled: false 2024-03-27T08:24:22.534 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.target_file_size_base: 67108864 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-27T08:24:22.535 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.arena_block_size: 1048576 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.disable_auto_compactions: 0 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-27T08:24:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.inplace_update_support: 0 2024-03-27T08:24:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.bloom_locality: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.max_successive_merges: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.paranoid_file_checks: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.force_consistency_checks: 1 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.report_bg_io_stats: 0 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.ttl: 2592000 2024-03-27T08:24:22.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enable_blob_files: false 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.min_blob_size: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_file_size: 268435456 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.blob_file_starting_level: 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-27T08:24:22.539 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1e1b1388-13d2-45cd-be03-d3b94227b51c 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527862278109, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527862279967, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711527862, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1e1b1388-13d2-45cd-be03-d3b94227b51c", "db_session_id": "1A02JDDABQGXO2Z1ZFCR", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527862280279, "job": 1, "event": "recovery_finished"} 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564a656f0000 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: DB pointer 0x564a656da000 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** DB Stats ** 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:24:22.540 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.541 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** Compaction Stats [default] ** 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.9 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Cumulative compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:24:22.542 INFO:journalctl@ceph.mon.c.smithi173.stdout: Interval compaction: 0.00 GB write, 0.18 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache BinnedLRUCache@0x564a65601090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: using public_addr v2:172.21.15.173:0/0 -> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: starting mon.c rank -1 at public addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] at bind addrs [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(???) e0 preinit fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 bash[35351]: 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 systemd[1]: Started Ceph mon.c for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).mds e1 new map 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).mds e1 print_map 2024-03-27T08:24:22.543 INFO:journalctl@ceph.mon.c.smithi173.stdout: e1 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout: legacy client fscid: -1 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout: 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout: No filesystems configured 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-27T08:24:22.544 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Deploying cephadm binary to smithi167 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Added host smithi167 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.545 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Deploying cephadm binary to smithi173 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:24:22.546 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Added host smithi173 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.547 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Saving service mon spec with placement smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c;count:3 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:22.549 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: Deploying daemon mon.c on smithi173 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/2299377971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:22.550 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:22 smithi173 ceph-mon[35397]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-03-27T08:24:27.357 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.365+0000 7fb0c3e00700 1 -- 172.21.15.173:0/4066139153 <== mon.0 v2:172.21.15.164:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7fb0bc035020 con 0x7fb0cc102390 2024-03-27T08:24:27.357 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:24:27.357 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","modified":"2024-03-27T08:24:22.328664Z","created":"2024-03-27T08:22:04.813774Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 msgr2=0x7fb0b003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 0x7fb0b003b990 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb0b4006fd0 tx=0x7fb0b4006e40 comp rx=0 tx=0).stop 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 msgr2=0x7fb0cc074940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc006010 tx=0x7fb0bc005810 comp rx=0 tx=0).stop 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 shutdown_connections 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0b00394d0 0x7fb0b003b990 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.368+0000 7fb0d1600700 1 --2- 172.21.15.173:0/4066139153 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb0cc102390 0x7fb0cc074940 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.369+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 >> 172.21.15.173:0/4066139153 conn(0x7fb0cc0fdc40 msgr2=0x7fb0cc103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.369+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 shutdown_connections 2024-03-27T08:24:27.361 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:27.369+0000 7fb0d1600700 1 -- 172.21.15.173:0/4066139153 wait complete. 2024-03-27T08:24:27.362 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: mon.a calling monitor election 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/4066139153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: mon.c calling monitor election 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:27.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: monmap epoch 2 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: last_changed 2024-03-27T08:24:22.328664+0000 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: min_mon_release 19 (squid) 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: election_strategy: 1 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: fsmap 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: mgrmap e13: x(active, since 70s) 2024-03-27T08:24:27.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: overall HEALTH_OK 2024-03-27T08:24:27.709 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.709 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.709 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.709 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:27.709 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:27.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:27.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: mon.a calling monitor election 2024-03-27T08:24:27.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/4066139153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: mon.c calling monitor election 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: monmap epoch 2 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: last_changed 2024-03-27T08:24:22.328664+0000 2024-03-27T08:24:27.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: min_mon_release 19 (squid) 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: election_strategy: 1 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: fsmap 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: mgrmap e13: x(active, since 70s) 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: overall HEALTH_OK 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:27.758 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:28.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:28 smithi164 ceph-mon[31788]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:28.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:28 smithi164 ceph-mon[31788]: Deploying daemon mon.b on smithi167 2024-03-27T08:24:28.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:28 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:28 smithi173 ceph-mon[35397]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:28.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:28 smithi173 ceph-mon[35397]: Deploying daemon mon.b on smithi167 2024-03-27T08:24:28.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:28 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:29.082 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T08:24:29.083 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T08:24:29.517 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:24:30.479 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:30 smithi173 ceph-mon[35397]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:30 smithi164 ceph-mon[31788]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 -- 172.21.15.173:0/436215377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 msgr2=0x7f572c10eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 --2- 172.21.15.173:0/436215377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c10eb10 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f571c009910 tx=0x7f571c009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 -- 172.21.15.173:0/436215377 shutdown_connections 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 --2- 172.21.15.173:0/436215377 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c10eb10 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 -- 172.21.15.173:0/436215377 >> 172.21.15.173:0/436215377 conn(0x7f572c077f60 msgr2=0x7f572c07a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 -- 172.21.15.173:0/436215377 shutdown_connections 2024-03-27T08:24:31.517 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.524+0000 7f5731400700 1 -- 172.21.15.173:0/436215377 wait complete. 2024-03-27T08:24:31.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 Processor -- start 2024-03-27T08:24:31.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 -- start start 2024-03-27T08:24:31.519 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f572c112d60 con 0x7f572c10e730 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.526+0000 7f5731400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f572c112be0 con 0x7f572c19e890 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f572a800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f5723e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f572a800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.173:60618/0 (socket says 172.21.15.173:60618) 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f572a800700 1 -- 172.21.15.173:0/2133150331 learned_addr learned my addr 172.21.15.173:0/2133150331 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f5723e00700 1 -- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 msgr2=0x7f572c1a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f5723e00700 1 -- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 msgr2=0x7f572c1a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T08:24:31.520 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f5723e00700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T08:24:31.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.527+0000 7f5723e00700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:24:31.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f572a800700 1 -- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 msgr2=0x7f572c1a2c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:24:31.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f572a800700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:31.521 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f572a800700 1 -- 172.21.15.173:0/2133150331 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f572c19eed0 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f572a800700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f571c006010 tx=0x7f571c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f571c00b960 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.528+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f572c1a3160 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.529+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f571c022470 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.529+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f571c00f660 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.529+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f572c1a36c0 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.530+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f572c109e70 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.530+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f571c02a070 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.531+0000 7f5723400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 0x7f571003b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.531+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f571c01e030 con 0x7f572c10e730 2024-03-27T08:24:31.524 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.531+0000 7f5723e00700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 0x7f571003b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:31.525 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.532+0000 7f5723e00700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 0x7f571003b720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5714009850 tx=0x7f5714008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:31.540 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.548+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f571c013070 con 0x7f572c10e730 2024-03-27T08:24:31.829 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.837+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f572c1a3940 con 0x7f572c10e730 2024-03-27T08:24:31.830 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.838+0000 7f5723400700 1 -- 172.21.15.173:0/2133150331 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f571c0163a0 con 0x7f572c10e730 2024-03-27T08:24:31.830 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:24:31.830 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":2,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","modified":"2024-03-27T08:24:22.328664Z","created":"2024-03-27T08:22:04.813774Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-27T08:24:31.832 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 msgr2=0x7f571003b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 0x7f571003b720 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5714009850 tx=0x7f5714008040 comp rx=0 tx=0).stop 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 msgr2=0x7f572c19e350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f571c006010 tx=0x7f571c004740 comp rx=0 tx=0).stop 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 shutdown_connections 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5710039260 0x7f571003b720 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f572c10e730 0x7f572c19e350 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 --2- 172.21.15.173:0/2133150331 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f572c19e890 0x7f572c1a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.840+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 >> 172.21.15.173:0/2133150331 conn(0x7f572c077f60 msgr2=0x7f572c10a230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.841+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 shutdown_connections 2024-03-27T08:24:31.833 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:31.841+0000 7f5731400700 1 -- 172.21.15.173:0/2133150331 wait complete. 2024-03-27T08:24:31.834 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 2 2024-03-27T08:24:32.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:32 smithi173 ceph-mon[35397]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:32.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:32 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/2133150331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:32 smithi164 ceph-mon[31788]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:32 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/2133150331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.001 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:32 smithi167 podman[34885]: 2024-03-27 08:24:32.644332421 +0000 UTC m=+0.031349587 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:24:33.002 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 podman[34885]: 2024-03-27 08:24:33.008566217 +0000 UTC m=+0.395583424 container init 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True) 2024-03-27T08:24:33.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 podman[34885]: 2024-03-27 08:24:33.018909211 +0000 UTC m=+0.405926379 container start 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-03-27T08:24:33.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: set uid:gid to 167:167 (ceph:ceph) 2024-03-27T08:24:33.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev), process ceph-mon, pid 2 2024-03-27T08:24:33.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pidfile_write: ignore empty --pid-file 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: load: jerasure load: lrc 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: RocksDB version: 7.9.2 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Git sha 0 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Compile date 2024-03-26 18:55:08 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: DB SUMMARY 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: DB Session ID: 23KOEPWJFGGJI4RQHP0O 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: CURRENT file: CURRENT 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: IDENTITY file: IDENTITY 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.error_if_exists: 0 2024-03-27T08:24:33.321 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.create_if_missing: 0 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.paranoid_checks: 1 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.env: 0x557063561c60 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.fs: PosixFileSystem 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.info_log: 0x5570641f3b20 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_file_opening_threads: 16 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.statistics: (nil) 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.use_fsync: 0 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_log_file_size: 0 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-27T08:24:33.322 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-27T08:24:33.323 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.keep_log_file_num: 1000 2024-03-27T08:24:33.323 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.recycle_log_file_num: 0 2024-03-27T08:24:33.323 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_fallocate: 1 2024-03-27T08:24:33.323 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_mmap_reads: 0 2024-03-27T08:24:33.323 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_mmap_writes: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.use_direct_reads: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.create_missing_column_families: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.db_log_dir: 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.wal_dir: 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.advise_random_on_open: 1 2024-03-27T08:24:33.324 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.db_write_buffer_size: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.write_buffer_manager: 0x5570641c41e0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.rate_limiter: (nil) 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.wal_recovery_mode: 2 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enable_thread_tracking: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enable_pipelined_write: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.unordered_write: 0 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-27T08:24:33.325 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.row_cache: None 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.wal_filter: None 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_ingest_behind: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.two_write_queues: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.manual_wal_flush: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.wal_compression: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.atomic_flush: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-27T08:24:33.326 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.log_readahead_size: 0 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.best_efforts_recovery: 0 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.allow_data_in_errors: 0 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.db_host_id: __hostname__ 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_background_jobs: 2 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_background_compactions: -1 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_subcompactions: 1 2024-03-27T08:24:33.327 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_total_wal_size: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_open_files: -1 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bytes_per_sync: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_readahead_size: 0 2024-03-27T08:24:33.328 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_background_flushes: -1 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Compression algorithms supported: 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kZSTD supported: 0 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kXpressCompression supported: 0 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kLZ4HCCompression supported: 1 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kZlibCompression supported: 1 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kSnappyCompression supported: 1 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kLZ4Compression supported: 1 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: kBZip2Compression supported: 0 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-27T08:24:33.329 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.merge_operator: 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_filter: None 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_filter_factory: None 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.sst_partitioner_factory: None 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5570641f3d00) 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_type: 0 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: data_block_index_type: 0 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_shortening: 1 2024-03-27T08:24:33.330 INFO:journalctl@ceph.mon.b.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: checksum: 4 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: no_block_cache: 0 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache: 0x5570641f7090 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_options: 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: capacity : 536870912 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: num_shard_bits : 4 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: strict_capacity_limit : 0 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_cache_compressed: (nil) 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: persistent_cache: (nil) 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_size: 4096 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_size_deviation: 10 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_restart_interval: 16 2024-03-27T08:24:33.331 INFO:journalctl@ceph.mon.b.smithi167.stdout: index_block_restart_interval: 1 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: metadata_block_size: 4096 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: partition_filters: 0 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: use_delta_encoding: 1 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: filter_policy: bloomfilter 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: whole_key_filtering: 1 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: verify_compression: 0 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: format_version: 5 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: enable_index_compression: 1 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: block_align: 0 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: max_auto_readahead_size: 262144 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: prepopulate_block_cache: 0 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: initial_auto_readahead_size: 8192 2024-03-27T08:24:33.332 INFO:journalctl@ceph.mon.b.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.write_buffer_size: 33554432 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_write_buffer_number: 2 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression: NoCompression 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression: Disabled 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.prefix_extractor: nullptr 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.num_levels: 7 2024-03-27T08:24:33.333 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-27T08:24:33.334 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-27T08:24:33.334 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.level: 32767 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.strategy: 0 2024-03-27T08:24:33.335 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.enabled: false 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.target_file_size_base: 67108864 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-27T08:24:33.336 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.arena_block_size: 1048576 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.disable_auto_compactions: 0 2024-03-27T08:24:33.337 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.inplace_update_support: 0 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-27T08:24:33.338 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.bloom_locality: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.max_successive_merges: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.paranoid_file_checks: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.force_consistency_checks: 1 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.report_bg_io_stats: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.ttl: 2592000 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enable_blob_files: false 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.min_blob_size: 0 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_file_size: 268435456 2024-03-27T08:24:33.339 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.blob_file_starting_level: 0 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 43651fd4-151f-49e5-8da3-dc72d68209a8 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527873077330, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527873078432, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1711527873, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "43651fd4-151f-49e5-8da3-dc72d68209a8", "db_session_id": "23KOEPWJFGGJI4RQHP0O", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: EVENT_LOG_v1 {"time_micros": 1711527873078659, "job": 1, "event": "recovery_finished"} 2024-03-27T08:24:33.340 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5570642e6000 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: DB pointer 0x5570642d0000 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** DB Stats ** 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-27T08:24:33.341 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** Compaction Stats [default] ** 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** Compaction Stats [default] ** 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-27T08:24:33.342 INFO:journalctl@ceph.mon.b.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Interval compaction: 0.00 GB write, 0.30 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Block cache BinnedLRUCache@0x5570641f7090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-03-27T08:24:33.343 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: starting mon.b rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(???) e0 preinit fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 bash[34885]: 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).mds e1 new map 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).mds e1 print_map 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: e1 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: legacy client fscid: -1 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout: No filesystems configured 2024-03-27T08:24:33.344 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 systemd[1]: Started Ceph mon.b for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Deploying cephadm binary to smithi167 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.345 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Added host smithi167 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi173", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Deploying cephadm binary to smithi173 2024-03-27T08:24:33.346 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Added host smithi173 2024-03-27T08:24:33.347 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-27T08:24:33.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/340014416' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi173", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:33.349 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Saving service mon spec with placement smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c;count:3 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi173:/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.client.admin.keyring 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Deploying daemon mon.c on smithi173 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/2299377971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.350 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.a calling monitor election 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/4066139153' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.c calling monitor election 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: monmap epoch 2 2024-03-27T08:24:33.351 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: last_changed 2024-03-27T08:24:22.328664+0000 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: min_mon_release 19 (squid) 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: election_strategy: 1 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: fsmap 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mgrmap e13: x(active, since 70s) 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: overall HEALTH_OK 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:33.352 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: Deploying daemon mon.b on smithi167 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/2133150331' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:33.353 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:33 smithi167 ceph-mon[34903]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-03-27T08:24:33.605 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-03-27T08:24:33.606 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph mon dump -f json 2024-03-27T08:24:34.049 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:24:38.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:38.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: mon.a calling monitor election 2024-03-27T08:24:38.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: mon.c calling monitor election 2024-03-27T08:24:38.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: mon.b calling monitor election 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: monmap epoch 3 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: last_changed 2024-03-27T08:24:33.133648+0000 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: min_mon_release 19 (squid) 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: election_strategy: 1 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: fsmap 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:38.508 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: mgrmap e13: x(active, since 81s) 2024-03-27T08:24:38.509 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: overall HEALTH_OK 2024-03-27T08:24:38.509 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.509 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: mon.a calling monitor election 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: mon.c calling monitor election 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: mon.b calling monitor election 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: monmap epoch 3 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: last_changed 2024-03-27T08:24:33.133648+0000 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: min_mon_release 19 (squid) 2024-03-27T08:24:38.572 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: election_strategy: 1 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: fsmap 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: mgrmap e13: x(active, since 81s) 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: overall HEALTH_OK 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.573 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: mon.a calling monitor election 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: mon.c calling monitor election 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: mon.b calling monitor election 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: monmap epoch 3 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: last_changed 2024-03-27T08:24:33.133648+0000 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: created 2024-03-27T08:22:04.813774+0000 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: min_mon_release 19 (squid) 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: election_strategy: 1 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: 0: [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] mon.a 2024-03-27T08:24:38.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: 1: [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] mon.c 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: 2: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.b 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: fsmap 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: osdmap e4: 0 total, 0 up, 0 in 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: mgrmap e13: x(active, since 81s) 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: overall HEALTH_OK 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.577 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.946+0000 7f2295000700 1 -- 172.21.15.173:0/429238044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2290102360 msgr2=0x7f2274005610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.946+0000 7f2295000700 1 --2- 172.21.15.173:0/429238044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2290102360 0x7f2274005610 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2280005fa0 tx=0x7f228000ffc0 comp rx=0 tx=0).stop 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.946+0000 7f2295000700 1 -- 172.21.15.173:0/429238044 shutdown_connections 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.946+0000 7f2295000700 1 --2- 172.21.15.173:0/429238044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2290102360 0x7f2274005610 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.946+0000 7f2295000700 1 -- 172.21.15.173:0/429238044 >> 172.21.15.173:0/429238044 conn(0x7f22900fdbd0 msgr2=0x7f22900ffff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.947+0000 7f2295000700 1 -- 172.21.15.173:0/429238044 shutdown_connections 2024-03-27T08:24:38.939 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.947+0000 7f2295000700 1 -- 172.21.15.173:0/429238044 wait complete. 2024-03-27T08:24:38.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 Processor -- start 2024-03-27T08:24:38.940 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 -- start start 2024-03-27T08:24:38.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:38.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22901982a0 0x7f229019c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:38.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:38.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f229010a130 con 0x7f229019cb70 2024-03-27T08:24:38.941 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2290109fb0 con 0x7f2290102360 2024-03-27T08:24:38.942 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.949+0000 7f2295000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f229010a2b0 con 0x7f22901982a0 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.950+0000 7f228e800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.950+0000 7f228e800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.173:57548/0 (socket says 172.21.15.173:57548) 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.950+0000 7f228e800700 1 -- 172.21.15.173:0/2198540524 learned_addr learned my addr 172.21.15.173:0/2198540524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.950+0000 7f228de00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.950+0000 7f2287e00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22901982a0 0x7f229019c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228de00700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 msgr2=0x7f2290197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228de00700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 msgr2=0x7f2290197d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228de00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22901982a0 msgr2=0x7f229019c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22901982a0 0x7f229019c630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 msgr2=0x7f2290197d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-27T08:24:38.943 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228de00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:24:38.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:38.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 -- 172.21.15.173:0/2198540524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22901a48e0 con 0x7f229019cb70 2024-03-27T08:24:38.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f228e800700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f228800ba50 tx=0x7f228800bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:38.944 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288019070 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f228800ce00 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.951+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22900748d0 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.952+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288007350 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.952+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2290074e10 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.953+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2290063c70 con 0x7f229019cb70 2024-03-27T08:24:38.945 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.953+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f228801c070 con 0x7f229019cb70 2024-03-27T08:24:38.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.953+0000 7f2286a00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 0x7f226c03bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:38.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.954+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f228804bc10 con 0x7f229019cb70 2024-03-27T08:24:38.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.954+0000 7f228de00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 0x7f226c03bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:38.946 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.955+0000 7f228de00700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 0x7f226c03bdc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f228000fb20 tx=0x7f2280005c00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:38.959 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:38.968+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f228800c930 con 0x7f229019cb70 2024-03-27T08:24:39.274 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.282+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f2290075100 con 0x7f229019cb70 2024-03-27T08:24:39.275 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.283+0000 7f2286a00700 1 -- 172.21.15.173:0/2198540524 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1289 (secure 0 0 0) 0x7f2288007510 con 0x7f229019cb70 2024-03-27T08:24:39.275 INFO:teuthology.orchestra.run.smithi173.stdout: 2024-03-27T08:24:39.275 INFO:teuthology.orchestra.run.smithi173.stdout:{"epoch":3,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","modified":"2024-03-27T08:24:33.133648Z","created":"2024-03-27T08:22:04.813774Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:3300","nonce":0},{"type":"v1","addr":"172.21.15.164:6789","nonce":0}]},"addr":"172.21.15.164:6789/0","public_addr":"172.21.15.164:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:3300","nonce":0},{"type":"v1","addr":"172.21.15.173:6789","nonce":0}]},"addr":"172.21.15.173:6789/0","public_addr":"172.21.15.173:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-27T08:24:39.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 msgr2=0x7f226c03bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:39.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 0x7f226c03bdc0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f228000fb20 tx=0x7f2280005c00 comp rx=0 tx=0).stop 2024-03-27T08:24:39.278 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 msgr2=0x7f229019d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f228800ba50 tx=0x7f228800bd60 comp rx=0 tx=0).stop 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 shutdown_connections 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f226c039900 0x7f226c03bdc0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f229019cb70 0x7f229019d020 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2290102360 0x7f2290197d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:39.279 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 --2- 172.21.15.173:0/2198540524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f22901982a0 0x7f229019c630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:39.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 >> 172.21.15.173:0/2198540524 conn(0x7f22900fdbd0 msgr2=0x7f22900fea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:39.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 shutdown_connections 2024-03-27T08:24:39.280 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:39.287+0000 7f2295000700 1 -- 172.21.15.173:0/2198540524 wait complete. 2024-03-27T08:24:39.280 INFO:teuthology.orchestra.run.smithi173.stderr:dumped monmap epoch 3 2024-03-27T08:24:39.464 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.464 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.465 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:39.465 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:39.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:39.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:39.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:39.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:39.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:24:40.052 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-27T08:24:40.052 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph config generate-minimal-conf 2024-03-27T08:24:40.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:40 smithi173 ceph-mon[35397]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:40.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:40 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/2198540524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:40.478 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:24:40.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:40 smithi164 ceph-mon[31788]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:40.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:40 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/2198540524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:40.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:24:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:24:40.132+0000 7fc557600700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-27T08:24:40.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:40 smithi167 ceph-mon[34903]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:40.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:40 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/2198540524' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-27T08:24:41.665 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:41.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:41.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:41.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:41.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:41.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:41.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:42.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 -- 172.21.15.164:0/4058687780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc601032a0 msgr2=0x7fbc60103680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:42.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 --2- 172.21.15.164:0/4058687780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc601032a0 0x7fbc60103680 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009910 tx=0x7fbc50009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:42.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 -- 172.21.15.164:0/4058687780 shutdown_connections 2024-03-27T08:24:42.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 --2- 172.21.15.164:0/4058687780 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc601032a0 0x7fbc60103680 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 -- 172.21.15.164:0/4058687780 >> 172.21.15.164:0/4058687780 conn(0x7fbc60077ce0 msgr2=0x7fbc600ff060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:42.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 -- 172.21.15.164:0/4058687780 shutdown_connections 2024-03-27T08:24:42.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.439+0000 7fbc65000700 1 -- 172.21.15.164:0/4058687780 wait complete. 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.440+0000 7fbc65000700 1 Processor -- start 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.440+0000 7fbc65000700 1 -- start start 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.440+0000 7fbc65000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc601032a0 0x7fbc60197e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.440+0000 7fbc65000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.440+0000 7fbc65000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc65000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010c670 con 0x7fbc60198340 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc65000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010c4f0 con 0x7fbc6019cbc0 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc65000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbc6010c7f0 con 0x7fbc601032a0 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:42.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40930/0 (socket says 172.21.15.164:40930) 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 -- 172.21.15.164:0/2877111364 learned_addr learned my addr 172.21.15.164:0/2877111364 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5e800700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5de00700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc601032a0 0x7fbc60197e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc601032a0 msgr2=0x7fbc60197e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5e800700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 msgr2=0x7fbc6019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc601032a0 0x7fbc60197e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5e800700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 msgr2=0x7fbc6019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5e800700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5d400700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 msgr2=0x7fbc6019d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.441+0000 7fbc5e800700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc5d400700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc5d400700 1 -- 172.21.15.164:0/2877111364 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc601a4930 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc5d400700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00b780 tx=0x7fbc4c00bb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c004230 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbc4c0043d0 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc601a4b60 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c011c10 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.442+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc601a50a0 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.443+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc60063c70 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.444+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7fbc4c01a400 con 0x7fbc60198340 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.444+0000 7fbc56a00700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 0x7fbc4403bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:42.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.444+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fbc4c04c530 con 0x7fbc60198340 2024-03-27T08:24:42.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.444+0000 7fbc5de00700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 0x7fbc4403bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:42.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.445+0000 7fbc5de00700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 0x7fbc4403bdc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009750 tx=0x7fbc5000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:42.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.450+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fbc4c01a840 con 0x7fbc60198340 2024-03-27T08:24:42.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.677+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fbc601a53c0 con 0x7fbc60198340 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: Updating smithi164:/etc/ceph/ceph.conf 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.671 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.677+0000 7fbc56a00700 1 -- 172.21.15.164:0/2877111364 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7fbc4c0193a0 con 0x7fbc60198340 2024-03-27T08:24:42.672 INFO:teuthology.orchestra.run.smithi164.stdout:# minimal ceph.conf for f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:42.672 INFO:teuthology.orchestra.run.smithi164.stdout:[global] 2024-03-27T08:24:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: fsid = f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:24:42.672 INFO:teuthology.orchestra.run.smithi164.stdout: mon_host = [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] 2024-03-27T08:24:42.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 msgr2=0x7fbc4403bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:42.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 0x7fbc4403bdc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fbc50009750 tx=0x7fbc5000b540 comp rx=0 tx=0).stop 2024-03-27T08:24:42.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 msgr2=0x7fbc6019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:42.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00b780 tx=0x7fbc4c00bb40 comp rx=0 tx=0).stop 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 shutdown_connections 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbc44039900 0x7fbc4403bdc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbc6019cbc0 0x7fbc6019d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbc601032a0 0x7fbc60197e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 --2- 172.21.15.164:0/2877111364 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbc60198340 0x7fbc6019c680 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 >> 172.21.15.164:0/2877111364 conn(0x7fbc60077ce0 msgr2=0x7fbc60104190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 shutdown_connections 2024-03-27T08:24:42.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:42.680+0000 7fbc65000700 1 -- 172.21.15.164:0/2877111364 wait complete. 2024-03-27T08:24:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: Updating smithi164:/etc/ceph/ceph.conf 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: Updating smithi164:/etc/ceph/ceph.conf 2024-03-27T08:24:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: Updating smithi167:/etc/ceph/ceph.conf 2024-03-27T08:24:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: Updating smithi173:/etc/ceph/ceph.conf 2024-03-27T08:24:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.425 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-27T08:24:43.425 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:24:43.425 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T08:24:43.510 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:24:43.510 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:43.621 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: Updating smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2877111364' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:43.622 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:43.623 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.624 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:24:43.624 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T08:24:43.715 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.715 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: Updating smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.715 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.715 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.715 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2877111364' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:43.716 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.730 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:24:43.730 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: Updating smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: Updating smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: Updating smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/config/ceph.conf 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2877111364' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:43.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:43.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:43.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:43.867 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:24:43.867 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.conf 2024-03-27T08:24:43.965 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:24:43.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-27T08:24:44.106 INFO:tasks.cephadm:Adding mgr.x on smithi164 2024-03-27T08:24:44.106 INFO:tasks.cephadm:Adding mgr.y on smithi167 2024-03-27T08:24:44.106 INFO:tasks.cephadm:Adding mgr.z on smithi173 2024-03-27T08:24:44.107 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch apply mgr '3;smithi164=x;smithi167=y;smithi173=z' 2024-03-27T08:24:44.573 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:24:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:44 smithi173 ceph-mon[35397]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T08:24:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:44 smithi173 ceph-mon[35397]: Reconfiguring daemon mon.a on smithi164 2024-03-27T08:24:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:44 smithi173 ceph-mon[35397]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:44 smithi164 ceph-mon[31788]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T08:24:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:44 smithi164 ceph-mon[31788]: Reconfiguring daemon mon.a on smithi164 2024-03-27T08:24:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:44 smithi164 ceph-mon[31788]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:44 smithi167 ceph-mon[34903]: Reconfiguring mon.a (unknown last config time)... 2024-03-27T08:24:44.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:44 smithi167 ceph-mon[34903]: Reconfiguring daemon mon.a on smithi164 2024-03-27T08:24:44.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:44 smithi167 ceph-mon[34903]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:46.298 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.298 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: Reconfiguring mon.b (monmap changed)... 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: Reconfiguring daemon mon.b on smithi167 2024-03-27T08:24:46.299 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:46 smithi167 ceph-mon[34903]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: Reconfiguring mon.b (monmap changed)... 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:46.302 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:46.303 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: Reconfiguring daemon mon.b on smithi167 2024-03-27T08:24:46.303 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:46 smithi173 ceph-mon[35397]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:46.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: Reconfiguring mon.b (monmap changed)... 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: Reconfiguring daemon mon.b on smithi167 2024-03-27T08:24:46.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:46 smithi164 ceph-mon[31788]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:46.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 -- 172.21.15.173:0/1692321086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d20105ab0 msgr2=0x7f4d20105ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:46.610 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 --2- 172.21.15.173:0/1692321086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d20105ab0 0x7f4d20105ed0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f4d14009910 tx=0x7f4d14009c20 comp rx=0 tx=0).stop 2024-03-27T08:24:46.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 -- 172.21.15.173:0/1692321086 shutdown_connections 2024-03-27T08:24:46.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 --2- 172.21.15.173:0/1692321086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d20105ab0 0x7f4d20105ed0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 -- 172.21.15.173:0/1692321086 >> 172.21.15.173:0/1692321086 conn(0x7f4d200ff970 msgr2=0x7f4d20101db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:46.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 -- 172.21.15.173:0/1692321086 shutdown_connections 2024-03-27T08:24:46.611 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.617+0000 7f4d27c00700 1 -- 172.21.15.173:0/1692321086 wait complete. 2024-03-27T08:24:46.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.619+0000 7f4d27c00700 1 Processor -- start 2024-03-27T08:24:46.612 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.619+0000 7f4d27c00700 1 -- start start 2024-03-27T08:24:46.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d20105ab0 0x7f4d20199ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:46.613 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d2019a6a0 0x7f4d201a1800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2010a510 con 0x7f4d2019a6a0 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2010a390 con 0x7f4d20105ab0 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d27c00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4d2010a690 con 0x7f4d2019a220 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d1fe00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d1fe00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:55792/0 (socket says 172.21.15.173:55792) 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d1fe00700 1 -- 172.21.15.173:0/2529011114 learned_addr learned my addr 172.21.15.173:0/2529011114 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d25200700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d20105ab0 0x7f4d20199ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.620+0000 7f4d25c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d2019a6a0 0x7f4d201a1800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 -- 172.21.15.173:0/2529011114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d20105ab0 msgr2=0x7f4d20199ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:46.614 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d20105ab0 0x7f4d20199ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 -- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d2019a6a0 msgr2=0x7f4d201a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:46.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d2019a6a0 0x7f4d201a1800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 -- 172.21.15.173:0/2529011114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d201a2100 con 0x7f4d2019a220 2024-03-27T08:24:46.615 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1fe00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00b780 tx=0x7f4d0c00bb40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c004230 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4d0c0043d0 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d201a23f0 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c011c10 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.621+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d201a2a00 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.623+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d20063c70 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.623+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f4d0c0036a0 con 0x7f4d2019a220 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.623+0000 7f4d1d600700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 0x7f4d0803bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:46.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.623+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f4d0c04c2a0 con 0x7f4d2019a220 2024-03-27T08:24:46.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.624+0000 7f4d25200700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 0x7f4d0803bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:46.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.625+0000 7f4d25200700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 0x7f4d0803bdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005300 tx=0x7f4d140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:46.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.629+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4d0c021e00 con 0x7f4d2019a220 2024-03-27T08:24:46.856 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.863+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi164=x;smithi167=y;smithi173=z", "target": ["mon-mgr", ""]}) -- 0x7f4d20062a80 con 0x7f4d08039900 2024-03-27T08:24:46.870 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.877+0000 7f4d1d600700 1 -- 172.21.15.173:0/2529011114 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4d20062a80 con 0x7f4d08039900 2024-03-27T08:24:46.870 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mgr update... 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 msgr2=0x7f4d0803bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 0x7f4d0803bdc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005300 tx=0x7f4d140058e0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 msgr2=0x7f4d2019f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f4d0c00b780 tx=0x7f4d0c00bb40 comp rx=0 tx=0).stop 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 shutdown_connections 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4d08039900 0x7f4d0803bdc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4d2019a6a0 0x7f4d201a1800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.873 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4d20105ab0 0x7f4d20199ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 --2- 172.21.15.173:0/2529011114 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4d2019a220 0x7f4d2019f250 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:46.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 >> 172.21.15.173:0/2529011114 conn(0x7f4d200ff970 msgr2=0x7f4d20100630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:46.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 shutdown_connections 2024-03-27T08:24:46.874 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:24:46.880+0000 7f4d27c00700 1 -- 172.21.15.173:0/2529011114 wait complete. 2024-03-27T08:24:47.900 DEBUG:teuthology.orchestra.run.smithi167:mgr.y> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.y.service 2024-03-27T08:24:47.908 DEBUG:teuthology.orchestra.run.smithi173:mgr.z> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.z.service 2024-03-27T08:24:47.913 INFO:tasks.cephadm:Deploying OSDs... 2024-03-27T08:24:47.913 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:24:47.913 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T08:24:47.971 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T08:24:47.971 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_1 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 634 Links: 1 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-03-27 08:23:33.382020150 +0000 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-03-27 08:17:41.534987787 +0000 2024-03-27T08:24:48.025 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-03-27 08:17:41.534987787 +0000 2024-03-27T08:24:48.026 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-03-27 08:17:41.534987787 +0000 2024-03-27T08:24:48.026 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T08:24:48.116 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-03-27T08:24:48.116 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-03-27T08:24:48.116 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000321285 s, 1.6 MB/s 2024-03-27T08:24:48.121 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T08:24:48.174 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_2 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 650 Links: 1 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-03-27 08:23:33.464018807 +0000 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-03-27 08:17:42.112978516 +0000 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-03-27 08:17:42.112978516 +0000 2024-03-27T08:24:48.221 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-03-27 08:17:42.112978516 +0000 2024-03-27T08:24:48.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi164=x;smithi167=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: Saving service mgr spec with placement smithi164=x;smithi167=y;smithi173=z;count:3 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: Reconfiguring mon.c (monmap changed)... 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: Reconfiguring daemon mon.c on smithi173 2024-03-27T08:24:48.230 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:47 smithi173 ceph-mon[35397]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi164=x;smithi167=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: Saving service mgr spec with placement smithi164=x;smithi167=y;smithi173=z;count:3 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: Reconfiguring mon.c (monmap changed)... 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: Reconfiguring daemon mon.c on smithi173 2024-03-27T08:24:48.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:47 smithi164 ceph-mon[31788]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='client.24106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi164=x;smithi167=y;smithi173=z", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: Saving service mgr spec with placement smithi164=x;smithi167=y;smithi173=z;count:3 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: Reconfiguring mon.c (monmap changed)... 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: Reconfiguring daemon mon.c on smithi173 2024-03-27T08:24:48.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:47 smithi167 ceph-mon[34903]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:48.348 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-03-27T08:24:48.348 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-03-27T08:24:48.348 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000360438 s, 1.4 MB/s 2024-03-27T08:24:48.353 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T08:24:48.409 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_3 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-03-27 08:23:33.529017743 +0000 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-03-27 08:17:42.696969149 +0000 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-03-27 08:17:42.696969149 +0000 2024-03-27T08:24:48.458 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-03-27 08:17:42.696969149 +0000 2024-03-27T08:24:48.459 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T08:24:48.546 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-03-27T08:24:48.546 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-03-27T08:24:48.546 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000346711 s, 1.5 MB/s 2024-03-27T08:24:48.550 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T08:24:48.606 DEBUG:teuthology.orchestra.run.smithi164:> stat /dev/vg_nvme/lv_4 2024-03-27T08:24:48.654 INFO:teuthology.orchestra.run.smithi164.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T08:24:48.654 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:48.654 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 5h/5d Inode: 688 Links: 1 2024-03-27T08:24:48.654 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:48.655 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:48.655 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-03-27 08:23:33.591016727 +0000 2024-03-27T08:24:48.655 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-03-27 08:17:43.255960183 +0000 2024-03-27T08:24:48.655 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-03-27 08:17:43.255960183 +0000 2024-03-27T08:24:48.655 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: 2024-03-27 08:17:43.255960183 +0000 2024-03-27T08:24:48.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T08:24:48.740 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records in 2024-03-27T08:24:48.741 INFO:teuthology.orchestra.run.smithi164.stderr:1+0 records out 2024-03-27T08:24:48.741 INFO:teuthology.orchestra.run.smithi164.stderr:512 bytes copied, 0.000344024 s, 1.5 MB/s 2024-03-27T08:24:48.745 DEBUG:teuthology.orchestra.run.smithi164:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T08:24:48.799 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-03-27T08:24:48.799 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T08:24:48.857 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T08:24:48.857 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-03-27T08:24:48.907 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 632 Links: 1 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-03-27 08:24:32.232909307 +0000 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-03-27 08:17:41.536580314 +0000 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-03-27 08:17:41.536580314 +0000 2024-03-27T08:24:48.908 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-03-27 08:17:41.536580314 +0000 2024-03-27T08:24:48.908 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T08:24:48.995 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-03-27T08:24:48.995 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-03-27T08:24:48.995 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000373072 s, 1.4 MB/s 2024-03-27T08:24:48.999 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T08:24:49.055 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 652 Links: 1 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-03-27 08:24:32.232909307 +0000 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-03-27 08:17:42.112570249 +0000 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-03-27 08:17:42.112570249 +0000 2024-03-27T08:24:49.105 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-03-27 08:17:42.112570249 +0000 2024-03-27T08:24:49.106 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T08:24:49.194 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-03-27T08:24:49.195 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-03-27T08:24:49.195 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000326308 s, 1.6 MB/s 2024-03-27T08:24:49.199 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T08:24:49.253 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 671 Links: 1 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:49.302 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-03-27 08:24:32.233909290 +0000 2024-03-27T08:24:49.303 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-03-27 08:17:42.683560271 +0000 2024-03-27T08:24:49.303 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-03-27 08:17:42.683560271 +0000 2024-03-27T08:24:49.303 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-03-27 08:17:42.683560271 +0000 2024-03-27T08:24:49.303 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T08:24:49.390 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-03-27T08:24:49.390 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-03-27T08:24:49.390 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.00035734 s, 1.4 MB/s 2024-03-27T08:24:49.394 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T08:24:49.453 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 691 Links: 1 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-03-27 08:24:32.234909272 +0000 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-03-27 08:17:43.266550078 +0000 2024-03-27T08:24:49.501 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-03-27 08:17:43.266550078 +0000 2024-03-27T08:24:49.502 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-03-27 08:17:43.266550078 +0000 2024-03-27T08:24:49.502 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T08:24:49.580 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-03-27T08:24:49.580 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-03-27T08:24:49.581 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000319003 s, 1.6 MB/s 2024-03-27T08:24:49.585 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T08:24:49.638 DEBUG:teuthology.orchestra.run.smithi173:> set -ex 2024-03-27T08:24:49.638 DEBUG:teuthology.orchestra.run.smithi173:> dd if=/scratch_devs of=/dev/stdout 2024-03-27T08:24:49.689 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-27T08:24:49.690 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_1 2024-03-27T08:24:49.738 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 631 Links: 1 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-03-27 08:24:20.754576462 +0000 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-03-27 08:17:50.781853880 +0000 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-03-27 08:17:50.781853880 +0000 2024-03-27T08:24:49.739 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-03-27 08:17:50.781853880 +0000 2024-03-27T08:24:49.739 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-27T08:24:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-03-27T08:24:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-03-27T08:24:49.824 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000331648 s, 1.5 MB/s 2024-03-27T08:24:49.828 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-27T08:24:49.879 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_2 2024-03-27T08:24:49.922 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 653 Links: 1 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-03-27 08:24:20.755576439 +0000 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-03-27 08:17:51.358840825 +0000 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-03-27 08:17:51.358840825 +0000 2024-03-27T08:24:49.923 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-03-27 08:17:51.358840825 +0000 2024-03-27T08:24:49.923 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-27T08:24:50.045 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-03-27T08:24:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-03-27T08:24:50.046 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000333822 s, 1.5 MB/s 2024-03-27T08:24:50.049 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-27T08:24:50.095 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_3 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 672 Links: 1 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-03-27 08:24:20.756576416 +0000 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-03-27 08:17:51.958827249 +0000 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-03-27 08:17:51.958827249 +0000 2024-03-27T08:24:50.179 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-03-27 08:17:51.958827249 +0000 2024-03-27T08:24:50.180 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-27T08:24:50.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-03-27T08:24:50.287 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-03-27T08:24:50.287 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000278545 s, 1.8 MB/s 2024-03-27T08:24:50.291 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-27T08:24:50.334 DEBUG:teuthology.orchestra.run.smithi173:> stat /dev/vg_nvme/lv_4 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Device: 5h/5d Inode: 690 Links: 1 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Context: system_u:object_r:device_t:s0 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Access: 2024-03-27 08:24:20.756576416 +0000 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Modify: 2024-03-27 08:17:52.521814510 +0000 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout:Change: 2024-03-27 08:17:52.521814510 +0000 2024-03-27T08:24:50.424 INFO:teuthology.orchestra.run.smithi173.stdout: Birth: 2024-03-27 08:17:52.521814510 +0000 2024-03-27T08:24:50.425 DEBUG:teuthology.orchestra.run.smithi173:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-27T08:24:50.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.538 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:50 smithi173 ceph-mon[35397]: Deploying daemon mgr.z on smithi173 2024-03-27T08:24:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records in 2024-03-27T08:24:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:1+0 records out 2024-03-27T08:24:50.557 INFO:teuthology.orchestra.run.smithi173.stderr:512 bytes copied, 0.000315537 s, 1.6 MB/s 2024-03-27T08:24:50.560 DEBUG:teuthology.orchestra.run.smithi173:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:50 smithi167 ceph-mon[34903]: Deploying daemon mgr.z on smithi173 2024-03-27T08:24:50.610 INFO:tasks.cephadm:Deploying osd.0 on smithi164 with /dev/vg_nvme/lv_4... 2024-03-27T08:24:50.611 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:50.697 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:50.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:50.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:50 smithi164 ceph-mon[31788]: Deploying daemon mgr.z on smithi173 2024-03-27T08:24:51.044 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:24:52.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:52 smithi164 ceph-mon[31788]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:52 smithi173 ceph-mon[35397]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:52 smithi167 ceph-mon[34903]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:52.899 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:52 smithi173 podman[37254]: 2024-03-27 08:24:52.676847089 +0000 UTC m=+0.173750414 container create 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:24:52.899 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:52 smithi173 podman[37254]: 2024-03-27 08:24:52.905617411 +0000 UTC m=+0.402520776 container init 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-27T08:24:53.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:52 smithi173 podman[37254]: 2024-03-27 08:24:52.915415748 +0000 UTC m=+0.412319079 container start 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:24:53.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:52 smithi173 ceph-mgr[37273]: -- 172.21.15.173:0/295194103 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562d542485a0 con 0x562d5421c800 2024-03-27T08:24:53.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:52 smithi173 bash[37254]: 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 2024-03-27T08:24:53.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:53 smithi173 systemd[1]: Started Ceph mgr.z for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:24:53.724 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T08:24:53.724 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T08:24:53.725 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-03-27T08:24:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-03-27T08:24:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0349163 s, 300 MB/s 2024-03-27T08:24:53.725 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 2024-03-27T08:24:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-03-27T08:24:54.074 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:53.661+0000 7fdfa94d0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T08:24:54.075 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:53.778+0000 7fdfa94d0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T08:24:54.403 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.403 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.403 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:54.403 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.403 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:54.404 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:54.404 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:54.404 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:54.404 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:54 smithi167 ceph-mon[34903]: Deploying daemon mgr.y on smithi167 2024-03-27T08:24:54.466 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.466 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.466 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:54.466 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.466 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:54.467 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:54.467 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:54.467 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:54.467 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:54 smithi164 ceph-mon[31788]: Deploying daemon mgr.y on smithi167 2024-03-27T08:24:54.538 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi164:vg_nvme/lv_4 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:54.558 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-mon[35397]: Deploying daemon mgr.y on smithi167 2024-03-27T08:24:54.825 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:54.564+0000 7fdfa94d0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T08:24:54.825 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:54.683+0000 7fdfa94d0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T08:24:54.973 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:24:55.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:54.856+0000 7fdfa94d0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T08:24:55.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:54.976+0000 7fdfa94d0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T08:24:55.325 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:55.082+0000 7fdfa94d0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T08:24:55.776 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:55.413+0000 7fdfa94d0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T08:24:55.776 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:55.552+0000 7fdfa94d0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T08:24:55.776 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:55.662+0000 7fdfa94d0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T08:24:56.007 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 systemd[1]: Starting Ceph mgr.y for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:24:56.074 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:55.782+0000 7fdfa94d0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T08:24:56.075 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:56.000+0000 7fdfa94d0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T08:24:56.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:56 smithi167 ceph-mon[34903]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:56.444 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:56 smithi164 ceph-mon[31788]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:56.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:56 smithi173 ceph-mon[35397]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:56.628 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 podman[36272]: 2024-03-27 08:24:56.285911724 +0000 UTC m=+0.032060091 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:24:56.629 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 podman[36272]: 2024-03-27 08:24:56.398936134 +0000 UTC m=+0.145084511 container create 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-27T08:24:56.629 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 podman[36272]: 2024-03-27 08:24:56.635965682 +0000 UTC m=+0.382114093 container init 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T08:24:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 -- 172.21.15.164:0/969961465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c105a30 msgr2=0x7f608c107e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 --2- 172.21.15.164:0/969961465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c105a30 0x7f608c107e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f6074009990 tx=0x7f6074009ca0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 -- 172.21.15.164:0/969961465 shutdown_connections 2024-03-27T08:24:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 --2- 172.21.15.164:0/969961465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c108360 0x7f608c10a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 --2- 172.21.15.164:0/969961465 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 0x7f608c1054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 --2- 172.21.15.164:0/969961465 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c105a30 0x7f608c107e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 -- 172.21.15.164:0/969961465 >> 172.21.15.164:0/969961465 conn(0x7f608c0fcb10 msgr2=0x7f608c0fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:24:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 -- 172.21.15.164:0/969961465 shutdown_connections 2024-03-27T08:24:56.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.978+0000 7f6092600700 1 -- 172.21.15.164:0/969961465 wait complete. 2024-03-27T08:24:56.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.979+0000 7f6092600700 1 Processor -- start 2024-03-27T08:24:56.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 -- start start 2024-03-27T08:24:56.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 0x7f608c102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:56.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c105a30 0x7f608c1010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:56.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10e2a0 con 0x7f608c108360 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10e120 con 0x7f608c105a30 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f6092600700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f608c10e420 con 0x7f608c103100 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f608be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f608be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:47960/0 (socket says 172.21.15.164:47960) 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f608be00700 1 -- 172.21.15.164:0/3746198276 learned_addr learned my addr 172.21.15.164:0/3746198276 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.980+0000 7f608b400700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 0x7f608c102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f6083e00700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c105a30 0x7f608c1010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 -- 172.21.15.164:0/3746198276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 msgr2=0x7f608c102a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 0x7f608c102a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 -- 172.21.15.164:0/3746198276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c105a30 msgr2=0x7f608c1010b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:24:56.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c105a30 0x7f608c1010b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:24:56.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 -- 172.21.15.164:0/3746198276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f608c101b30 con 0x7f608c108360 2024-03-27T08:24:56.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f608be00700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f60840094f0 tx=0x7f608400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:56.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.981+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084004db0 con 0x7f608c108360 2024-03-27T08:24:56.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.982+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6084009e20 con 0x7f608c108360 2024-03-27T08:24:56.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.982+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608c101e20 con 0x7f608c108360 2024-03-27T08:24:56.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.982+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6084015400 con 0x7f608c108360 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.982+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608c1a73b0 con 0x7f608c108360 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.983+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 13) ==== 46523+0+0 (secure 0 0 0) 0x7f60840155a0 con 0x7f608c108360 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.983+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f608c069300 con 0x7f608c108360 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.983+0000 7f6088c00700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 0x7f607003bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.983+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f608404c2b0 con 0x7f608c108360 2024-03-27T08:24:56.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.984+0000 7f608b400700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 0x7f607003bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:24:56.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.984+0000 7f608b400700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 0x7f607003bb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f607c005950 tx=0x7f607c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:24:56.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:56.990+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6084010070 con 0x7f608c108360 2024-03-27T08:24:57.068 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 podman[36272]: 2024-03-27 08:24:56.646032258 +0000 UTC m=+0.392180655 container start 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS) 2024-03-27T08:24:57.069 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 ceph-mgr[36291]: -- 172.21.15.167:0/5791805 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5602657385a0 con 0x56026570c800 2024-03-27T08:24:57.069 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 bash[36272]: 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e 2024-03-27T08:24:57.069 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:56 smithi167 systemd[1]: Started Ceph mgr.y for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:24:57.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:24:57.226+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f608c062b40 con 0x7f60700396b0 2024-03-27T08:24:57.574 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:57.291+0000 7fdfa94d0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T08:24:57.574 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:57.467+0000 7fdfa94d0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T08:24:57.818 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:57.424+0000 7f92141bb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-27T08:24:57.819 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:57.548+0000 7f92141bb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:58.248 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:58.249 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.249 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:24:58.249 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:24:58.249 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:58.249 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:24:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:57.910+0000 7fdfa94d0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:58.051+0000 7fdfa94d0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.310 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:58.311 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:24:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='client.14223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:24:58.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:24:58.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:24:58.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:24:58.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:24:58.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:24:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:24:58.575 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:58.316+0000 7fdfa94d0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:24:58.575 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:58.561+0000 7fdfa94d0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T08:24:58.696 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:58.392+0000 7f92141bb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-27T08:24:58.696 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:58.520+0000 7f92141bb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-27T08:24:58.696 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:58.702+0000 7f92141bb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-27T08:24:59.068 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:58.824+0000 7f92141bb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-27T08:24:59.068 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:58.944+0000 7f92141bb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-27T08:24:59.266 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:58.948+0000 7fdfa94d0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:24:59.554 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:59.292+0000 7f92141bb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-27T08:24:59.554 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:59.442+0000 7f92141bb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-27T08:24:59.567 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:59.273+0000 7fdfa94d0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T08:24:59.818 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:59.560+0000 7f92141bb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-27T08:24:59.819 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:59.690+0000 7f92141bb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-27T08:24:59.824 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:24:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:24:59.573+0000 7fdfa94d0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T08:25:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.242 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-mon[35397]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:00 smithi164 ceph-mon[31788]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:00.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:00.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:00 smithi167 ceph-mon[34903]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:00.319 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:24:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:24:59.918+0000 7f92141bb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-27T08:25:01.074 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:25:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:25:00.652+0000 7fdfa94d0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T08:25:01.358 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.358 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:01.358 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:01.358 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:25:01.358 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:25:01.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]: dispatch 2024-03-27T08:25:01.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]': finished 2024-03-27T08:25:01.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T08:25:01.359 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:01.405 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:01.243+0000 7f92141bb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:01.412+0000 7f92141bb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]: dispatch 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]': finished 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T08:25:01.406 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:01.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:01.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]: dispatch 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/615830750' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3ccf9cf4-4550-4d3e-8413-46b4133cb1c0"}]': finished 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: osdmap e5: 1 total, 0 up, 1 in 2024-03-27T08:25:01.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:01.763 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:25:01.364+0000 7fdfa94d0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T08:25:01.763 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:25:01.491+0000 7fdfa94d0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T08:25:02.074 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:25:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z[37269]: 2024-03-27T08:25:01.770+0000 7fdfa94d0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T08:25:02.193 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:01.826+0000 7f92141bb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-27T08:25:02.193 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:01.943+0000 7f92141bb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-27T08:25:02.194 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:02.200+0000 7f92141bb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:25:02.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:02.255+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mgrmap(e 14) ==== 92419+0+0 (secure 0 0 0) 0x7f6084005000 con 0x7f608c108360 2024-03-27T08:25:02.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T08:25:02.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: Reconfiguring daemon mgr.x on smithi164 2024-03-27T08:25:02.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:02.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: Standby manager daemon z started 2024-03-27T08:25:02.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T08:25:02.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:02.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T08:25:02.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:02.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:02 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3722474026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:02.441+0000 7f92141bb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: Reconfiguring daemon mgr.x on smithi164 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: Standby manager daemon z started 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3722474026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: Reconfiguring mgr.x (unknown last config time)... 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: Reconfiguring daemon mgr.x on smithi164 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: pgmap v47: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: Standby manager daemon z started 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.173:0/2785140296' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:02.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:02 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3722474026' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:03.068 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:02 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:02.808+0000 7f92141bb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-27T08:25:03.424 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:03.126+0000 7f92141bb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-27T08:25:03.425 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:03 smithi167 ceph-mon[34903]: mgrmap e14: x(active, since 105s), standbys: z 2024-03-27T08:25:03.425 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:03 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T08:25:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:03 smithi164 ceph-mon[31788]: mgrmap e14: x(active, since 105s), standbys: z 2024-03-27T08:25:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:03 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T08:25:03.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:03 smithi173 ceph-mon[35397]: mgrmap e14: x(active, since 105s), standbys: z 2024-03-27T08:25:03.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:03 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-03-27T08:25:03.818 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:03.432+0000 7f92141bb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-27T08:25:04.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:04 smithi164 ceph-mon[31788]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:04.568 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:04.444+0000 7f92141bb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-27T08:25:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:04 smithi167 ceph-mon[34903]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:04.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:04 smithi173 ceph-mon[35397]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:05.542 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:05.137+0000 7f92141bb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-27T08:25:05.543 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:05.267+0000 7f92141bb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-27T08:25:05.818 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:25:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y[36287]: 2024-03-27T08:25:05.550+0000 7f92141bb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-27T08:25:06.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:06.253+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mon.0 v2:172.21.15.164:3300/0 8 ==== mgrmap(e 15) ==== 138315+0+0 (secure 0 0 0) 0x7f6084012480 con 0x7f608c108360 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: Standby manager daemon y started 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T08:25:06.484 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:06 smithi164 ceph-mon[31788]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: Standby manager daemon y started 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T08:25:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:06 smithi167 ceph-mon[34903]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:06.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: Standby manager daemon y started 2024-03-27T08:25:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-03-27T08:25:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-27T08:25:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-03-27T08:25:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:06 smithi173 ceph-mon[35397]: from='mgr.? 172.21.15.167:0/2516647173' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-27T08:25:07.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:07 smithi167 ceph-mon[34903]: mgrmap e15: x(active, since 109s), standbys: z, y 2024-03-27T08:25:07.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T08:25:07.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:07 smithi173 ceph-mon[35397]: mgrmap e15: x(active, since 109s), standbys: z, y 2024-03-27T08:25:07.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T08:25:07.640 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:07 smithi164 ceph-mon[31788]: mgrmap e15: x(active, since 109s), standbys: z, y 2024-03-27T08:25:07.641 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-03-27T08:25:08.260 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:08 smithi164 ceph-mon[31788]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:08.261 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.261 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.261 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:08 smithi167 ceph-mon[34903]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:08 smithi173 ceph-mon[35397]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:08.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:09.565 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:09 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:09.566 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:09 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:09.566 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:09 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:09.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:09 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:09.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:09 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:09.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:09 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:09.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:09 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:09.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:09 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:09.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:09 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:10.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:10 smithi167 ceph-mon[34903]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:10.407 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:10 smithi164 ceph-mon[31788]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:10.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:10 smithi173 ceph-mon[35397]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:11.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T08:25:11.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:11.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T08:25:11.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:11.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-27T08:25:11.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:12.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:12 smithi164 ceph-mon[31788]: Deploying daemon osd.0 on smithi164 2024-03-27T08:25:12.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:12 smithi164 ceph-mon[31788]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:12.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:12 smithi167 ceph-mon[34903]: Deploying daemon osd.0 on smithi164 2024-03-27T08:25:12.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:12 smithi167 ceph-mon[34903]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:12.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:12 smithi173 ceph-mon[35397]: Deploying daemon osd.0 on smithi164 2024-03-27T08:25:12.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:12 smithi173 ceph-mon[35397]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:14.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:14 smithi164 ceph-mon[31788]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:14.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:14 smithi167 ceph-mon[34903]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:14.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:14 smithi173 ceph-mon[35397]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:16 smithi167 ceph-mon[34903]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:16.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:16 smithi173 ceph-mon[35397]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:16.584 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:16 smithi164 ceph-mon[31788]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:18.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:18 smithi167 ceph-mon[34903]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:18.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:18 smithi173 ceph-mon[35397]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:18.673 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:18 smithi164 ceph-mon[31788]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:20.417 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:20 smithi164 ceph-mon[31788]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:20.418 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.418 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.418 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:20 smithi167 ceph-mon[34903]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:20.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:20 smithi173 ceph-mon[35397]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:22.459 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:22 smithi164 ceph-mon[31788]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:22.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:22 smithi167 ceph-mon[34903]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:22.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:22 smithi173 ceph-mon[35397]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T08:25:23.897 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:23 smithi164 ceph-mon[31788]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:23.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:23.998+0000 7f6088c00700 1 -- 172.21.15.164:0/3746198276 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f608c062b40 con 0x7f60700396b0 2024-03-27T08:25:23.991 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 0 on host 'smithi164' 2024-03-27T08:25:23.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 msgr2=0x7f607003bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 0x7f607003bb70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f607c005950 tx=0x7f607c00b410 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 msgr2=0x7f608c1015f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f60840094f0 tx=0x7f608400d3b0 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 shutdown_connections 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f60700396b0 0x7f607003bb70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f608c108360 0x7f608c1015f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f608c103100 0x7f608c102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 --2- 172.21.15.164:0/3746198276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f608c105a30 0x7f608c1010b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:23.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.002+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 >> 172.21.15.164:0/3746198276 conn(0x7f608c0fcb10 msgr2=0x7f608c103be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:25:23.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.003+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 shutdown_connections 2024-03-27T08:25:23.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:25:24.003+0000 7f6092600700 1 -- 172.21.15.164:0/3746198276 wait complete. 2024-03-27T08:25:24.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:24.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:24.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T08:25:24.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:23 smithi167 ceph-mon[34903]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:24.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-27T08:25:24.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:23 smithi173 ceph-mon[35397]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:24.674 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:24.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:24.733 DEBUG:teuthology.orchestra.run.smithi164:osd.0> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.0.service 2024-03-27T08:25:24.737 INFO:tasks.cephadm:Deploying osd.1 on smithi167 with /dev/vg_nvme/lv_4... 2024-03-27T08:25:24.738 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T08:25:25.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:25.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:25.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: osdmap e6: 1 total, 0 up, 1 in 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:25.191 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:25:25.916 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-mon[31788]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:25:25.916 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-mon[31788]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T08:25:25.917 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:25.917 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:25.917 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-mon[31788]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:25.917 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0[46796]: 2024-03-27T08:25:25.632+0000 7f987de00700 -1 osd.0 0 waiting for initial osdmap 2024-03-27T08:25:25.917 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:25:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0[46796]: 2024-03-27T08:25:25.673+0000 7f9873c00700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:25:26.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:25 smithi167 ceph-mon[34903]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:25:26.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:25 smithi167 ceph-mon[34903]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T08:25:26.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:25 smithi167 ceph-mon[34903]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:26.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:25 smithi173 ceph-mon[35397]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:25:26.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:25 smithi173 ceph-mon[35397]: osdmap e7: 1 total, 0 up, 1 in 2024-03-27T08:25:26.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:25 smithi173 ceph-mon[35397]: pgmap v61: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:26.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:26 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:25:26.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:26 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:25:26.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.699 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:26 smithi164 ceph-mon[31788]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' 2024-03-27T08:25:26.699 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.791 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:26 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:25:26.791 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:26 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:25:26.791 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:26.791 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:26 smithi167 ceph-mon[34903]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' 2024-03-27T08:25:26.791 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:27.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:26 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:25:27.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:26 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:25:27.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:27.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:26 smithi173 ceph-mon[35397]: from='osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757]' entity='osd.0' 2024-03-27T08:25:27.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:27 smithi164 ceph-mon[31788]: osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] boot 2024-03-27T08:25:28.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:27 smithi164 ceph-mon[31788]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T08:25:28.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:28.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:27 smithi164 ceph-mon[31788]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:28.005 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T08:25:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T08:25:28.006 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-03-27T08:25:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-03-27T08:25:28.006 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0328649 s, 319 MB/s 2024-03-27T08:25:28.006 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-03-27T08:25:28.006 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:27 smithi167 ceph-mon[34903]: osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] boot 2024-03-27T08:25:28.006 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:27 smithi167 ceph-mon[34903]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T08:25:28.006 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:27 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:28.006 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:27 smithi167 ceph-mon[34903]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:28.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:27 smithi173 ceph-mon[35397]: osd.0 [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] boot 2024-03-27T08:25:28.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:27 smithi173 ceph-mon[35397]: osdmap e8: 1 total, 1 up, 1 in 2024-03-27T08:25:28.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-27T08:25:28.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:27 smithi173 ceph-mon[35397]: pgmap v63: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-27T08:25:28.774 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:28 smithi167 ceph-mon[34903]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T08:25:28.829 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-03-27T08:25:29.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:28 smithi164 ceph-mon[31788]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T08:25:29.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:28 smithi173 ceph-mon[35397]: osdmap e9: 1 total, 1 up, 1 in 2024-03-27T08:25:29.257 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi164 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:25:30.389 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi164 to 17091M 2024-03-27T08:25:30.390 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.390 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:30.390 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:30.390 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi164 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi164 to 17091M 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:30.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi164 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi164 to 17091M 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 -- 172.21.15.167:0/4044348037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48108360 msgr2=0x7fdc4810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:31.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 --2- 172.21.15.167:0/4044348037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48108360 0x7fdc4810a7d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fdc4000b0a0 tx=0x7fdc4000b3b0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 -- 172.21.15.167:0/4044348037 shutdown_connections 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 --2- 172.21.15.167:0/4044348037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48108360 0x7fdc4810a7d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 --2- 172.21.15.167:0/4044348037 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48103100 0x7fdc481054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 --2- 172.21.15.167:0/4044348037 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 0x7fdc48107e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 -- 172.21.15.167:0/4044348037 >> 172.21.15.167:0/4044348037 conn(0x7fdc480fcb10 msgr2=0x7fdc480fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 -- 172.21.15.167:0/4044348037 shutdown_connections 2024-03-27T08:25:31.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.168+0000 7fdc4d000700 1 -- 172.21.15.167:0/4044348037 wait complete. 2024-03-27T08:25:31.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.169+0000 7fdc4d000700 1 Processor -- start 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 -- start start 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 0x7fdc4819afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48108360 0x7fdc481a2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4810e2a0 con 0x7fdc48105a30 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4810e120 con 0x7fdc48103100 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc4d000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdc4810e420 con 0x7fdc48108360 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc45e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc45e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:60382/0 (socket says 172.21.15.167:60382) 2024-03-27T08:25:31.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.170+0000 7fdc45e00700 1 -- 172.21.15.167:0/3219016352 learned_addr learned my addr 172.21.15.167:0/3219016352 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc3d400700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 0x7fdc4819afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc46800700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48108360 0x7fdc481a2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 -- 172.21.15.167:0/3219016352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48108360 msgr2=0x7fdc481a2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48108360 0x7fdc481a2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 -- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 msgr2=0x7fdc4819afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 0x7fdc4819afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 -- 172.21.15.167:0/3219016352 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc481a2700 con 0x7fdc48103100 2024-03-27T08:25:31.165 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc45e00700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c970 tx=0x7fdc3800cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38007aa0 con 0x7fdc48103100 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc38004d00 con 0x7fdc48103100 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc3800f450 con 0x7fdc48103100 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.171+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc481a29f0 con 0x7fdc48103100 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.172+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc481a2ee0 con 0x7fdc48103100 2024-03-27T08:25:31.166 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.173+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc48069300 con 0x7fdc48103100 2024-03-27T08:25:31.167 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.175+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) ==== 138315+0+0 (secure 0 0 0) 0x7fdc38004750 con 0x7fdc48103100 2024-03-27T08:25:31.168 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.176+0000 7fdc3f400700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 0x7fdc2c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:25:31.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.176+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7fdc380ce4f0 con 0x7fdc48103100 2024-03-27T08:25:31.169 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.177+0000 7fdc3d400700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 0x7fdc2c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:25:31.170 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.177+0000 7fdc3d400700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 0x7fdc2c0a5ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc30005950 tx=0x7fdc300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:25:31.172 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.180+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdc3809cb20 con 0x7fdc48103100 2024-03-27T08:25:31.406 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:31.413+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fdc48062a80 con 0x7fdc2c0a3610 2024-03-27T08:25:32.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:32 smithi167 ceph-mon[34903]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:32.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:32 smithi167 ceph-mon[34903]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:25:32.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:25:32.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:25:32.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:32.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:32 smithi173 ceph-mon[35397]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:32.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:32 smithi173 ceph-mon[35397]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:25:32.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:25:32.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:25:32.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:32 smithi164 ceph-mon[31788]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:32 smithi164 ceph-mon[31788]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:25:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:25:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:25:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:34.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:34 smithi167 ceph-mon[34903]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:34.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:34 smithi173 ceph-mon[35397]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:34 smithi164 ceph-mon[31788]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:35.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:35 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/2704957539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:35 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:35 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]': finished 2024-03-27T08:25:35.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:35 smithi167 ceph-mon[34903]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T08:25:35.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:35.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:35 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/2704957539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:35 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:35 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]': finished 2024-03-27T08:25:35.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:35 smithi173 ceph-mon[35397]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T08:25:35.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:35.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:35 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/2704957539' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:35 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]: dispatch 2024-03-27T08:25:35.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:35 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "25fb7622-4173-476f-80d4-897c9b42bf16"}]': finished 2024-03-27T08:25:35.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:35 smithi164 ceph-mon[31788]: osdmap e10: 2 total, 1 up, 2 in 2024-03-27T08:25:35.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:36.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:36 smithi173 ceph-mon[35397]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:36.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:36 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/457593259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:36.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:36 smithi164 ceph-mon[31788]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:36.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:36 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/457593259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:36.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:36 smithi167 ceph-mon[34903]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:36.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:36 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/457593259' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:25:38.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:38 smithi164 ceph-mon[31788]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:38.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:38 smithi167 ceph-mon[34903]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:38.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:38 smithi173 ceph-mon[35397]: pgmap v70: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:40.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:40 smithi167 ceph-mon[34903]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:40.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:40 smithi173 ceph-mon[35397]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:40.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:40 smithi164 ceph-mon[31788]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:42.437 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:42 smithi167 ceph-mon[34903]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:42.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:42 smithi173 ceph-mon[35397]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:42 smithi164 ceph-mon[31788]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:44 smithi167 ceph-mon[34903]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T08:25:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:44 smithi173 ceph-mon[35397]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T08:25:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:44 smithi164 ceph-mon[31788]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-27T08:25:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:45.463 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:45 smithi167 ceph-mon[34903]: Deploying daemon osd.1 on smithi167 2024-03-27T08:25:45.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:45 smithi164 ceph-mon[31788]: Deploying daemon osd.1 on smithi167 2024-03-27T08:25:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:45 smithi173 ceph-mon[35397]: Deploying daemon osd.1 on smithi167 2024-03-27T08:25:46.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:46 smithi167 ceph-mon[34903]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:46.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:46 smithi164 ceph-mon[31788]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:46 smithi173 ceph-mon[35397]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:48.706 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:48 smithi167 ceph-mon[34903]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:48 smithi164 ceph-mon[31788]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:48.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:48 smithi173 ceph-mon[35397]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:50.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:50 smithi167 ceph-mon[34903]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:50.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:50 smithi164 ceph-mon[31788]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:50 smithi173 ceph-mon[35397]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:52.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:52 smithi164 ceph-mon[31788]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:52.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:52.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:52 smithi167 ceph-mon[34903]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:52.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:52.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:52.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:52 smithi173 ceph-mon[35397]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:52.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:54.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:54 smithi167 ceph-mon[34903]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:54 smithi164 ceph-mon[31788]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:54.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:54 smithi173 ceph-mon[35397]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:56.241 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:56 smithi167 ceph-mon[34903]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:56.364 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.371+0000 7fdc3f400700 1 -- 172.21.15.167:0/3219016352 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fdc48062a80 con 0x7fdc2c0a3610 2024-03-27T08:25:56.365 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 1 on host 'smithi167' 2024-03-27T08:25:56.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.374+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 msgr2=0x7fdc2c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:56.367 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.374+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 0x7fdc2c0a5ad0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdc30005950 tx=0x7fdc300058e0 comp rx=0 tx=0).stop 2024-03-27T08:25:56.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 msgr2=0x7fdc4819aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:25:56.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c970 tx=0x7fdc3800cd30 comp rx=0 tx=0).stop 2024-03-27T08:25:56.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 shutdown_connections 2024-03-27T08:25:56.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc2c0a3610 0x7fdc2c0a5ad0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:56.368 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc48108360 0x7fdc481a2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:56.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc48103100 0x7fdc4819aaa0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:56.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 --2- 172.21.15.167:0/3219016352 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc48105a30 0x7fdc4819afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:25:56.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 >> 172.21.15.167:0/3219016352 conn(0x7fdc480fcb10 msgr2=0x7fdc48102820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:25:56.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 shutdown_connections 2024-03-27T08:25:56.369 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:25:56.375+0000 7fdc4d000700 1 -- 172.21.15.167:0/3219016352 wait complete. 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:56 smithi164 ceph-mon[31788]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:56 smithi173 ceph-mon[35397]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-27T08:25:57.179 DEBUG:teuthology.orchestra.run.smithi167:osd.1> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.1.service 2024-03-27T08:25:57.184 INFO:tasks.cephadm:Deploying osd.2 on smithi173 with /dev/vg_nvme/lv_4... 2024-03-27T08:25:57.185 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-27T08:25:57.408 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T08:25:57.408 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T08:25:57.408 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:57.409 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.409 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.409 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.409 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.409 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.445 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:57.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-27T08:25:57.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: osdmap e11: 2 total, 1 up, 2 in 2024-03-27T08:25:57.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:57.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:25:57.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:25:57.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:25:57.632 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:25:58.422 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-mon[34903]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:25:58.422 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-mon[34903]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T08:25:58.422 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.422 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.422 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-mon[34903]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:58.423 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1[39514]: 2024-03-27T08:25:58.146+0000 7facfb000700 -1 osd.1 0 waiting for initial osdmap 2024-03-27T08:25:58.423 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:25:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1[39514]: 2024-03-27T08:25:58.179+0000 7facf0e00700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:25:58.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:58 smithi164 ceph-mon[31788]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:25:58.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:58 smithi164 ceph-mon[31788]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T08:25:58.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:58 smithi164 ceph-mon[31788]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:58.551 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:58 smithi173 ceph-mon[35397]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:25:58.551 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:58 smithi173 ceph-mon[35397]: osdmap e12: 2 total, 1 up, 2 in 2024-03-27T08:25:58.551 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.551 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:58.551 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:58 smithi173 ceph-mon[35397]: pgmap v82: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:25:59.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:59 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:25:59.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:59 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:25:59.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:59 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:59.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:25:59 smithi167 ceph-mon[34903]: from='osd.1 ' entity='osd.1' 2024-03-27T08:25:59.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:59 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:25:59.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:59 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:25:59.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:59 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:59.458 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:25:59 smithi173 ceph-mon[35397]: from='osd.1 ' entity='osd.1' 2024-03-27T08:25:59.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:59 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:25:59.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:59 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:25:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:59 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:25:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:25:59 smithi164 ceph-mon[31788]: from='osd.1 ' entity='osd.1' 2024-03-27T08:26:00.309 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-27T08:26:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-27T08:26:00.310 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-03-27T08:26:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-03-27T08:26:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.036515 s, 287 MB/s 2024-03-27T08:26:00.310 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-03-27T08:26:00.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:00 smithi164 ceph-mon[31788]: osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] boot 2024-03-27T08:26:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:00 smithi164 ceph-mon[31788]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T08:26:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:00 smithi164 ceph-mon[31788]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:26:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:00 smithi167 ceph-mon[34903]: osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] boot 2024-03-27T08:26:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:00 smithi167 ceph-mon[34903]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T08:26:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:00 smithi167 ceph-mon[34903]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:26:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:00 smithi173 ceph-mon[35397]: osd.1 [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] boot 2024-03-27T08:26:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:00 smithi173 ceph-mon[35397]: osdmap e13: 2 total, 2 up, 2 in 2024-03-27T08:26:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-27T08:26:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:00 smithi173 ceph-mon[35397]: pgmap v84: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-03-27T08:26:01.080 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_4 2024-03-27T08:26:01.273 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:01 smithi167 ceph-mon[34903]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T08:26:01.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:01 smithi173 ceph-mon[35397]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T08:26:01.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:01 smithi164 ceph-mon[31788]: osdmap e14: 2 total, 2 up, 2 in 2024-03-27T08:26:01.512 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:26:02.689 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi167 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi167 to 17091M 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:02.690 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi167 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi167 to 17091M 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: pgmap v86: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi167 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:02.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi167 to 17091M 2024-03-27T08:26:02.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:02.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:02.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:02.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 -- 172.21.15.173:0/3278859170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe601048c0 msgr2=0x7efe60104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 --2- 172.21.15.173:0/3278859170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe601048c0 0x7efe60104ce0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7efe48009990 tx=0x7efe48009ca0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 -- 172.21.15.173:0/3278859170 shutdown_connections 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 --2- 172.21.15.173:0/3278859170 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe6010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 --2- 172.21.15.173:0/3278859170 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe601048c0 0x7efe60104ce0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 --2- 172.21.15.173:0/3278859170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe60105ac0 0x7efe60105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.623+0000 7efe67600700 1 -- 172.21.15.173:0/3278859170 >> 172.21.15.173:0/3278859170 conn(0x7efe600ffe60 msgr2=0x7efe601022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.624+0000 7efe67600700 1 -- 172.21.15.173:0/3278859170 shutdown_connections 2024-03-27T08:26:03.616 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.624+0000 7efe67600700 1 -- 172.21.15.173:0/3278859170 wait complete. 2024-03-27T08:26:03.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.625+0000 7efe67600700 1 Processor -- start 2024-03-27T08:26:03.617 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.625+0000 7efe67600700 1 -- start start 2024-03-27T08:26:03.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe601048c0 0x7efe6019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:03.619 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe601a2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efe601104c0 con 0x7efe60106460 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe60110340 con 0x7efe601048c0 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe67600700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efe60110640 con 0x7efe60105ac0 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe57e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe57e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:40806/0 (socket says 172.21.15.173:40806) 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe57e00700 1 -- 172.21.15.173:0/99551533 learned_addr learned my addr 172.21.15.173:0/99551533 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:26:03.620 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe64c00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe601048c0 0x7efe6019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.626+0000 7efe65600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe601a2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 -- 172.21.15.173:0/99551533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe601048c0 msgr2=0x7efe6019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe601048c0 0x7efe6019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 -- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 msgr2=0x7efe601a2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe601a2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 -- 172.21.15.173:0/99551533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe601a27a0 con 0x7efe60105ac0 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe65600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe601a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe57e00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d980 tx=0x7efe5000dd40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe50016070 con 0x7efe60105ac0 2024-03-27T08:26:03.621 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efe50009b40 con 0x7efe60105ac0 2024-03-27T08:26:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe601a2a90 con 0x7efe60105ac0 2024-03-27T08:26:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe5000f3c0 con 0x7efe60105ac0 2024-03-27T08:26:03.622 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.627+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe601a3020 con 0x7efe60105ac0 2024-03-27T08:26:03.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.629+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe60069300 con 0x7efe60105ac0 2024-03-27T08:26:03.623 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.631+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 15) ==== 138315+0+0 (secure 0 0 0) 0x7efe50019070 con 0x7efe60105ac0 2024-03-27T08:26:03.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.633+0000 7efe5e000700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 0x7efe400a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:03.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.633+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7efe500ce060 con 0x7efe60105ac0 2024-03-27T08:26:03.625 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.634+0000 7efe64c00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 0x7efe400a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:03.626 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.635+0000 7efe64c00700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 0x7efe400a5b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe480039c0 tx=0x7efe480058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:26:03.628 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.637+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7efe5009c3e0 con 0x7efe60105ac0 2024-03-27T08:26:03.861 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:03.870+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7efe60062a80 con 0x7efe400a3690 2024-03-27T08:26:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:04 smithi164 ceph-mon[31788]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:04.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:04 smithi173 ceph-mon[35397]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:04.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:04.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:04.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:04 smithi167 ceph-mon[34903]: pgmap v87: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:05.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:05 smithi173 ceph-mon[35397]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:05 smithi164 ceph-mon[31788]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:05.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:05 smithi167 ceph-mon[34903]: from='client.24154 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:06.527 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:06 smithi173 ceph-mon[35397]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:06 smithi164 ceph-mon[31788]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:06 smithi167 ceph-mon[34903]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/407092143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]': finished 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T08:26:08.622 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/407092143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]': finished 2024-03-27T08:26:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T08:26:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/407092143' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]: dispatch 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c67b96cb-ba02-41dc-a4f6-6887b490de1a"}]': finished 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: osdmap e15: 3 total, 2 up, 3 in 2024-03-27T08:26:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:09.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:09 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/3810937528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:09.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:09 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/3810937528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:09.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:09 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/3810937528' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:10.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:10 smithi164 ceph-mon[31788]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:10 smithi167 ceph-mon[34903]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:10 smithi173 ceph-mon[35397]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:12 smithi164 ceph-mon[31788]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:12 smithi167 ceph-mon[34903]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:12 smithi173 ceph-mon[35397]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:14.525 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:14 smithi173 ceph-mon[35397]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:14 smithi164 ceph-mon[31788]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:14 smithi167 ceph-mon[34903]: pgmap v93: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:16 smithi164 ceph-mon[31788]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:16.808 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:16 smithi173 ceph-mon[35397]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:16 smithi167 ceph-mon[34903]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:17.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T08:26:17.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T08:26:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-27T08:26:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:18.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:18 smithi173 ceph-mon[35397]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:18.555 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:18 smithi173 ceph-mon[35397]: Deploying daemon osd.2 on smithi173 2024-03-27T08:26:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:18 smithi164 ceph-mon[31788]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:18 smithi164 ceph-mon[31788]: Deploying daemon osd.2 on smithi173 2024-03-27T08:26:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:18 smithi167 ceph-mon[34903]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:18 smithi167 ceph-mon[34903]: Deploying daemon osd.2 on smithi173 2024-03-27T08:26:20.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:20 smithi164 ceph-mon[31788]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:20 smithi167 ceph-mon[34903]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:20 smithi173 ceph-mon[35397]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:22.564 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:22 smithi173 ceph-mon[35397]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:22 smithi164 ceph-mon[31788]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:22 smithi167 ceph-mon[34903]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:24 smithi164 ceph-mon[31788]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:24 smithi167 ceph-mon[34903]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:24 smithi173 ceph-mon[35397]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:26.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:26 smithi173 ceph-mon[35397]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:26.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:26 smithi164 ceph-mon[31788]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:26 smithi167 ceph-mon[34903]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:28.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:28 smithi173 ceph-mon[35397]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:28.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:28 smithi164 ceph-mon[31788]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:28.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:28 smithi167 ceph-mon[34903]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:29.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:29 smithi173 ceph-mon[35397]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:29.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:29 smithi173 ceph-mon[35397]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:29.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:29 smithi164 ceph-mon[31788]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:29.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:29 smithi164 ceph-mon[31788]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:29 smithi167 ceph-mon[34903]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:29 smithi167 ceph-mon[34903]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-27T08:26:30.647 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 2 on host 'smithi173' 2024-03-27T08:26:30.647 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.652+0000 7efe5e000700 1 -- 172.21.15.173:0/99551533 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7efe60062a80 con 0x7efe400a3690 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.656+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 msgr2=0x7efe400a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.656+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 0x7efe400a5b50 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7efe480039c0 tx=0x7efe480058e0 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 msgr2=0x7efe6019b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7efe5000d980 tx=0x7efe5000dd40 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 shutdown_connections 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe400a3690 0x7efe400a5b50 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efe60106460 0x7efe601a2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe601048c0 0x7efe6019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 --2- 172.21.15.173:0/99551533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efe60105ac0 0x7efe6019b080 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:30.650 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 >> 172.21.15.173:0/99551533 conn(0x7efe600ffe60 msgr2=0x7efe60108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:26:30.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 shutdown_connections 2024-03-27T08:26:30.651 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:26:30.657+0000 7efe67600700 1 -- 172.21.15.173:0/99551533 wait complete. 2024-03-27T08:26:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:30.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: osdmap e16: 3 total, 2 up, 3 in 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:26:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.458 DEBUG:teuthology.orchestra.run.smithi173:osd.2> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.2.service 2024-03-27T08:26:31.463 INFO:tasks.cephadm:Deploying osd.3 on smithi164 with /dev/vg_nvme/lv_3... 2024-03-27T08:26:31.463 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T08:26:31.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:26:31.707 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T08:26:31.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:31.708 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:31.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: osdmap e17: 3 total, 2 up, 3 in 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:26:31.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:31.897 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:26:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:26:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:26:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] boot 2024-03-27T08:26:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T08:26:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] boot 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T08:26:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: osd.2 [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] boot 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: osdmap e18: 3 total, 3 up, 3 in 2024-03-27T08:26:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-27T08:26:33.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:33 smithi164 ceph-mon[31788]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T08:26:33.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:33 smithi164 ceph-mon[31788]: pgmap v107: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:33.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:33 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:33 smithi173 ceph-mon[35397]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T08:26:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:33 smithi173 ceph-mon[35397]: pgmap v107: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:33 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:34.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:33 smithi167 ceph-mon[34903]: osdmap e19: 3 total, 3 up, 3 in 2024-03-27T08:26:34.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:33 smithi167 ceph-mon[34903]: pgmap v107: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:34.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0666586 s, 157 MB/s 2024-03-27T08:26:34.729 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-03-27T08:26:34.920 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:34.920 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:34 smithi164 ceph-mon[31788]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T08:26:34.920 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:34 smithi167 ceph-mon[34903]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T08:26:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:35.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:35.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:34 smithi173 ceph-mon[35397]: osdmap e20: 3 total, 3 up, 3 in 2024-03-27T08:26:35.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-27T08:26:35.255 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51328]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:35.255 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51328]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.255 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51328]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51328]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51331]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:35.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51331]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51331]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:26:34 smithi164 sudo[51331]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.355 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44350]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:35.355 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44350]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.355 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44350]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.355 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44350]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43276]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43276]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43276]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43276]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43279]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43279]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43279]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.569 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43279]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44360]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:35.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44360]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44360]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.626 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44360]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44353]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:35.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44353]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44353]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.627 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44353]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51336]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51336]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51336]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51336]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51339]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51339]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51339]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 sudo[51339]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.706 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi164:vg_nvme/lv_3 2024-03-27T08:26:35.884 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44363]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:35.884 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44363]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:35.884 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44363]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 sudo[44363]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:35.885 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:35.886 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:35 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:35 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43282]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43282]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43282]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43282]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43285]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43285]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43285]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 sudo[43285]: pam_unix(sudo:session): session closed for user root 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: osdmap e21: 3 total, 3 up, 3 in 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-03-27T08:26:36.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:35 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-03-27T08:26:36.150 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:26:37.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:37.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: osdmap e22: 3 total, 3 up, 3 in 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi173 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi173 to 17091M 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:36 smithi164 ceph-mon[31788]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: osdmap e22: 3 total, 3 up, 3 in 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi173 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi173 to 17091M 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:36 smithi167 ceph-mon[34903]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: osdmap e22: 3 total, 3 up, 3 in 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi173 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi173 to 17091M 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:26:37.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:36 smithi173 ceph-mon[35397]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-03-27T08:26:38.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:37 smithi164 ceph-mon[31788]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:38.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:37 smithi167 ceph-mon[34903]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:38.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:37 smithi173 ceph-mon[35397]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 88 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 -- 172.21.15.164:0/2421375672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c1048c0 msgr2=0x7f8e7c104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 --2- 172.21.15.164:0/2421375672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c104ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e700099c0 tx=0x7f8e70009cd0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 -- 172.21.15.164:0/2421375672 shutdown_connections 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 --2- 172.21.15.164:0/2421375672 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c106460 0x7f8e7c10cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 --2- 172.21.15.164:0/2421375672 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c104ce0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 --2- 172.21.15.164:0/2421375672 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 0x7f8e7c105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 -- 172.21.15.164:0/2421375672 >> 172.21.15.164:0/2421375672 conn(0x7f8e7c0ffe60 msgr2=0x7f8e7c1022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:26:38.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 -- 172.21.15.164:0/2421375672 shutdown_connections 2024-03-27T08:26:38.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.221+0000 7f8e84000700 1 -- 172.21.15.164:0/2421375672 wait complete. 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 Processor -- start 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 -- start start 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 0x7f8e7c19af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c110470 con 0x7f8e7c106460 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c1102f0 con 0x7f8e7c1048c0 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.223+0000 7f8e84000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e7c1105f0 con 0x7f8e7c105ac0 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32902/0 (socket says 172.21.15.164:32902) 2024-03-27T08:26:38.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 -- 172.21.15.164:0/1089929221 learned_addr learned my addr 172.21.15.164:0/1089929221 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:26:38.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e81600700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:38.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e80c00700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 0x7f8e7c19af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 -- 172.21.15.164:0/1089929221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 msgr2=0x7f8e7c19af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 0x7f8e7c19af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 -- 172.21.15.164:0/1089929221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c1048c0 msgr2=0x7f8e7c19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c19aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 -- 172.21.15.164:0/1089929221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e7c1a2660 con 0x7f8e7c106460 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.224+0000 7f8e82000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e74007f10 tx=0x7f8e7400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.225+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e74004bb0 con 0x7f8e7c106460 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.225+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8e74004d50 con 0x7f8e7c106460 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.225+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e7c1a2950 con 0x7f8e7c106460 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.225+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e740133f0 con 0x7f8e7c106460 2024-03-27T08:26:38.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.225+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e7c1a2e90 con 0x7f8e7c106460 2024-03-27T08:26:38.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.226+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e7c069300 con 0x7f8e7c106460 2024-03-27T08:26:38.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.228+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f8e7401a020 con 0x7f8e7c106460 2024-03-27T08:26:38.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.229+0000 7f8e7a000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 0x7f8e640a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:26:38.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.229+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3237+0+0 (secure 0 0 0) 0x7f8e740ce860 con 0x7f8e7c106460 2024-03-27T08:26:38.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.230+0000 7f8e81600700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 0x7f8e640a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:26:38.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.230+0000 7f8e81600700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 0x7f8e640a5be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000b580 tx=0x7f8e70005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:26:38.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.233+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8e74010070 con 0x7f8e7c106460 2024-03-27T08:26:38.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:26:38.465+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8e7c062a80 con 0x7f8e640a3720 2024-03-27T08:26:39.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:38 smithi167 ceph-mon[34903]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:39.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:39.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:39.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:39.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:38 smithi173 ceph-mon[35397]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:39.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:39.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:39.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:39.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:38 smithi164 ceph-mon[31788]: from='client.14292 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:26:39.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:26:39.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:26:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:40.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:39 smithi164 ceph-mon[31788]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:39 smithi167 ceph-mon[34903]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:40.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:39 smithi173 ceph-mon[35397]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:42.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:42 smithi164 ceph-mon[31788]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-03-27T08:26:42.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:42 smithi167 ceph-mon[34903]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-03-27T08:26:42.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:42 smithi173 ceph-mon[35397]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 4.5 KiB/s rd, 218 KiB/s wr, 14 op/s 2024-03-27T08:26:43.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]: dispatch 2024-03-27T08:26:43.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]': finished 2024-03-27T08:26:43.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:43 smithi164 ceph-mon[31788]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T08:26:43.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:26:43.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]: dispatch 2024-03-27T08:26:43.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]': finished 2024-03-27T08:26:43.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:43 smithi167 ceph-mon[34903]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T08:26:43.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:26:43.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]: dispatch 2024-03-27T08:26:43.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1281428764' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3"}]': finished 2024-03-27T08:26:43.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:43 smithi173 ceph-mon[35397]: osdmap e23: 4 total, 3 up, 4 in 2024-03-27T08:26:43.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:26:44.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:44 smithi164 ceph-mon[31788]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-03-27T08:26:44.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:44 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1801277964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:44.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:44 smithi167 ceph-mon[34903]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-03-27T08:26:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:44 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1801277964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:44 smithi173 ceph-mon[35397]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 3.4 KiB/s rd, 163 KiB/s wr, 10 op/s 2024-03-27T08:26:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:44 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1801277964' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:26:46.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:46 smithi167 ceph-mon[34903]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-03-27T08:26:46.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:46 smithi173 ceph-mon[35397]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-03-27T08:26:46.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:46 smithi164 ceph-mon[31788]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.9 KiB/s rd, 139 KiB/s wr, 9 op/s 2024-03-27T08:26:48.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:48 smithi164 ceph-mon[31788]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:48.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:48 smithi167 ceph-mon[34903]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:48.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:48 smithi173 ceph-mon[35397]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:50.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:50 smithi167 ceph-mon[34903]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:50.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:50 smithi173 ceph-mon[35397]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:50.628 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:50 smithi164 ceph-mon[31788]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail; 2.7 KiB/s rd, 131 KiB/s wr, 8 op/s 2024-03-27T08:26:52.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:52 smithi164 ceph-mon[31788]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T08:26:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:52 smithi167 ceph-mon[34903]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T08:26:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:52 smithi173 ceph-mon[35397]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-27T08:26:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:26:53.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:53 smithi164 ceph-mon[31788]: Deploying daemon osd.3 on smithi164 2024-03-27T08:26:53.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:53 smithi167 ceph-mon[34903]: Deploying daemon osd.3 on smithi164 2024-03-27T08:26:53.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:53 smithi173 ceph-mon[35397]: Deploying daemon osd.3 on smithi164 2024-03-27T08:26:54.422 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:54 smithi164 ceph-mon[31788]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:54.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:54 smithi167 ceph-mon[34903]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:54.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:54 smithi173 ceph-mon[35397]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:56.507 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:56 smithi164 ceph-mon[31788]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:56.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:56 smithi167 ceph-mon[34903]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:56.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:56 smithi173 ceph-mon[35397]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:58.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:26:58 smithi167 ceph-mon[34903]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:58.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:26:58 smithi173 ceph-mon[35397]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:26:58.739 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:26:58 smithi164 ceph-mon[31788]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:00 smithi167 ceph-mon[34903]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:00.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:00 smithi173 ceph-mon[35397]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:00 smithi164 ceph-mon[31788]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:01.675 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.676 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.676 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:01.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:01.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:02 smithi164 ceph-mon[31788]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:02.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:02 smithi167 ceph-mon[34903]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:02 smithi173 ceph-mon[35397]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:04.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:04 smithi164 ceph-mon[31788]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:04.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:04 smithi164 ceph-mon[31788]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T08:27:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:04 smithi167 ceph-mon[34903]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:04 smithi167 ceph-mon[34903]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T08:27:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:04 smithi173 ceph-mon[35397]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:04 smithi173 ceph-mon[35397]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-27T08:27:05.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.264+0000 7f8e7a000700 1 -- 172.21.15.164:0/1089929221 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8e7c062a80 con 0x7f8e640a3720 2024-03-27T08:27:05.257 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 3 on host 'smithi164' 2024-03-27T08:27:05.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.267+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 msgr2=0x7f8e640a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:05.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.267+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 0x7f8e640a5be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8e7000b580 tx=0x7f8e70005fb0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.267+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 msgr2=0x7f8e7c1a1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:05.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.267+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f8e74007f10 tx=0x7f8e7400d3b0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 shutdown_connections 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e640a3720 0x7f8e640a5be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e7c106460 0x7f8e7c1a1fc0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e7c1048c0 0x7f8e7c19aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 --2- 172.21.15.164:0/1089929221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e7c105ac0 0x7f8e7c19af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 >> 172.21.15.164:0/1089929221 conn(0x7f8e7c0ffe60 msgr2=0x7f8e7c108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 shutdown_connections 2024-03-27T08:27:05.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:27:05.268+0000 7f8e84000700 1 -- 172.21.15.164:0/1089929221 wait complete. 2024-03-27T08:27:06.053 DEBUG:teuthology.orchestra.run.smithi164:osd.3> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.3.service 2024-03-27T08:27:06.058 INFO:tasks.cephadm:Deploying osd.4 on smithi167 with /dev/vg_nvme/lv_3... 2024-03-27T08:27:06.058 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T08:27:06.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:06.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T08:27:06.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T08:27:06.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:27:06.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:06.497 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:27:06.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:06.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T08:27:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T08:27:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:27:06.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: osdmap e24: 4 total, 3 up, 4 in 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:27:06.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.686 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:27:07.687 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: osdmap e25: 4 total, 3 up, 4 in 2024-03-27T08:27:07.687 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.687 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.687 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: osdmap e26: 4 total, 3 up, 4 in 2024-03-27T08:27:07.687 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:27:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: osdmap e25: 4 total, 3 up, 4 in 2024-03-27T08:27:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: osdmap e26: 4 total, 3 up, 4 in 2024-03-27T08:27:07.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.756 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:27:07.412+0000 7f81bd400700 -1 osd.3 0 waiting for initial osdmap 2024-03-27T08:27:07.756 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:27:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:27:07.476+0000 7f81b3200700 -1 osd.3 26 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: osdmap e25: 4 total, 3 up, 4 in 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: osdmap e26: 4 total, 3 up, 4 in 2024-03-27T08:27:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.470 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:27:08.470 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:27:08.470 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:08.470 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.470 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' 2024-03-27T08:27:08.471 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] boot 2024-03-27T08:27:08.471 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T08:27:08.471 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] boot 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T08:27:08.615 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 98 MiB used, 268 GiB / 268 GiB avail 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: from='osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862]' entity='osd.3' 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: osd.3 [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] boot 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: osdmap e27: 4 total, 4 up, 4 in 2024-03-27T08:27:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0349955 s, 300 MB/s 2024-03-27T08:27:09.376 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-03-27T08:27:09.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:09 smithi167 ceph-mon[34903]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T08:27:09.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:09 smithi167 ceph-mon[34903]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:09.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:09 smithi173 ceph-mon[35397]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T08:27:09.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:09 smithi173 ceph-mon[35397]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:10.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:09 smithi164 ceph-mon[31788]: osdmap e28: 4 total, 4 up, 4 in 2024-03-27T08:27:10.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:09 smithi164 ceph-mon[31788]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:10.181 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-03-27T08:27:10.633 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:27:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:10 smithi173 ceph-mon[35397]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T08:27:10.952 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:10 smithi167 ceph-mon[34903]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T08:27:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:10 smithi164 ceph-mon[31788]: osdmap e29: 4 total, 4 up, 4 in 2024-03-27T08:27:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: osdmap e30: 4 total, 4 up, 4 in 2024-03-27T08:27:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi164 2024-03-27T08:27:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:27:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi164 to 8545M 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:11 smithi173 ceph-mon[35397]: osdmap e31: 4 total, 4 up, 4 in 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: osdmap e30: 4 total, 4 up, 4 in 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi164 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.899 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi164 to 8545M 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:11.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:11 smithi167 ceph-mon[34903]: osdmap e31: 4 total, 4 up, 4 in 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: osdmap e30: 4 total, 4 up, 4 in 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi164 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: pgmap v137: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:12.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi164 to 8545M 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:12.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:11 smithi164 ceph-mon[31788]: osdmap e31: 4 total, 4 up, 4 in 2024-03-27T08:27:12.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 -- 172.21.15.167:0/630383238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080102680 msgr2=0x7fb080102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:12.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 --2- 172.21.15.167:0/630383238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080102680 0x7fb080102aa0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb07000b0d0 tx=0x7fb07000b3e0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 -- 172.21.15.167:0/630383238 shutdown_connections 2024-03-27T08:27:12.624 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 --2- 172.21.15.167:0/630383238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080104220 0x7fb08010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 --2- 172.21.15.167:0/630383238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080102680 0x7fb080102aa0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 --2- 172.21.15.167:0/630383238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080103880 0x7fb080103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 -- 172.21.15.167:0/630383238 >> 172.21.15.167:0/630383238 conn(0x7fb0800fdbe0 msgr2=0x7fb080100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:27:12.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.632+0000 7fb085200700 1 -- 172.21.15.167:0/630383238 shutdown_connections 2024-03-27T08:27:12.625 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.633+0000 7fb085200700 1 -- 172.21.15.167:0/630383238 wait complete. 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 Processor -- start 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 -- start start 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 0x7fb0801987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080104220 0x7fb08019fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010e230 con 0x7fb080102680 2024-03-27T08:27:12.627 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010e0b0 con 0x7fb080103880 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb085200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb08010e3b0 con 0x7fb080104220 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb075400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb075400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43942/0 (socket says 172.21.15.167:43942) 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.634+0000 7fb075400700 1 -- 172.21.15.167:0/2456995470 learned_addr learned my addr 172.21.15.167:0/2456995470 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb07de00700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 0x7fb0801987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb07e800700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080104220 0x7fb08019fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 -- 172.21.15.167:0/2456995470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080104220 msgr2=0x7fb08019fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080104220 0x7fb08019fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 -- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 msgr2=0x7fb0801987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 0x7fb0801987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 -- 172.21.15.167:0/2456995470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0801a0450 con 0x7fb080103880 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb07de00700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 0x7fb0801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:27:12.628 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb075400700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb06800c9b0 tx=0x7fb06800cd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068007b00 con 0x7fb080103880 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.635+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0801a0740 con 0x7fb080103880 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.636+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb068007ca0 con 0x7fb080103880 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.636+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb068004a30 con 0x7fb080103880 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.636+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0801a0cd0 con 0x7fb080103880 2024-03-27T08:27:12.629 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.637+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb080069300 con 0x7fb080103880 2024-03-27T08:27:12.630 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.639+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fb06800f450 con 0x7fb080103880 2024-03-27T08:27:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.641+0000 7fb077400700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 0x7fb0640a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.642+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 3669+0+0 (secure 0 0 0) 0x7fb0680cee10 con 0x7fb080103880 2024-03-27T08:27:12.633 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.642+0000 7fb07de00700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 0x7fb0640a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:12.634 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.643+0000 7fb07de00700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 0x7fb0640a5b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb070009be0 tx=0x7fb07000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:27:12.637 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.645+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb068014030 con 0x7fb080103880 2024-03-27T08:27:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:12.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:12.879+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fb080062a80 con 0x7fb0640a36a0 2024-03-27T08:27:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:13.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:13.844 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:13 smithi167 ceph-mon[34903]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:13.844 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:13 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:13.844 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:13 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:13.844 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:13 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:13.845 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:13 smithi167 ceph-mon[34903]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:27:14.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:13 smithi164 ceph-mon[31788]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:13 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:13 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:13 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:13 smithi164 ceph-mon[31788]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:27:14.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:13 smithi173 ceph-mon[35397]: from='client.34220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:14.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:13 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:14.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:13 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:14.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:13 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:14.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:13 smithi173 ceph-mon[35397]: pgmap v139: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:27:16.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:16 smithi164 ceph-mon[31788]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:27:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:16 smithi167 ceph-mon[34903]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:27:16.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:16 smithi173 ceph-mon[35397]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:27:17.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:17 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/1262582133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:17 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:17 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]': finished 2024-03-27T08:27:17.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:17 smithi167 ceph-mon[34903]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T08:27:17.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:17.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:17 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/1262582133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:17 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:17 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]': finished 2024-03-27T08:27:17.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:17 smithi173 ceph-mon[35397]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T08:27:17.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:17.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:17 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/1262582133' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:17 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]: dispatch 2024-03-27T08:27:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:17 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "59fc75ef-25b1-4b3b-82c5-78d108babbdb"}]': finished 2024-03-27T08:27:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:17 smithi164 ceph-mon[31788]: osdmap e32: 5 total, 4 up, 5 in 2024-03-27T08:27:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:18.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:18 smithi167 ceph-mon[34903]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:18.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:18 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/3244181162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:18.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:18 smithi173 ceph-mon[35397]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:18.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:18 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/3244181162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:18 smithi164 ceph-mon[31788]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:18 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/3244181162' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:20.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:20 smithi167 ceph-mon[34903]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:20.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:20 smithi173 ceph-mon[35397]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:20 smithi164 ceph-mon[31788]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:22.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:22 smithi167 ceph-mon[34903]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:22.630 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:22 smithi173 ceph-mon[35397]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:22 smithi164 ceph-mon[31788]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:24.401 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:24 smithi167 ceph-mon[34903]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:24.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:24 smithi173 ceph-mon[35397]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:24 smithi164 ceph-mon[31788]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:26.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:26 smithi167 ceph-mon[34903]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:26.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T08:27:26.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:26 smithi173 ceph-mon[35397]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T08:27:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:26 smithi164 ceph-mon[31788]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-27T08:27:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:27.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:27 smithi167 ceph-mon[34903]: Deploying daemon osd.4 on smithi167 2024-03-27T08:27:27.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:27 smithi173 ceph-mon[35397]: Deploying daemon osd.4 on smithi167 2024-03-27T08:27:27.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:27 smithi164 ceph-mon[31788]: Deploying daemon osd.4 on smithi167 2024-03-27T08:27:28.552 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:28 smithi167 ceph-mon[34903]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:28.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:28 smithi173 ceph-mon[35397]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:28.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:28 smithi164 ceph-mon[31788]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:30.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:30 smithi164 ceph-mon[31788]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:30.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:30 smithi167 ceph-mon[34903]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:30.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:30 smithi173 ceph-mon[35397]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:32.503 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:32 smithi167 ceph-mon[34903]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:32.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:32 smithi173 ceph-mon[35397]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:32 smithi164 ceph-mon[31788]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:34 smithi167 ceph-mon[34903]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:34.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:34.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:34 smithi173 ceph-mon[35397]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:34.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:34.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:34.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:34 smithi164 ceph-mon[31788]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:34.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:34.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:34.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:36.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:36 smithi167 ceph-mon[34903]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:36.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:36 smithi173 ceph-mon[35397]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:36.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:36 smithi164 ceph-mon[31788]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:38.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:37 smithi167 ceph-mon[34903]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:38.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:37 smithi167 ceph-mon[34903]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.028 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:37 smithi167 ceph-mon[34903]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.138 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.145+0000 7fb077400700 1 -- 172.21.15.167:0/2456995470 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb080062a80 con 0x7fb0640a36a0 2024-03-27T08:27:38.139 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 4 on host 'smithi167' 2024-03-27T08:27:38.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.148+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 msgr2=0x7fb0640a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.148+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 0x7fb0640a5b60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb070009be0 tx=0x7fb07000b040 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.148+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 msgr2=0x7fb080198d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.148+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb06800c9b0 tx=0x7fb06800cd70 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 shutdown_connections 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0640a36a0 0x7fb0640a5b60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb080104220 0x7fb08019fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb080102680 0x7fb0801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 --2- 172.21.15.167:0/2456995470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb080103880 0x7fb080198d30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:38.143 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 >> 172.21.15.167:0/2456995470 conn(0x7fb0800fdbe0 msgr2=0x7fb080106b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:27:38.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 shutdown_connections 2024-03-27T08:27:38.144 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:27:38.149+0000 7fb085200700 1 -- 172.21.15.167:0/2456995470 wait complete. 2024-03-27T08:27:38.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:37 smithi164 ceph-mon[31788]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:38.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:37 smithi164 ceph-mon[31788]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:37 smithi164 ceph-mon[31788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:38.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:37 smithi173 ceph-mon[35397]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:38.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:37 smithi173 ceph-mon[35397]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:37 smithi173 ceph-mon[35397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-27T08:27:38.960 DEBUG:teuthology.orchestra.run.smithi167:osd.4> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.4.service 2024-03-27T08:27:38.964 INFO:tasks.cephadm:Deploying osd.5 on smithi173 with /dev/vg_nvme/lv_3... 2024-03-27T08:27:38.965 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: osdmap e33: 5 total, 4 up, 5 in 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: osdmap e33: 5 total, 4 up, 5 in 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:39.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:39.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: osdmap e33: 5 total, 4 up, 5 in 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:39.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:27:39.392 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:27:40.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:39 smithi164 ceph-mon[31788]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:27:40.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:39 smithi164 ceph-mon[31788]: osdmap e34: 5 total, 4 up, 5 in 2024-03-27T08:27:40.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:39 smithi164 ceph-mon[31788]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:39 smithi167 ceph-mon[34903]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:27:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:39 smithi167 ceph-mon[34903]: osdmap e34: 5 total, 4 up, 5 in 2024-03-27T08:27:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:39 smithi167 ceph-mon[34903]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:40.267 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:39 smithi173 ceph-mon[35397]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:27:40.267 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:39 smithi173 ceph-mon[35397]: osdmap e34: 5 total, 4 up, 5 in 2024-03-27T08:27:40.267 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.268 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:40.268 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:39 smithi173 ceph-mon[35397]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-03-27T08:27:41.026 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:40 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:27:41.026 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:40 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:27:41.026 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:40 smithi167 ceph-mon[34903]: osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] boot 2024-03-27T08:27:41.026 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:40 smithi167 ceph-mon[34903]: osdmap e35: 5 total, 5 up, 5 in 2024-03-27T08:27:41.026 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:40 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:41.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:40 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:27:41.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:40 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:27:41.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:40 smithi173 ceph-mon[35397]: osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] boot 2024-03-27T08:27:41.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:40 smithi173 ceph-mon[35397]: osdmap e35: 5 total, 5 up, 5 in 2024-03-27T08:27:41.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:40 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:41.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:40 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:27:41.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:40 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:27:41.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:40 smithi164 ceph-mon[31788]: osd.4 [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] boot 2024-03-27T08:27:41.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:40 smithi164 ceph-mon[31788]: osdmap e35: 5 total, 5 up, 5 in 2024-03-27T08:27:41.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-27T08:27:42.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:41 smithi173 ceph-mon[35397]: osdmap e36: 5 total, 5 up, 5 in 2024-03-27T08:27:42.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:41 smithi173 ceph-mon[35397]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0327343 s, 320 MB/s 2024-03-27T08:27:42.124 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 2024-03-27T08:27:42.125 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-03-27T08:27:42.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:41 smithi164 ceph-mon[31788]: osdmap e36: 5 total, 5 up, 5 in 2024-03-27T08:27:42.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:41 smithi164 ceph-mon[31788]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:42.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:41 smithi167 ceph-mon[34903]: osdmap e36: 5 total, 5 up, 5 in 2024-03-27T08:27:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:41 smithi167 ceph-mon[34903]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:43.002 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_3 2024-03-27T08:27:43.418 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:44.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:44.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:44 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:44.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:44.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:44 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:27:44.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:44 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:27:45.293 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:45 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi167 2024-03-27T08:27:45.700 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:45 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi167 to 8545M 2024-03-27T08:27:45.701 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:45 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi167 2024-03-27T08:27:45.702 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:45 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi167 to 8545M 2024-03-27T08:27:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 -- 172.21.15.173:0/2323985729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 msgr2=0x7f90c8104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 --2- 172.21.15.173:0/2323985729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c8104ce0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f90b8009990 tx=0x7f90b8009ca0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 -- 172.21.15.173:0/2323985729 shutdown_connections 2024-03-27T08:27:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 --2- 172.21.15.173:0/2323985729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.704 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 --2- 172.21.15.173:0/2323985729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c8104ce0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 --2- 172.21.15.173:0/2323985729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c8105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 -- 172.21.15.173:0/2323985729 >> 172.21.15.173:0/2323985729 conn(0x7f90c80ffe60 msgr2=0x7f90c81022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 -- 172.21.15.173:0/2323985729 shutdown_connections 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.536+0000 7f90ce400700 1 -- 172.21.15.173:0/2323985729 wait complete. 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.537+0000 7f90ce400700 1 Processor -- start 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.537+0000 7f90ce400700 1 -- start start 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.537+0000 7f90ce400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.537+0000 7f90ce400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c819af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.537+0000 7f90ce400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c81a1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90ce400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f90c81104c0 con 0x7f90c8105ac0 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90ce400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8110340 con 0x7f90c8106460 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90ce400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f90c8110640 con 0x7f90c81048c0 2024-03-27T08:27:45.705 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:57240/0 (socket says 172.21.15.173:57240) 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 -- 172.21.15.173:0/2785208524 learned_addr learned my addr 172.21.15.173:0/2785208524 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c6a00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c819af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7e00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c81a1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 -- 172.21.15.173:0/2785208524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 msgr2=0x7f90c81a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c81a1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 -- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 msgr2=0x7f90c819af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c819af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7400700 1 -- 172.21.15.173:0/2785208524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c81a2640 con 0x7f90c81048c0 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c6a00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.538+0000 7f90c7e00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c81a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90c7400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90b80057c0 tx=0x7f90b8009f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:27:45.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b8027070 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c81a28d0 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f90b8022470 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b800f6c0 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.539+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c81a2d30 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.540+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c8069300 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.542+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f90b802a070 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.544+0000 7f90bfe00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 0x7f90ac0a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.544+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4101+0+0 (secure 0 0 0) 0x7f90b80cff40 con 0x7f90c81048c0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.544+0000 7f90c6a00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 0x7f90ac0a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.545+0000 7f90c6a00700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 0x7f90ac0a5be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:27:45.707 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.547+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f90b8013070 con 0x7f90c81048c0 2024-03-27T08:27:45.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:45 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi167 2024-03-27T08:27:45.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:45 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi167 to 8545M 2024-03-27T08:27:45.772 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:27:45.779+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f90c8062a80 con 0x7f90ac0a3720 2024-03-27T08:27:46.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:46 smithi167 ceph-mon[34903]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:46.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:46.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:46.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:46.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:46 smithi173 ceph-mon[35397]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:46.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:46.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:46.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:46.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:46 smithi164 ceph-mon[31788]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:27:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:27:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:47.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:47 smithi167 ceph-mon[34903]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:47.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:47 smithi173 ceph-mon[35397]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:47.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:47 smithi164 ceph-mon[31788]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:27:48.480 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:48 smithi173 ceph-mon[35397]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:48.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:48 smithi167 ceph-mon[34903]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:48 smithi164 ceph-mon[31788]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/1492826466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]': finished 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T08:27:50.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:27:50.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:50.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/1492826466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]': finished 2024-03-27T08:27:50.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T08:27:50.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:27:50.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/1492826466' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]: dispatch 2024-03-27T08:27:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a66118e3-de31-41fb-becc-152bf0fa6bee"}]': finished 2024-03-27T08:27:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: osdmap e37: 6 total, 5 up, 6 in 2024-03-27T08:27:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:27:51.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/1699527388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:51.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/1699527388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:51.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/1699527388' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:27:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:52 smithi167 ceph-mon[34903]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:52 smithi173 ceph-mon[35397]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:52.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:52 smithi164 ceph-mon[31788]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:54.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:54 smithi167 ceph-mon[34903]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:54.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:54 smithi173 ceph-mon[35397]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:54 smithi164 ceph-mon[31788]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:56.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:56 smithi173 ceph-mon[35397]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:56 smithi164 ceph-mon[31788]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:56.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:56 smithi167 ceph-mon[34903]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:58.753 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:58 smithi173 ceph-mon[35397]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:58.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:58 smithi164 ceph-mon[31788]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:58 smithi167 ceph-mon[34903]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:27:59.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:59 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T08:27:59.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:27:59 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:59.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:59 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T08:27:59.811 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:27:59 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:27:59.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:59 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-27T08:27:59.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:27:59 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:00 smithi164 ceph-mon[31788]: Deploying daemon osd.5 on smithi173 2024-03-27T08:28:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:00 smithi164 ceph-mon[31788]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:00.767 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:00 smithi173 ceph-mon[35397]: Deploying daemon osd.5 on smithi173 2024-03-27T08:28:00.767 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:00 smithi173 ceph-mon[35397]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:00 smithi167 ceph-mon[34903]: Deploying daemon osd.5 on smithi173 2024-03-27T08:28:00.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:00 smithi167 ceph-mon[34903]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:02 smithi164 ceph-mon[31788]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:02.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:02 smithi167 ceph-mon[34903]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:02 smithi173 ceph-mon[35397]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:04.554 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:04 smithi173 ceph-mon[35397]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:04 smithi164 ceph-mon[31788]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:04 smithi167 ceph-mon[34903]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:06.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:06 smithi173 ceph-mon[35397]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:06 smithi164 ceph-mon[31788]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:06 smithi167 ceph-mon[34903]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:08.462 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.462 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.462 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:08 smithi173 ceph-mon[35397]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:08.462 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:08.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:08 smithi164 ceph-mon[31788]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:08.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:08.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:08 smithi167 ceph-mon[34903]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:10.441 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:10 smithi173 ceph-mon[35397]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:10.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:10 smithi167 ceph-mon[34903]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:10.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:10 smithi164 ceph-mon[31788]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:12.025 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.033+0000 7f90bfe00700 1 -- 172.21.15.173:0/2785208524 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f90c8062a80 con 0x7f90ac0a3720 2024-03-27T08:28:12.026 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 5 on host 'smithi173' 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 msgr2=0x7f90ac0a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 0x7f90ac0a5be0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f90b4005fd0 tx=0x7f90b4005e20 comp rx=0 tx=0).stop 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 msgr2=0x7f90c819a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f90b80057c0 tx=0x7f90b8009f90 comp rx=0 tx=0).stop 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 shutdown_connections 2024-03-27T08:28:12.029 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f90ac0a3720 0x7f90ac0a5be0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f90c8106460 0x7f90c81a1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f90c81048c0 0x7f90c819a9e0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 --2- 172.21.15.173:0/2785208524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f90c8105ac0 0x7f90c819af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 >> 172.21.15.173:0/2785208524 conn(0x7f90c80ffe60 msgr2=0x7f90c8108cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.037+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 shutdown_connections 2024-03-27T08:28:12.030 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:28:12.038+0000 7f90ce400700 1 -- 172.21.15.173:0/2785208524 wait complete. 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:11 smithi167 ceph-mon[34903]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:12.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:12.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:12.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:11 smithi173 ceph-mon[35397]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-27T08:28:12.256 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:11 smithi164 ceph-mon[31788]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:12.829 DEBUG:teuthology.orchestra.run.smithi173:osd.5> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.5.service 2024-03-27T08:28:12.833 INFO:tasks.cephadm:Deploying osd.6 on smithi164 with /dev/vg_nvme/lv_2... 2024-03-27T08:28:12.834 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: osdmap e38: 6 total, 5 up, 6 in 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:13.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: osdmap e38: 6 total, 5 up, 6 in 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:13.266 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: osdmap e38: 6 total, 5 up, 6 in 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:13.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:13 smithi164 ceph-mon[31788]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:28:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:13 smithi164 ceph-mon[31788]: osdmap e39: 6 total, 5 up, 6 in 2024-03-27T08:28:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:13 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:13 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:13 smithi164 ceph-mon[31788]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:14.204 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:13 smithi173 ceph-mon[35397]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:28:14.204 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:13 smithi173 ceph-mon[35397]: osdmap e39: 6 total, 5 up, 6 in 2024-03-27T08:28:14.205 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:13 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.205 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:13 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.205 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:13 smithi173 ceph-mon[35397]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:14.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:13 smithi167 ceph-mon[34903]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:28:14.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:13 smithi167 ceph-mon[34903]: osdmap e39: 6 total, 5 up, 6 in 2024-03-27T08:28:14.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:13 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:13 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:14.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:13 smithi167 ceph-mon[34903]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 155 MiB used, 447 GiB / 447 GiB avail 2024-03-27T08:28:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:14 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:28:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:14 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:28:15.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:14 smithi164 ceph-mon[31788]: osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] boot 2024-03-27T08:28:15.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:14 smithi164 ceph-mon[31788]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T08:28:15.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:15.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:14 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:28:15.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:14 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:28:15.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:14 smithi173 ceph-mon[35397]: osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] boot 2024-03-27T08:28:15.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:14 smithi173 ceph-mon[35397]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T08:28:15.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:15.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:14 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:28:15.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:14 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:28:15.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:14 smithi167 ceph-mon[34903]: osd.5 [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] boot 2024-03-27T08:28:15.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:14 smithi167 ceph-mon[34903]: osdmap e40: 6 total, 6 up, 6 in 2024-03-27T08:28:15.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-27T08:28:16.170 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T08:28:16.171 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T08:28:16.171 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-03-27T08:28:16.171 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-03-27T08:28:16.171 INFO:teuthology.orchestra.run.smithi164.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.031996 s, 328 MB/s 2024-03-27T08:28:16.171 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-03-27T08:28:16.171 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:15 smithi164 ceph-mon[31788]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T08:28:16.171 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:15 smithi164 ceph-mon[31788]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:16.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:15 smithi167 ceph-mon[34903]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T08:28:16.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:15 smithi167 ceph-mon[34903]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:16.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:15 smithi173 ceph-mon[35397]: osdmap e41: 6 total, 6 up, 6 in 2024-03-27T08:28:16.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:15 smithi173 ceph-mon[35397]: pgmap v180: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:16.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi164:vg_nvme/lv_2 2024-03-27T08:28:17.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:16 smithi173 ceph-mon[35397]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T08:28:17.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:16 smithi173 ceph-mon[35397]: osdmap e43: 6 total, 6 up, 6 in 2024-03-27T08:28:17.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:16 smithi164 ceph-mon[31788]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T08:28:17.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:16 smithi164 ceph-mon[31788]: osdmap e43: 6 total, 6 up, 6 in 2024-03-27T08:28:17.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:16 smithi167 ceph-mon[34903]: osdmap e42: 6 total, 6 up, 6 in 2024-03-27T08:28:17.348 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:16 smithi167 ceph-mon[34903]: osdmap e43: 6 total, 6 up, 6 in 2024-03-27T08:28:17.407 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi173 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi173 to 8545M 2024-03-27T08:28:18.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:18.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:18.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:18 smithi164 ceph-mon[31788]: osdmap e44: 6 total, 6 up, 6 in 2024-03-27T08:28:18.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi173 2024-03-27T08:28:18.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi173 to 8545M 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.571 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:18 smithi167 ceph-mon[34903]: osdmap e44: 6 total, 6 up, 6 in 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi173 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: pgmap v183: 1 pgs: 1 remapped+peering; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi173 to 8545M 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:18.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:18 smithi173 ceph-mon[35397]: osdmap e44: 6 total, 6 up, 6 in 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 -- 172.21.15.164:0/3901810123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 msgr2=0x7ff860105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 --2- 172.21.15.164:0/3901810123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff860105f20 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff8480099c0 tx=0x7ff848009cd0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 -- 172.21.15.164:0/3901810123 shutdown_connections 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 --2- 172.21.15.164:0/3901810123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 0x7ff86010cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 --2- 172.21.15.164:0/3901810123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 0x7ff860104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 --2- 172.21.15.164:0/3901810123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff860105f20 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 -- 172.21.15.164:0/3901810123 >> 172.21.15.164:0/3901810123 conn(0x7ff8600ffe60 msgr2=0x7ff8601022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 -- 172.21.15.164:0/3901810123 shutdown_connections 2024-03-27T08:28:19.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.574+0000 7ff865800700 1 -- 172.21.15.164:0/3901810123 wait complete. 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.575+0000 7ff865800700 1 Processor -- start 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 -- start start 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 0x7ff86019a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 0x7ff8601a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff860110420 con 0x7ff860105ac0 2024-03-27T08:28:19.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8601102a0 con 0x7ff8601048c0 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff865800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8601105a0 con 0x7ff860106460 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff856000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff856000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60828/0 (socket says 172.21.15.164:60828) 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff856000700 1 -- 172.21.15.164:0/1860668450 learned_addr learned my addr 172.21.15.164:0/1860668450 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.576+0000 7ff85ea00700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 0x7ff86019a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff85f400700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 0x7ff8601a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 -- 172.21.15.164:0/1860668450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 msgr2=0x7ff8601a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 0x7ff8601a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 -- 172.21.15.164:0/1860668450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 msgr2=0x7ff86019a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 0x7ff86019a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 -- 172.21.15.164:0/1860668450 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8601a2630 con 0x7ff860105ac0 2024-03-27T08:28:19.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff856000700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff848000c00 tx=0x7ff8480057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:28:19.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.577+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff848027070 con 0x7ff860105ac0 2024-03-27T08:28:19.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.578+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff8480041b0 con 0x7ff860105ac0 2024-03-27T08:28:19.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.578+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8601a28c0 con 0x7ff860105ac0 2024-03-27T08:28:19.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.578+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84800f460 con 0x7ff860105ac0 2024-03-27T08:28:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.578+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8601a2d10 con 0x7ff860105ac0 2024-03-27T08:28:19.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.579+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff860069300 con 0x7ff860105ac0 2024-03-27T08:28:19.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.581+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7ff84802a070 con 0x7ff860105ac0 2024-03-27T08:28:19.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.582+0000 7ff857e00700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 0x7ff8440a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.582+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4533+0+0 (secure 0 0 0) 0x7ff8480d0230 con 0x7ff860105ac0 2024-03-27T08:28:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.583+0000 7ff85ea00700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 0x7ff8440a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:19.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.583+0000 7ff85ea00700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 0x7ff8440a5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff860105920 tx=0x7ff850007a30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:28:19.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.587+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ff84805ecb0 con 0x7ff860105ac0 2024-03-27T08:28:19.815 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:19.823+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff860062a80 con 0x7ff8440a36a0 2024-03-27T08:28:20.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:20 smithi167 ceph-mon[34903]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:20.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:20.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:20 smithi173 ceph-mon[35397]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:20.733 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:20 smithi164 ceph-mon[31788]: pgmap v185: 1 pgs: 1 remapped+peering; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:20.733 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:20.733 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:20.733 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:21.553 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:21 smithi164 ceph-mon[31788]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:21.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:21 smithi167 ceph-mon[34903]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:21.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:21 smithi173 ceph-mon[35397]: from='client.14349 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:22.566 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:22 smithi164 ceph-mon[31788]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:28:22.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:22 smithi167 ceph-mon[34903]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:28:22.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:22 smithi173 ceph-mon[35397]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:28:24.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:24 smithi167 ceph-mon[34903]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-27T08:28:24.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:24 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]: dispatch 2024-03-27T08:28:24.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:24 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]': finished 2024-03-27T08:28:24.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:24 smithi167 ceph-mon[34903]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T08:28:24.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:24.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:24 smithi173 ceph-mon[35397]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-27T08:28:24.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:24 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]: dispatch 2024-03-27T08:28:24.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:24 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]': finished 2024-03-27T08:28:24.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:24 smithi173 ceph-mon[35397]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T08:28:24.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:24 smithi164 ceph-mon[31788]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-03-27T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]: dispatch 2024-03-27T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3755701128' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a6ecbda0-55a0-4633-bfd5-18aff3d6318e"}]': finished 2024-03-27T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:24 smithi164 ceph-mon[31788]: osdmap e45: 7 total, 6 up, 7 in 2024-03-27T08:28:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:25.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:25 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/655027219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:28:25.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:25 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/655027219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:28:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:25 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/655027219' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:28:26.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:26 smithi167 ceph-mon[34903]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:28:26.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:26 smithi173 ceph-mon[35397]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:28:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:26 smithi164 ceph-mon[31788]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:28:28.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:28 smithi167 ceph-mon[34903]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T08:28:28.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:28 smithi173 ceph-mon[35397]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T08:28:28.607 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:28 smithi164 ceph-mon[31788]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-03-27T08:28:30.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:30 smithi167 ceph-mon[34903]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T08:28:30.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:30 smithi173 ceph-mon[35397]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T08:28:30.606 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:30 smithi164 ceph-mon[31788]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-03-27T08:28:32.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:32 smithi164 ceph-mon[31788]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:32.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:32 smithi173 ceph-mon[35397]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:32 smithi167 ceph-mon[34903]: pgmap v192: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:34.669 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:34 smithi164 ceph-mon[31788]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:34.669 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T08:28:34.669 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:34 smithi167 ceph-mon[34903]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:34.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T08:28:34.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:34 smithi173 ceph-mon[35397]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-03-27T08:28:34.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:35.698 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:35 smithi164 ceph-mon[31788]: Deploying daemon osd.6 on smithi164 2024-03-27T08:28:35.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:35 smithi167 ceph-mon[34903]: Deploying daemon osd.6 on smithi164 2024-03-27T08:28:35.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:35 smithi173 ceph-mon[35397]: Deploying daemon osd.6 on smithi164 2024-03-27T08:28:36.596 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:36 smithi164 ceph-mon[31788]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:36 smithi167 ceph-mon[34903]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:36 smithi173 ceph-mon[35397]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:38.621 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:38 smithi167 ceph-mon[34903]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:38 smithi164 ceph-mon[31788]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:38 smithi173 ceph-mon[35397]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:40.616 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:40 smithi164 ceph-mon[31788]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:40.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:40 smithi167 ceph-mon[34903]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:40 smithi173 ceph-mon[35397]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:42.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:42 smithi164 ceph-mon[31788]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:42 smithi167 ceph-mon[34903]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:42 smithi173 ceph-mon[35397]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:43.714 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:43.714 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:43.714 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:43 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:43.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:43.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:43.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:43 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:43 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:44.693 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:44 smithi164 ceph-mon[31788]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:44 smithi167 ceph-mon[34903]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:44 smithi173 ceph-mon[35397]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:46.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:46.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.272+0000 7ff857e00700 1 -- 172.21.15.164:0/1860668450 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff860062a80 con 0x7ff8440a36a0 2024-03-27T08:28:47.266 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 6 on host 'smithi164' 2024-03-27T08:28:47.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 msgr2=0x7ff8440a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:47.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 0x7ff8440a5b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff860105920 tx=0x7ff850007a30 comp rx=0 tx=0).stop 2024-03-27T08:28:47.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 msgr2=0x7ff86019af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:47.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff848000c00 tx=0x7ff8480057c0 comp rx=0 tx=0).stop 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 shutdown_connections 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8440a36a0 0x7ff8440a5b60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff860106460 0x7ff8601a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8601048c0 0x7ff86019a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 --2- 172.21.15.164:0/1860668450 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff860105ac0 0x7ff86019af10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:47.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 >> 172.21.15.164:0/1860668450 conn(0x7ff8600ffe60 msgr2=0x7ff860108dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:28:47.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 shutdown_connections 2024-03-27T08:28:47.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:28:47.275+0000 7ff865800700 1 -- 172.21.15.164:0/1860668450 wait complete. 2024-03-27T08:28:47.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:47 smithi164 ceph-mon[31788]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T08:28:47.723 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.723 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.723 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:47 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:47.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:47 smithi167 ceph-mon[34903]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T08:28:47.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:47 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:47 smithi173 ceph-mon[35397]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-03-27T08:28:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:47.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:47 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:28:48.146 DEBUG:teuthology.orchestra.run.smithi164:osd.6> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.6.service 2024-03-27T08:28:48.151 INFO:tasks.cephadm:Deploying osd.7 on smithi167 with /dev/vg_nvme/lv_2... 2024-03-27T08:28:48.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T08:28:48.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:48.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T08:28:48.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: osdmap e46: 7 total, 6 up, 7 in 2024-03-27T08:28:48.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:28:48.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:48.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:48 smithi167 ceph-mon[34903]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:28:48.592 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:28:48.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:48.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T08:28:48.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: osdmap e46: 7 total, 6 up, 7 in 2024-03-27T08:28:48.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:28:48.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:48.720 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-mon[31788]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:28:48.720 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:28:48.499+0000 7fb5bca00700 -1 osd.6 0 waiting for initial osdmap 2024-03-27T08:28:48.720 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:28:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:28:48.531+0000 7fb5b7800700 -1 osd.6 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: osdmap e46: 7 total, 6 up, 7 in 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:48 smithi173 ceph-mon[35397]: from='osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:28:49.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:49 smithi164 ceph-mon[31788]: osdmap e47: 7 total, 6 up, 7 in 2024-03-27T08:28:49.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:49.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:49.768 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:49 smithi167 ceph-mon[34903]: osdmap e47: 7 total, 6 up, 7 in 2024-03-27T08:28:49.768 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:49.768 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:49.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:49 smithi173 ceph-mon[35397]: osdmap e47: 7 total, 6 up, 7 in 2024-03-27T08:28:49.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:49.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] boot 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: osdmap e48: 7 total, 7 up, 7 in 2024-03-27T08:28:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:28:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:28:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] boot 2024-03-27T08:28:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: osdmap e48: 7 total, 7 up, 7 in 2024-03-27T08:28:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:28:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:28:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 183 MiB used, 536 GiB / 536 GiB avail 2024-03-27T08:28:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: osd.6 [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] boot 2024-03-27T08:28:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: osdmap e48: 7 total, 7 up, 7 in 2024-03-27T08:28:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0359669 s, 292 MB/s 2024-03-27T08:28:51.288 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-03-27T08:28:51.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:51 smithi167 ceph-mon[34903]: osdmap e49: 7 total, 7 up, 7 in 2024-03-27T08:28:51.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:51 smithi173 ceph-mon[35397]: osdmap e49: 7 total, 7 up, 7 in 2024-03-27T08:28:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:51 smithi164 ceph-mon[31788]: osdmap e49: 7 total, 7 up, 7 in 2024-03-27T08:28:52.042 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-03-27T08:28:52.454 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:28:52.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:52 smithi167 ceph-mon[34903]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:52 smithi173 ceph-mon[35397]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:52 smithi164 ceph-mon[31788]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:54.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:54.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi164 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi164 to 5697M 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:54.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi164 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi164 to 5697M 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:54.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 -- 172.21.15.167:0/4011163226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 msgr2=0x7f2c0c1090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 --2- 172.21.15.167:0/4011163226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c1090e0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc0099c0 tx=0x7f2bfc009cd0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 -- 172.21.15.167:0/4011163226 shutdown_connections 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 --2- 172.21.15.167:0/4011163226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 0x7f2c0c111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 --2- 172.21.15.167:0/4011163226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c1090e0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.532 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 --2- 172.21.15.167:0/4011163226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 0x7f2c0c10a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 -- 172.21.15.167:0/4011163226 >> 172.21.15.167:0/4011163226 conn(0x7f2c0c077c90 msgr2=0x7f2c0c07a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:28:54.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 -- 172.21.15.167:0/4011163226 shutdown_connections 2024-03-27T08:28:54.533 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.540+0000 7f2c12400700 1 -- 172.21.15.167:0/4011163226 wait complete. 2024-03-27T08:28:54.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.541+0000 7f2c12400700 1 Processor -- start 2024-03-27T08:28:54.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.541+0000 7f2c12400700 1 -- start start 2024-03-27T08:28:54.535 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 0x7f2c0c19f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 0x7f2c0c1a63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c114840 con 0x7f2c0c109ec0 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1146c0 con 0x7f2c0c108cc0 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c12400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2c0c1149c0 con 0x7f2c0c10a860 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c0b400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c0b400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:58276/0 (socket says 172.21.15.167:58276) 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c0b400700 1 -- 172.21.15.167:0/3203579419 learned_addr learned my addr 172.21.15.167:0/3203579419 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c03e00700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 0x7f2c0c19f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.542+0000 7f2c0be00700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 0x7f2c0c1a63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 -- 172.21.15.167:0/3203579419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 msgr2=0x7f2c0c1a63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 0x7f2c0c1a63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.536 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 -- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 msgr2=0x7f2c0c19f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 0x7f2c0c19f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 -- 172.21.15.167:0/3203579419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c0c1a6a50 con 0x7f2c0c108cc0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c0b400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005840 tx=0x7f2bfc009f10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc027070 con 0x7f2c0c108cc0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2bfc003fa0 con 0x7f2c0c108cc0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bfc022d70 con 0x7f2c0c108cc0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c0c1a6ce0 con 0x7f2c0c108cc0 2024-03-27T08:28:54.537 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.543+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c0c1a7170 con 0x7f2c0c108cc0 2024-03-27T08:28:54.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.545+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c0c069300 con 0x7f2c0c108cc0 2024-03-27T08:28:54.538 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.547+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f2bfc02a070 con 0x7f2c0c108cc0 2024-03-27T08:28:54.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.548+0000 7f2c08c00700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 0x7f2bf00a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:28:54.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.548+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 4965+0+0 (secure 0 0 0) 0x7f2bfc0cffe0 con 0x7f2c0c108cc0 2024-03-27T08:28:54.540 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.549+0000 7f2c03e00700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 0x7f2bf00a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:28:54.541 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.550+0000 7f2c03e00700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 0x7f2bf00a5be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005ea0 tx=0x7f2bf4005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:28:54.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.552+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2bfc013070 con 0x7f2c0c108cc0 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: pgmap v207: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi164 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi164 to 5697M 2024-03-27T08:28:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:54.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:28:54.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:28:54.777 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:28:54.785+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2c0c062a80 con 0x7f2bf00a3720 2024-03-27T08:28:55.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:55 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:55.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:55 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:55.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:55 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:55.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:55 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:55.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:55 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:55.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:55 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:55.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:55 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:28:55.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:55 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:28:55.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:55 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:28:56.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:56 smithi167 ceph-mon[34903]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:56.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:56 smithi167 ceph-mon[34903]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:56.557 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:56 smithi164 ceph-mon[31788]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:56.557 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:56 smithi164 ceph-mon[31788]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:56.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:56 smithi173 ceph-mon[35397]: from='client.34268 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:28:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:56 smithi173 ceph-mon[35397]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:58.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:58 smithi167 ceph-mon[34903]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:58.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:58 smithi173 ceph-mon[35397]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:58.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:58 smithi164 ceph-mon[31788]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:28:59.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:59 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/2886098375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:59 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:59 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]': finished 2024-03-27T08:28:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:59 smithi164 ceph-mon[31788]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T08:28:59.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:28:59 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:28:59.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:59 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/2886098375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:59 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:59 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]': finished 2024-03-27T08:28:59.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:59 smithi167 ceph-mon[34903]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T08:28:59.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:28:59 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:28:59.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:59 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/2886098375' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:59 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]: dispatch 2024-03-27T08:28:59.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:59 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1"}]': finished 2024-03-27T08:28:59.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:59 smithi173 ceph-mon[35397]: osdmap e50: 8 total, 7 up, 8 in 2024-03-27T08:28:59.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:28:59 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:00.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:00 smithi167 ceph-mon[34903]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/1228484746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:00.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:00 smithi173 ceph-mon[35397]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:00.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/1228484746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:00 smithi164 ceph-mon[31788]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/1228484746' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:02 smithi167 ceph-mon[34903]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:02.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:02 smithi173 ceph-mon[35397]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:02 smithi164 ceph-mon[31788]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:04.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:04 smithi167 ceph-mon[34903]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:04.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:04 smithi173 ceph-mon[35397]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:04 smithi164 ceph-mon[31788]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:06.559 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:06 smithi167 ceph-mon[34903]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:06.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:06 smithi173 ceph-mon[35397]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:06 smithi164 ceph-mon[31788]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:08 smithi167 ceph-mon[34903]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T08:29:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:08 smithi173 ceph-mon[35397]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T08:29:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:08 smithi164 ceph-mon[31788]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-03-27T08:29:08.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:09.470 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:09 smithi167 ceph-mon[34903]: Deploying daemon osd.7 on smithi167 2024-03-27T08:29:09.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:09 smithi173 ceph-mon[35397]: Deploying daemon osd.7 on smithi167 2024-03-27T08:29:09.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:09 smithi164 ceph-mon[31788]: Deploying daemon osd.7 on smithi167 2024-03-27T08:29:10.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:10 smithi164 ceph-mon[31788]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:10.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:10 smithi167 ceph-mon[34903]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:10.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:10 smithi173 ceph-mon[35397]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:12.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:12 smithi167 ceph-mon[34903]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:12.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:12 smithi173 ceph-mon[35397]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:12 smithi164 ceph-mon[31788]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:14.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:14 smithi173 ceph-mon[35397]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:14.575 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:14 smithi167 ceph-mon[34903]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:14 smithi164 ceph-mon[31788]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:16 smithi164 ceph-mon[31788]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:16.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:16 smithi167 ceph-mon[34903]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:16.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:16 smithi173 ceph-mon[35397]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:16.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:18.596 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:18 smithi167 ceph-mon[34903]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:18 smithi164 ceph-mon[31788]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:18 smithi173 ceph-mon[35397]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:20.700 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:20.700 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.700 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.700 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:20.700 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:20.701 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:20.837 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.844+0000 7f2c08c00700 1 -- 172.21.15.167:0/3203579419 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2c0c062a80 con 0x7f2bf00a3720 2024-03-27T08:29:20.837 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 7 on host 'smithi167' 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 msgr2=0x7f2bf00a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 0x7f2bf00a5be0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005ea0 tx=0x7f2bf4005e30 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 msgr2=0x7f2c0c19edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2bfc005840 tx=0x7f2bfc009f10 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 shutdown_connections 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2bf00a3720 0x7f2bf00a5be0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2c0c10a860 0x7f2c0c1a63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c0c108cc0 0x7f2c0c19edf0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 --2- 172.21.15.167:0/3203579419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2c0c109ec0 0x7f2c0c19f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:20.841 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 >> 172.21.15.167:0/3203579419 conn(0x7f2c0c077c90 msgr2=0x7f2c0c10d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:29:20.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 shutdown_connections 2024-03-27T08:29:20.842 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:29:20.848+0000 7f2c12400700 1 -- 172.21.15.167:0/3203579419 wait complete. 2024-03-27T08:29:21.572 DEBUG:teuthology.orchestra.run.smithi167:osd.7> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.7.service 2024-03-27T08:29:21.577 INFO:tasks.cephadm:Deploying osd.8 on smithi173 with /dev/vg_nvme/lv_2... 2024-03-27T08:29:21.578 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-27T08:29:21.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:21 smithi167 ceph-mon[34903]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:21 smithi167 ceph-mon[34903]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:21 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:21.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:21 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:21.639 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:21 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:21.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:21 smithi173 ceph-mon[35397]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:21 smithi173 ceph-mon[35397]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:21 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:21.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:21 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:21.660 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:21 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:21.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:21 smithi164 ceph-mon[31788]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:21 smithi164 ceph-mon[31788]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-03-27T08:29:21.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:21.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:21.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:22.028 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:29:22.536 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T08:29:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T08:29:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:22.537 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:22 smithi173 ceph-mon[35397]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:22.711 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:22 smithi167 ceph-mon[34903]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-03-27T08:29:22.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: osdmap e51: 8 total, 7 up, 8 in 2024-03-27T08:29:22.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:22.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: from='osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:22.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:22 smithi164 ceph-mon[31788]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: osdmap e52: 8 total, 7 up, 8 in 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.383 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:29:23.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:29:23.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:29:23.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: osdmap e52: 8 total, 7 up, 8 in 2024-03-27T08:29:23.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: osdmap e52: 8 total, 7 up, 8 in 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.763 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:23.768 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:29:23.416+0000 7f3180e00700 -1 osd.7 0 waiting for initial osdmap 2024-03-27T08:29:23.768 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:29:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:29:23.463+0000 7f3176c00700 -1 osd.7 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:29:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: osdmap e53: 8 total, 7 up, 8 in 2024-03-27T08:29:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: from='osd.7 ' entity='osd.7' 2024-03-27T08:29:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: osdmap e53: 8 total, 7 up, 8 in 2024-03-27T08:29:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: from='osd.7 ' entity='osd.7' 2024-03-27T08:29:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: osdmap e53: 8 total, 7 up, 8 in 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: from='osd.7 ' entity='osd.7' 2024-03-27T08:29:24.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0360798 s, 291 MB/s 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 2024-03-27T08:29:24.939 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-03-27T08:29:25.688 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:25 smithi173 ceph-mon[35397]: osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] boot 2024-03-27T08:29:25.688 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:25 smithi173 ceph-mon[35397]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T08:29:25.688 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:25.747 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_2 2024-03-27T08:29:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:25 smithi164 ceph-mon[31788]: osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] boot 2024-03-27T08:29:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:25 smithi164 ceph-mon[31788]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T08:29:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:25.785 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:25 smithi167 ceph-mon[34903]: osd.7 [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] boot 2024-03-27T08:29:25.785 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:25 smithi167 ceph-mon[34903]: osdmap e54: 8 total, 8 up, 8 in 2024-03-27T08:29:25.785 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-03-27T08:29:26.177 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:26.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:26.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:26.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: pgmap v228: 1 pgs: 1 remapped+peering; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: Health check failed: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: osdmap e55: 8 total, 8 up, 8 in 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:29:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:26.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:26.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:29:26.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:27.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:27 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi167 2024-03-27T08:29:27.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:27 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi167 to 5697M 2024-03-27T08:29:27.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:27 smithi164 ceph-mon[31788]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T08:29:27.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:27 smithi164 ceph-mon[31788]: osdmap e57: 8 total, 8 up, 8 in 2024-03-27T08:29:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:27 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi167 2024-03-27T08:29:27.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:27 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi167 to 5697M 2024-03-27T08:29:27.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:27 smithi167 ceph-mon[34903]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T08:29:27.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:27 smithi167 ceph-mon[34903]: osdmap e57: 8 total, 8 up, 8 in 2024-03-27T08:29:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:27 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi167 2024-03-27T08:29:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:27 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi167 to 5697M 2024-03-27T08:29:27.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:27 smithi173 ceph-mon[35397]: osdmap e56: 8 total, 8 up, 8 in 2024-03-27T08:29:27.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:27 smithi173 ceph-mon[35397]: osdmap e57: 8 total, 8 up, 8 in 2024-03-27T08:29:28.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 -- 172.21.15.173:0/2849121806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 msgr2=0x7f1c9c1090e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:28.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 --2- 172.21.15.173:0/2849121806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c1090e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009990 tx=0x7f1c90009ca0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.359 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 -- 172.21.15.173:0/2849121806 shutdown_connections 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 --2- 172.21.15.173:0/2849121806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c10a860 0x7f1c9c111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 --2- 172.21.15.173:0/2849121806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c1090e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 --2- 172.21.15.173:0/2849121806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c109ec0 0x7f1c9c10a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 -- 172.21.15.173:0/2849121806 >> 172.21.15.173:0/2849121806 conn(0x7f1c9c077c90 msgr2=0x7f1c9c07a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 -- 172.21.15.173:0/2849121806 shutdown_connections 2024-03-27T08:29:28.360 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.367+0000 7f1ca3600700 1 -- 172.21.15.173:0/2849121806 wait complete. 2024-03-27T08:29:28.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.368+0000 7f1ca3600700 1 Processor -- start 2024-03-27T08:29:28.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.368+0000 7f1ca3600700 1 -- start start 2024-03-27T08:29:28.362 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c109ec0 0x7f1c9c19f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c10a860 0x7f1c9c1a63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c1148e0 con 0x7f1c9c10a860 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c114760 con 0x7f1c9c109ec0 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca3600700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1c9c114a60 con 0x7f1c9c108cc0 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:37616/0 (socket says 172.21.15.173:37616) 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 -- 172.21.15.173:0/1469553788 learned_addr learned my addr 172.21.15.173:0/1469553788 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1c9be00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c109ec0 0x7f1c9c19f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca1600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c10a860 0x7f1c9c1a63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 -- 172.21.15.173:0/1469553788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c109ec0 msgr2=0x7f1c9c19f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c109ec0 0x7f1c9c19f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.363 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 -- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c10a860 msgr2=0x7f1c9c1a63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c10a860 0x7f1c9c1a63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.369+0000 7f1ca0c00700 1 -- 172.21.15.173:0/1469553788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c9c1a6a70 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1ca0c00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c900057c0 tx=0x7f1c90005af0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90027070 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c9c1a6d00 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1c900041b0 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c90022e60 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.370+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c9c1a71b0 con 0x7f1c9c108cc0 2024-03-27T08:29:28.364 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.371+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c9c069300 con 0x7f1c9c108cc0 2024-03-27T08:29:28.366 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.375+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f1c9002a070 con 0x7f1c9c108cc0 2024-03-27T08:29:28.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.376+0000 7f1c99600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 0x7f1c840a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:29:28.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.376+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5397+0+0 (secure 0 0 0) 0x7f1c900d0520 con 0x7f1c9c108cc0 2024-03-27T08:29:28.368 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.377+0000 7f1c9be00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 0x7f1c840a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:29:28.369 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.378+0000 7f1c9be00700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 0x7f1c840a5be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005ea0 tx=0x7f1c8c005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:29:28.371 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.379+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1c90013070 con 0x7f1c9c108cc0 2024-03-27T08:29:28.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:28 smithi173 ceph-mon[35397]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:28.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:28 smithi173 ceph-mon[35397]: osdmap e58: 8 total, 8 up, 8 in 2024-03-27T08:29:28.607 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:28.615+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1c9c062a80 con 0x7f1c840a3720 2024-03-27T08:29:28.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:28 smithi164 ceph-mon[31788]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:28.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:28 smithi164 ceph-mon[31788]: osdmap e58: 8 total, 8 up, 8 in 2024-03-27T08:29:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:28 smithi167 ceph-mon[34903]: pgmap v232: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:28.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:28 smithi167 ceph-mon[34903]: osdmap e58: 8 total, 8 up, 8 in 2024-03-27T08:29:29.696 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:29:29.696 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:29:29.696 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:29.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:29:29.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:29:29.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:29.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:29:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:29:29.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:30 smithi164 ceph-mon[31788]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:29:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:30 smithi164 ceph-mon[31788]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:30.755 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:30 smithi173 ceph-mon[35397]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:29:30.755 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:30 smithi173 ceph-mon[35397]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:30 smithi167 ceph-mon[34903]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:29:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:30 smithi167 ceph-mon[34903]: pgmap v234: 1 pgs: 1 remapped+peering; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:31.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:31 smithi173 ceph-mon[35397]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-27T08:29:31.601 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:31 smithi173 ceph-mon[35397]: Cluster is now healthy 2024-03-27T08:29:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:31 smithi164 ceph-mon[31788]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-27T08:29:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:31 smithi164 ceph-mon[31788]: Cluster is now healthy 2024-03-27T08:29:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:31 smithi167 ceph-mon[34903]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 1 pg peering) 2024-03-27T08:29:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:31 smithi167 ceph-mon[34903]: Cluster is now healthy 2024-03-27T08:29:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/2190497447' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]': finished 2024-03-27T08:29:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T08:29:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/2190497447' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]': finished 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T08:29:32.787 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/2190497447' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]: dispatch 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8b5e5331-70d7-48c7-921a-9ee5e820651b"}]': finished 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: osdmap e59: 9 total, 8 up, 9 in 2024-03-27T08:29:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:33 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/2327838692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:33.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:33 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/2327838692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:34.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:33 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/2327838692' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:29:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:34 smithi167 ceph-mon[34903]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:34 smithi173 ceph-mon[35397]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:34 smithi164 ceph-mon[31788]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:36 smithi167 ceph-mon[34903]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:36 smithi173 ceph-mon[35397]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:37.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:36 smithi164 ceph-mon[31788]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:38.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:38 smithi167 ceph-mon[34903]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:38 smithi173 ceph-mon[35397]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:39.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:38 smithi164 ceph-mon[31788]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:39.920 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:39 smithi173 ceph-mon[35397]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:40.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:39 smithi164 ceph-mon[31788]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:40.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:39 smithi167 ceph-mon[34903]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:42.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:42 smithi167 ceph-mon[34903]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:42.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T08:29:42.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:42.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:42 smithi173 ceph-mon[35397]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:42.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T08:29:42.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:42 smithi164 ceph-mon[31788]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-03-27T08:29:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:29:43.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:43 smithi167 ceph-mon[34903]: Deploying daemon osd.8 on smithi173 2024-03-27T08:29:43.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:43 smithi173 ceph-mon[35397]: Deploying daemon osd.8 on smithi173 2024-03-27T08:29:43.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:43 smithi164 ceph-mon[31788]: Deploying daemon osd.8 on smithi173 2024-03-27T08:29:44.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:44 smithi167 ceph-mon[34903]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:44.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:44 smithi173 ceph-mon[35397]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:44 smithi164 ceph-mon[31788]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:46.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:46 smithi164 ceph-mon[31788]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:46.776 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:46 smithi173 ceph-mon[35397]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:46.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:46 smithi167 ceph-mon[34903]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:48.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:48 smithi173 ceph-mon[35397]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:48 smithi164 ceph-mon[31788]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:48.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:48 smithi167 ceph-mon[34903]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:50.476 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:50 smithi173 ceph-mon[35397]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:50.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:50 smithi164 ceph-mon[31788]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:50 smithi167 ceph-mon[34903]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:51.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:51 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:51.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:51 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:51.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:51 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:51.897 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:51 smithi173 ceph-mon[35397]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:52.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:51 smithi164 ceph-mon[31788]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:52.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:51 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:51 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:51 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:29:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:51 smithi167 ceph-mon[34903]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:54.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:54 smithi167 ceph-mon[34903]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:54.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:54 smithi173 ceph-mon[35397]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:54 smithi164 ceph-mon[31788]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:55.473 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.480+0000 7f1c99600700 1 -- 172.21.15.173:0/1469553788 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1c9c062a80 con 0x7f1c840a3720 2024-03-27T08:29:55.474 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 8 on host 'smithi173' 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 msgr2=0x7f1c840a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 0x7f1c840a5be0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c005ea0 tx=0x7f1c8c005e30 comp rx=0 tx=0).stop 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 msgr2=0x7f1c9c19ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1c900057c0 tx=0x7f1c90005af0 comp rx=0 tx=0).stop 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 shutdown_connections 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1c840a3720 0x7f1c840a5be0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1c9c10a860 0x7f1c9c1a63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1c9c108cc0 0x7f1c9c19ee10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:55.478 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 --2- 172.21.15.173:0/1469553788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1c9c109ec0 0x7f1c9c19f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:29:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 >> 172.21.15.173:0/1469553788 conn(0x7f1c9c077c90 msgr2=0x7f1c9c10d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:29:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 shutdown_connections 2024-03-27T08:29:55.479 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:29:55.485+0000 7f1ca3600700 1 -- 172.21.15.173:0/1469553788 wait complete. 2024-03-27T08:29:55.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:55 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:55 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:55 smithi164 ceph-mon[31788]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:55.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:55 smithi164 ceph-mon[31788]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:55.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:55 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:55 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:55 smithi173 ceph-mon[35397]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:55.803 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:55 smithi173 ceph-mon[35397]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:55.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:55 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:55 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:55.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:55 smithi167 ceph-mon[34903]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:55.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:55 smithi167 ceph-mon[34903]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-03-27T08:29:56.144 DEBUG:teuthology.orchestra.run.smithi173:osd.8> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.8.service 2024-03-27T08:29:56.149 INFO:tasks.cephadm:Deploying osd.9 on smithi164 with /dev/vg_nvme/lv_1... 2024-03-27T08:29:56.149 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T08:29:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T08:29:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: osdmap e60: 9 total, 8 up, 9 in 2024-03-27T08:29:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:56.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:56.600 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: osdmap e60: 9 total, 8 up, 9 in 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.760 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:56.761 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:56.761 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:29:56.467+0000 7f56be600700 -1 osd.8 0 waiting for initial osdmap 2024-03-27T08:29:56.761 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:29:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:29:56.490+0000 7f56b9400700 -1 osd.8 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:29:56.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:56.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-03-27T08:29:56.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: osdmap e60: 9 total, 8 up, 9 in 2024-03-27T08:29:56.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:56.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:29:56.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:56.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: osdmap e61: 9 total, 8 up, 9 in 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] boot 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T08:29:57.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:57 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.772 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: osdmap e61: 9 total, 8 up, 9 in 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] boot 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T08:29:57.773 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:57 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: osdmap e61: 9 total, 8 up, 9 in 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: osd.8 [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] boot 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: osdmap e62: 9 total, 9 up, 9 in 2024-03-27T08:29:57.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:57 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-03-27T08:29:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:58 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:29:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:58 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:29:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:58 smithi173 ceph-mon[35397]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:58.468 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:58 smithi173 ceph-mon[35397]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T08:29:58.715 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:58 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:29:58.715 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:58 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:29:58.715 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:58 smithi164 ceph-mon[31788]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:58.715 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:58 smithi164 ceph-mon[31788]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T08:29:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:58 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:29:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:58 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:29:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:58 smithi167 ceph-mon[34903]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-03-27T08:29:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:58 smithi167 ceph-mon[34903]: osdmap e63: 9 total, 9 up, 9 in 2024-03-27T08:29:59.599 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T08:29:59.600 INFO:teuthology.orchestra.run.smithi164.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T08:29:59.600 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10+0 records in 2024-03-27T08:29:59.600 INFO:teuthology.orchestra.run.smithi164.stderr:10+0 records out 2024-03-27T08:29:59.600 INFO:teuthology.orchestra.run.smithi164.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.035427 s, 296 MB/s 2024-03-27T08:29:59.600 INFO:teuthology.orchestra.run.smithi164.stderr:--> Zapping successful for: 2024-03-27T08:29:59.968 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:59 smithi164 ceph-mon[31788]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T08:29:59.968 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:29:59 smithi164 ceph-mon[31788]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:59 smithi167 ceph-mon[34903]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T08:30:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:29:59 smithi167 ceph-mon[34903]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:00.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:59 smithi173 ceph-mon[35397]: osdmap e64: 9 total, 9 up, 9 in 2024-03-27T08:30:00.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:29:59 smithi173 ceph-mon[35397]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:00.578 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi164:vg_nvme/lv_1 2024-03-27T08:30:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:00 smithi164 ceph-mon[31788]: osdmap e65: 9 total, 9 up, 9 in 2024-03-27T08:30:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:00 smithi164 ceph-mon[31788]: overall HEALTH_OK 2024-03-27T08:30:01.009 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:30:01.010 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:00 smithi173 ceph-mon[35397]: osdmap e65: 9 total, 9 up, 9 in 2024-03-27T08:30:01.010 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:00 smithi173 ceph-mon[35397]: overall HEALTH_OK 2024-03-27T08:30:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:00 smithi167 ceph-mon[34903]: osdmap e65: 9 total, 9 up, 9 in 2024-03-27T08:30:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:00 smithi167 ceph-mon[34903]: overall HEALTH_OK 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: osdmap e66: 9 total, 9 up, 9 in 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi173 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:01.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi173 to 5697M 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: pgmap v258: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:01.667 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:01 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:02.056 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: osdmap e66: 9 total, 9 up, 9 in 2024-03-27T08:30:02.056 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi173 2024-03-27T08:30:02.056 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.056 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi173 to 5697M 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: pgmap v258: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:02.057 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:01 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: osdmap e66: 9 total, 9 up, 9 in 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi173 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:02.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi173 to 5697M 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: pgmap v258: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:02.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:01 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:02.915 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:03.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 -- 172.21.15.164:0/4267835373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 msgr2=0x7fc0d81099c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 --2- 172.21.15.164:0/4267835373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d81099c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fc0d000b0d0 tx=0x7fc0d000b3e0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 -- 172.21.15.164:0/4267835373 shutdown_connections 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 --2- 172.21.15.164:0/4267835373 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d81099c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 --2- 172.21.15.164:0/4267835373 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 0x7fc0d8101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 --2- 172.21.15.164:0/4267835373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 0x7fc0d8102bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.197+0000 7fc0df200700 1 -- 172.21.15.164:0/4267835373 >> 172.21.15.164:0/4267835373 conn(0x7fc0d80fcb10 msgr2=0x7fc0d80fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:30:03.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.198+0000 7fc0df200700 1 -- 172.21.15.164:0/4267835373 shutdown_connections 2024-03-27T08:30:03.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.198+0000 7fc0df200700 1 -- 172.21.15.164:0/4267835373 wait complete. 2024-03-27T08:30:03.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 Processor -- start 2024-03-27T08:30:03.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 -- start start 2024-03-27T08:30:03.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 0x7fc0d8105500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:03.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 0x7fc0d8103b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:03.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d810d1a0 con 0x7fc0d8103110 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d810d020 con 0x7fc0d8102770 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.199+0000 7fc0df200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc0d810d320 con 0x7fc0d8101570 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51326/0 (socket says 172.21.15.164:51326) 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 -- 172.21.15.164:0/3869309321 learned_addr learned my addr 172.21.15.164:0/3869309321 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0d7e00700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 0x7fc0d8105500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0d7400700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 0x7fc0d8103b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 -- 172.21.15.164:0/3869309321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 msgr2=0x7fc0d8105500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:03.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 0x7fc0d8105500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 -- 172.21.15.164:0/3869309321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 msgr2=0x7fc0d8103b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 0x7fc0d8103b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 -- 172.21.15.164:0/3869309321 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0d8104940 con 0x7fc0d8103110 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.200+0000 7fc0dd200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009850 tx=0x7fc0d0007dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.201+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d001f020 con 0x7fc0d8103110 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.201+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc0d0003e10 con 0x7fc0d8103110 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.201+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0d81a29d0 con 0x7fc0d8103110 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.201+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0d001ba40 con 0x7fc0d8103110 2024-03-27T08:30:03.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.201+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0d81a2e20 con 0x7fc0d8103110 2024-03-27T08:30:03.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.202+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0d8069300 con 0x7fc0d8103110 2024-03-27T08:30:03.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.204+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fc0d0022020 con 0x7fc0d8103110 2024-03-27T08:30:03.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.206+0000 7fc0d4c00700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 0x7fc0bc0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:03.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.206+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5829+0+0 (secure 0 0 0) 0x7fc0d000f020 con 0x7fc0d8103110 2024-03-27T08:30:03.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.206+0000 7fc0d7e00700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 0x7fc0bc0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:03.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.206+0000 7fc0d7e00700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 0x7fc0bc0a5b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8005fd0 tx=0x7fc0c8005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:30:03.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.210+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc0d002b2f0 con 0x7fc0d8103110 2024-03-27T08:30:03.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:03.448+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc0d80fec30 con 0x7fc0bc0a36a0 2024-03-27T08:30:03.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:03 smithi164 ceph-mon[31788]: pgmap v259: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-27T08:30:03.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:03 smithi164 ceph-mon[31788]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:03.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:03 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:03.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:03 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:03.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:03 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:04.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:03 smithi167 ceph-mon[34903]: pgmap v259: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-27T08:30:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:03 smithi167 ceph-mon[34903]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:03 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:03 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:03 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:04.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:03 smithi173 ceph-mon[35397]: pgmap v259: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 102 KiB/s, 0 objects/s recovering 2024-03-27T08:30:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:03 smithi173 ceph-mon[35397]: from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi164:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:03 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:03 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:03 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:06.555 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:06 smithi164 ceph-mon[31788]: pgmap v260: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-27T08:30:06.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:06 smithi167 ceph-mon[34903]: pgmap v260: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-27T08:30:06.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:06 smithi173 ceph-mon[35397]: pgmap v260: 1 pgs: 1 peering; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 87 KiB/s, 0 objects/s recovering 2024-03-27T08:30:08.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:08 smithi164 ceph-mon[31788]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:30:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]: dispatch 2024-03-27T08:30:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]': finished 2024-03-27T08:30:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:08 smithi164 ceph-mon[31788]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T08:30:08.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:08 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:08 smithi167 ceph-mon[34903]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:30:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:08 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]: dispatch 2024-03-27T08:30:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:08 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]': finished 2024-03-27T08:30:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:08 smithi167 ceph-mon[34903]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T08:30:08.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:08 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:08 smithi173 ceph-mon[35397]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-03-27T08:30:08.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:08 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]: dispatch 2024-03-27T08:30:08.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:08 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/520714531' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "654dec9e-fa4b-4083-8f5a-770d7c0c96e6"}]': finished 2024-03-27T08:30:08.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:08 smithi173 ceph-mon[35397]: osdmap e67: 10 total, 9 up, 10 in 2024-03-27T08:30:08.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:08 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:09.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:09 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/232350900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:09.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:09 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/232350900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:09.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:09 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/232350900' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:10.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:10 smithi173 ceph-mon[35397]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:10.685 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:10 smithi164 ceph-mon[31788]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:10 smithi167 ceph-mon[34903]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:12.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:12 smithi164 ceph-mon[31788]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:12.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:12 smithi173 ceph-mon[35397]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:12 smithi167 ceph-mon[34903]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:14.423 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:14 smithi164 ceph-mon[31788]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:14 smithi167 ceph-mon[34903]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:14 smithi173 ceph-mon[35397]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:16.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:16 smithi164 ceph-mon[31788]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:16 smithi167 ceph-mon[34903]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:16 smithi173 ceph-mon[35397]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:17.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T08:30:17.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:17.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T08:30:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-03-27T08:30:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:18.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:18 smithi164 ceph-mon[31788]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:18 smithi164 ceph-mon[31788]: Deploying daemon osd.9 on smithi164 2024-03-27T08:30:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:18 smithi167 ceph-mon[34903]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:18 smithi167 ceph-mon[34903]: Deploying daemon osd.9 on smithi164 2024-03-27T08:30:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:18 smithi173 ceph-mon[35397]: pgmap v267: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:18 smithi173 ceph-mon[35397]: Deploying daemon osd.9 on smithi164 2024-03-27T08:30:20.624 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:20 smithi164 ceph-mon[31788]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:20 smithi167 ceph-mon[34903]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:20.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:20 smithi173 ceph-mon[35397]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:22.497 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:22 smithi164 ceph-mon[31788]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:22 smithi167 ceph-mon[34903]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:22 smithi173 ceph-mon[35397]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:24.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:24 smithi164 ceph-mon[31788]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:24 smithi167 ceph-mon[34903]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:24 smithi173 ceph-mon[35397]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:26.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:26 smithi164 ceph-mon[31788]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:26.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.625 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:26 smithi167 ceph-mon[34903]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:26 smithi173 ceph-mon[35397]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:28.739 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:28 smithi164 ceph-mon[31788]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:28 smithi167 ceph-mon[34903]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:28 smithi173 ceph-mon[35397]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:30.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.643+0000 7fc0d4c00700 1 -- 172.21.15.164:0/3869309321 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc0d80fec30 con 0x7fc0bc0a36a0 2024-03-27T08:30:30.636 INFO:teuthology.orchestra.run.smithi164.stdout:Created osd(s) 9 on host 'smithi164' 2024-03-27T08:30:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.648+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 msgr2=0x7fc0bc0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.648+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 0x7fc0bc0a5b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fc0c8005fd0 tx=0x7fc0c8005e50 comp rx=0 tx=0).stop 2024-03-27T08:30:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 msgr2=0x7fc0d8104090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:30.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0009850 tx=0x7fc0d0007dc0 comp rx=0 tx=0).stop 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 shutdown_connections 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc0bc0a36a0 0x7fc0bc0a5b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc0d8103110 0x7fc0d8104090 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc0d8101570 0x7fc0d8105500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 --2- 172.21.15.164:0/3869309321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0d8102770 0x7fc0d8103b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:30.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 >> 172.21.15.164:0/3869309321 conn(0x7fc0d80fcb10 msgr2=0x7fc0d80fe520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:30:30.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 shutdown_connections 2024-03-27T08:30:30.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:30:30.649+0000 7fc0df200700 1 -- 172.21.15.164:0/3869309321 wait complete. 2024-03-27T08:30:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:30 smithi164 ceph-mon[31788]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:30 smithi164 ceph-mon[31788]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T08:30:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:30 smithi167 ceph-mon[34903]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:30 smithi167 ceph-mon[34903]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T08:30:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:30 smithi173 ceph-mon[35397]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:30.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:30 smithi173 ceph-mon[35397]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-03-27T08:30:31.502 DEBUG:teuthology.orchestra.run.smithi164:osd.9> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.9.service 2024-03-27T08:30:31.508 INFO:tasks.cephadm:Deploying osd.10 on smithi167 with /dev/vg_nvme/lv_1... 2024-03-27T08:30:31.509 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: osdmap e68: 10 total, 9 up, 10 in 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: osdmap e68: 10 total, 9 up, 10 in 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-03-27T08:30:31.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: osdmap e68: 10 total, 9 up, 10 in 2024-03-27T08:30:31.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]: dispatch 2024-03-27T08:30:31.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:31.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:31.955 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:30:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:32 smithi164 ceph-mon[31788]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:32 smithi164 ceph-mon[31788]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:30:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:32 smithi164 ceph-mon[31788]: osdmap e69: 10 total, 9 up, 10 in 2024-03-27T08:30:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:32.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:32 smithi167 ceph-mon[34903]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:32 smithi167 ceph-mon[34903]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:30:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:32 smithi167 ceph-mon[34903]: osdmap e69: 10 total, 9 up, 10 in 2024-03-27T08:30:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:32 smithi173 ceph-mon[35397]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:32 smithi173 ceph-mon[35397]: from='osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi164", "root=default"]}]': finished 2024-03-27T08:30:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:32 smithi173 ceph-mon[35397]: osdmap e69: 10 total, 9 up, 10 in 2024-03-27T08:30:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:32.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:30:33.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:30:33.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] boot 2024-03-27T08:30:33.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: osdmap e70: 10 total, 10 up, 10 in 2024-03-27T08:30:33.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:33.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:33 smithi167 ceph-mon[34903]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:33.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:30:33.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:30:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] boot 2024-03-27T08:30:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: osdmap e70: 10 total, 10 up, 10 in 2024-03-27T08:30:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:33.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:33 smithi173 ceph-mon[35397]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: osd.9 [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] boot 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: osdmap e70: 10 total, 10 up, 10 in 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-03-27T08:30:33.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:33 smithi164 ceph-mon[31788]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 270 MiB used, 804 GiB / 805 GiB avail 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr: stderr: 10+0 records in 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:10+0 records out 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0350324 s, 299 MB/s 2024-03-27T08:30:34.731 INFO:teuthology.orchestra.run.smithi167.stderr:--> Zapping successful for: 2024-03-27T08:30:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:34 smithi167 ceph-mon[34903]: osdmap e71: 10 total, 10 up, 10 in 2024-03-27T08:30:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:34 smithi173 ceph-mon[35397]: osdmap e71: 10 total, 10 up, 10 in 2024-03-27T08:30:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:34 smithi164 ceph-mon[31788]: osdmap e71: 10 total, 10 up, 10 in 2024-03-27T08:30:35.469 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2024-03-27T08:30:35.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:35 smithi167 ceph-mon[34903]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:35.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:35 smithi173 ceph-mon[35397]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:35.909 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:30:36.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:35 smithi164 ceph-mon[31788]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi164 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.690 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi164 to 4272M 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.691 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:37 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi164 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi164 to 4272M 2024-03-27T08:30:37.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:37 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi164 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi164 to 4272M 2024-03-27T08:30:37.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:30:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:37 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 -- 172.21.15.167:0/1770548726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c076670 msgr2=0x7f293c074ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 --2- 172.21.15.167:0/1770548726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c076670 0x7f293c074ad0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f292c009990 tx=0x7f292c009ca0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 -- 172.21.15.167:0/1770548726 shutdown_connections 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 --2- 172.21.15.167:0/1770548726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c10a540 0x7f293c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 --2- 172.21.15.167:0/1770548726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c076670 0x7f293c074ad0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 --2- 172.21.15.167:0/1770548726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c0750a0 0x7f293c075520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 -- 172.21.15.167:0/1770548726 >> 172.21.15.167:0/1770548726 conn(0x7f293c0fdc50 msgr2=0x7f293c100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 -- 172.21.15.167:0/1770548726 shutdown_connections 2024-03-27T08:30:37.862 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.869+0000 7f2942200700 1 -- 172.21.15.167:0/1770548726 wait complete. 2024-03-27T08:30:37.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.870+0000 7f2942200700 1 Processor -- start 2024-03-27T08:30:37.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 -- start start 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c076670 0x7f293c19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 0x7f293c1a1f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f293c110420 con 0x7f293c076670 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1102a0 con 0x7f293c0750a0 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2942200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f293c1105a0 con 0x7f293c10a540 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f293b400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f293b400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:40422/0 (socket says 172.21.15.167:40422) 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f293b400700 1 -- 172.21.15.167:0/2801219852 learned_addr learned my addr 172.21.15.167:0/2801219852 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.871+0000 7f2932a00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c076670 0x7f293c19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293be00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 0x7f293c1a1f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:37.865 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 -- 172.21.15.167:0/2801219852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 msgr2=0x7f293c1a1f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 0x7f293c1a1f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 -- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c076670 msgr2=0x7f293c19af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c076670 0x7f293c19af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 -- 172.21.15.167:0/2801219852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f293c1a2630 con 0x7f293c0750a0 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293be00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 0x7f293c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:30:37.866 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f293b400700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f292c00b5c0 tx=0x7f292c0057c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c027070 con 0x7f293c0750a0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f293c1a28c0 con 0x7f293c0750a0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f292c022470 con 0x7f293c0750a0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.872+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f292c00f6a0 con 0x7f293c0750a0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.873+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f293c1a2d10 con 0x7f293c0750a0 2024-03-27T08:30:37.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.874+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f293c069300 con 0x7f293c0750a0 2024-03-27T08:30:37.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.876+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f292c02a070 con 0x7f293c0750a0 2024-03-27T08:30:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.878+0000 7f2938c00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 0x7f29200a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:30:37.870 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.878+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 6261+0+0 (secure 0 0 0) 0x7f292c0d0510 con 0x7f293c0750a0 2024-03-27T08:30:37.871 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.879+0000 7f2932a00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 0x7f29200a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:30:37.872 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.880+0000 7f2932a00700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 0x7f29200a5b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2924005fd0 tx=0x7f2924005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:30:37.875 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:37.883+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f292c013070 con 0x7f293c0750a0 2024-03-27T08:30:38.112 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:30:38.119+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f293c062a80 con 0x7f29200a36a0 2024-03-27T08:30:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:38 smithi164 ceph-mon[31788]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:38.781 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:38 smithi167 ceph-mon[34903]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:38.781 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:38.781 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:38.781 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:38.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:38 smithi173 ceph-mon[35397]: pgmap v281: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:38.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:30:38.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:30:38.827 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:39.694 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:39 smithi167 ceph-mon[34903]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:39 smithi164 ceph-mon[31788]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:39.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:39 smithi173 ceph-mon[35397]: from='client.34340 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:30:40.726 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:40 smithi167 ceph-mon[34903]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:40.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:40 smithi164 ceph-mon[31788]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:40 smithi173 ceph-mon[35397]: pgmap v282: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/126600927' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]': finished 2024-03-27T08:30:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T08:30:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:30:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/126600927' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]': finished 2024-03-27T08:30:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T08:30:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:30:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/126600927' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]: dispatch 2024-03-27T08:30:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4083fbc0-a61b-4fbc-b8a4-9ec80308a49c"}]': finished 2024-03-27T08:30:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: osdmap e72: 11 total, 10 up, 11 in 2024-03-27T08:30:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:30:43.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.167:0/1116679747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.167:0/1116679747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:44.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.167:0/1116679747' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:30:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:44 smithi167 ceph-mon[34903]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:44 smithi173 ceph-mon[35397]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:44 smithi164 ceph-mon[31788]: pgmap v285: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:46 smithi167 ceph-mon[34903]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:46 smithi173 ceph-mon[35397]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:46 smithi164 ceph-mon[31788]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:48.745 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:48 smithi167 ceph-mon[34903]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:48.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:48 smithi173 ceph-mon[35397]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:48 smithi164 ceph-mon[31788]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:50 smithi167 ceph-mon[34903]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:50 smithi173 ceph-mon[35397]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:50 smithi164 ceph-mon[31788]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:51.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:51 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T08:30:51.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:51 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:51.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:51 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T08:30:51.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:51 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-03-27T08:30:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:51 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:30:52.750 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:52 smithi167 ceph-mon[34903]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:52.750 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:52 smithi167 ceph-mon[34903]: Deploying daemon osd.10 on smithi167 2024-03-27T08:30:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:52 smithi173 ceph-mon[35397]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:52 smithi173 ceph-mon[35397]: Deploying daemon osd.10 on smithi167 2024-03-27T08:30:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:52 smithi164 ceph-mon[31788]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:52 smithi164 ceph-mon[31788]: Deploying daemon osd.10 on smithi167 2024-03-27T08:30:53.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:53 smithi167 ceph-mon[34903]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:54.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:53 smithi164 ceph-mon[31788]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:54.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:53 smithi173 ceph-mon[35397]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:56.533 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:56 smithi167 ceph-mon[34903]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:56.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:56 smithi173 ceph-mon[35397]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:56 smithi164 ceph-mon[31788]: pgmap v291: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:58.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:30:58 smithi173 ceph-mon[35397]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:58.587 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:30:58 smithi164 ceph-mon[31788]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:30:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:30:58 smithi167 ceph-mon[34903]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:00 smithi164 ceph-mon[31788]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:00 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:00.582 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:00 smithi167 ceph-mon[34903]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:00.582 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.582 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.582 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:00 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:00.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:00 smithi173 ceph-mon[35397]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:00.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:00.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:00 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:02.559 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:02 smithi167 ceph-mon[34903]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:02 smithi164 ceph-mon[31788]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:02 smithi173 ceph-mon[35397]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:04.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.330+0000 7f2938c00700 1 -- 172.21.15.167:0/2801219852 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f293c062a80 con 0x7f29200a36a0 2024-03-27T08:31:04.324 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 10 on host 'smithi167' 2024-03-27T08:31:04.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.333+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 msgr2=0x7f29200a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:04.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 0x7f29200a5b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2924005fd0 tx=0x7f2924005e50 comp rx=0 tx=0).stop 2024-03-27T08:31:04.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 msgr2=0x7f293c19a9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f292c00b5c0 tx=0x7f292c0057c0 comp rx=0 tx=0).stop 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 shutdown_connections 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f29200a36a0 0x7f29200a5b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f293c10a540 0x7f293c1a1f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f293c0750a0 0x7f293c19a9d0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:04.327 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 --2- 172.21.15.167:0/2801219852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f293c076670 0x7f293c19af10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:04.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 >> 172.21.15.167:0/2801219852 conn(0x7f293c0fdc50 msgr2=0x7f293c106440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:04.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 shutdown_connections 2024-03-27T08:31:04.328 INFO:teuthology.orchestra.run.smithi167.stderr:2024-03-27T08:31:04.334+0000 7f2942200700 1 -- 172.21.15.167:0/2801219852 wait complete. 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:04 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:04 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:04.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:04 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:05.126 DEBUG:teuthology.orchestra.run.smithi167:osd.10> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.10.service 2024-03-27T08:31:05.133 INFO:tasks.cephadm:Deploying osd.11 on smithi173 with /dev/vg_nvme/lv_1... 2024-03-27T08:31:05.133 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-03-27T08:31:05.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:05 smithi173 ceph-mon[35397]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T08:31:05.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:05 smithi173 ceph-mon[35397]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:05.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:05 smithi173 ceph-mon[35397]: osdmap e73: 11 total, 10 up, 11 in 2024-03-27T08:31:05.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:05 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:05.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:05 smithi173 ceph-mon[35397]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:05.576 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:31:05.682 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-mon[34903]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T08:31:05.682 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-mon[34903]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:05.682 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-mon[34903]: osdmap e73: 11 total, 10 up, 11 in 2024-03-27T08:31:05.682 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:05.682 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-mon[34903]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:05.683 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:31:05.421+0000 7f2a0cc00700 -1 osd.10 0 waiting for initial osdmap 2024-03-27T08:31:05.683 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:31:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:31:05.451+0000 7f2a07a00700 -1 osd.10 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:31:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:05 smithi164 ceph-mon[31788]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-03-27T08:31:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:05 smithi164 ceph-mon[31788]: from='osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:05 smithi164 ceph-mon[31788]: osdmap e73: 11 total, 10 up, 11 in 2024-03-27T08:31:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:05 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:05.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:05 smithi164 ceph-mon[31788]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-03-27T08:31:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:06 smithi173 ceph-mon[35397]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:06 smithi173 ceph-mon[35397]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:31:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:06 smithi173 ceph-mon[35397]: osdmap e74: 11 total, 10 up, 11 in 2024-03-27T08:31:06.742 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:06.743 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:06.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:06 smithi167 ceph-mon[34903]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:06.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:06 smithi167 ceph-mon[34903]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:31:06.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:06 smithi167 ceph-mon[34903]: osdmap e74: 11 total, 10 up, 11 in 2024-03-27T08:31:06.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:06.751 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:06 smithi164 ceph-mon[31788]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 297 MiB used, 894 GiB / 894 GiB avail 2024-03-27T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:06 smithi164 ceph-mon[31788]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-03-27T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:06 smithi164 ceph-mon[31788]: osdmap e74: 11 total, 10 up, 11 in 2024-03-27T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] boot 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:07.441 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:07 smithi167 ceph-mon[34903]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T08:31:07.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:31:07.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:31:07.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] boot 2024-03-27T08:31:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T08:31:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:07.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:07 smithi164 ceph-mon[31788]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T08:31:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:31:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:31:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: osd.10 [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] boot 2024-03-27T08:31:07.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: osdmap e75: 11 total, 11 up, 11 in 2024-03-27T08:31:07.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-03-27T08:31:07.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:07 smithi173 ceph-mon[35397]: osdmap e76: 11 total, 11 up, 11 in 2024-03-27T08:31:08.340 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-03-27T08:31:08.340 INFO:teuthology.orchestra.run.smithi173.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-03-27T08:31:08.341 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10+0 records in 2024-03-27T08:31:08.341 INFO:teuthology.orchestra.run.smithi173.stderr:10+0 records out 2024-03-27T08:31:08.341 INFO:teuthology.orchestra.run.smithi173.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0346056 s, 303 MB/s 2024-03-27T08:31:08.341 INFO:teuthology.orchestra.run.smithi173.stderr:--> Zapping successful for: 2024-03-27T08:31:08.720 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:08 smithi167 ceph-mon[34903]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:08.720 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:08 smithi167 ceph-mon[34903]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T08:31:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:08 smithi164 ceph-mon[31788]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:08 smithi164 ceph-mon[31788]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T08:31:08.784 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:08 smithi173 ceph-mon[35397]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:08.784 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:08 smithi173 ceph-mon[35397]: osdmap e77: 11 total, 11 up, 11 in 2024-03-27T08:31:09.199 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch daemon add osd smithi173:vg_nvme/lv_1 2024-03-27T08:31:09.643 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: osdmap e78: 11 total, 11 up, 11 in 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:10.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:10.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: osdmap e78: 11 total, 11 up, 11 in 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:10.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:10.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: osdmap e78: 11 total, 11 up, 11 in 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:10.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:10.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:10.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:10.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi167 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi167 to 4272M 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: osdmap e79: 11 total, 11 up, 11 in 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:11.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 -- 172.21.15.173:0/3383478982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93081048c0 msgr2=0x7f9308104ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 --2- 172.21.15.173:0/3383478982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93081048c0 0x7f9308104ce0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92f8009990 tx=0x7f92f8009ca0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 -- 172.21.15.173:0/3383478982 shutdown_connections 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 --2- 172.21.15.173:0/3383478982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 0x7f930810cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 --2- 172.21.15.173:0/3383478982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f93081048c0 0x7f9308104ce0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 --2- 172.21.15.173:0/3383478982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9308105ac0 0x7f9308105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 -- 172.21.15.173:0/3383478982 >> 172.21.15.173:0/3383478982 conn(0x7f93080ffe60 msgr2=0x7f93081022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 -- 172.21.15.173:0/3383478982 shutdown_connections 2024-03-27T08:31:11.754 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.761+0000 7f930ce00700 1 -- 172.21.15.173:0/3383478982 wait complete. 2024-03-27T08:31:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi167 2024-03-27T08:31:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi167 to 4272M 2024-03-27T08:31:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: osdmap e79: 11 total, 11 up, 11 in 2024-03-27T08:31:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:11.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:11.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:11.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:11.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.762+0000 7f930ce00700 1 Processor -- start 2024-03-27T08:31:11.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.762+0000 7f930ce00700 1 -- start start 2024-03-27T08:31:11.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.762+0000 7f930ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93081048c0 0x7f930819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:11.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.762+0000 7f930ce00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:11.757 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f930ce00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 0x7f93081a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f930ce00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9308110490 con 0x7f93081048c0 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f930ce00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9308110310 con 0x7f9308106460 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f930ce00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9308110610 con 0x7f9308105ac0 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:48606/0 (socket says 172.21.15.173:48606) 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 -- 172.21.15.173:0/2720795560 learned_addr learned my addr 172.21.15.173:0/2720795560 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f9306800700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 0x7f93081a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f9305e00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93081048c0 0x7f930819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 -- 172.21.15.173:0/2720795560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 msgr2=0x7f93081a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 0x7f93081a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 -- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93081048c0 msgr2=0x7f930819aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.763+0000 7f92ffe00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93081048c0 0x7f930819aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:11.758 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f92ffe00700 1 -- 172.21.15.173:0/2720795560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93081a26d0 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f92ffe00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d980 tx=0x7f92f000dc90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f0016070 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f92f0009da0 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93081a29c0 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92f000f3c0 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.764+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93081a2f00 con 0x7f9308105ac0 2024-03-27T08:31:11.759 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.766+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9308069300 con 0x7f9308105ac0 2024-03-27T08:31:11.762 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.769+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f92f0019070 con 0x7f9308105ac0 2024-03-27T08:31:11.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.770+0000 7f92fea00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 0x7f92ec0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:11.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.771+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 6694+0+0 (secure 0 0 0) 0x7f92f00cf1f0 con 0x7f9308105ac0 2024-03-27T08:31:11.763 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.771+0000 7f9305e00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 0x7f92ec0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:11.765 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.772+0000 7f9305e00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 0x7f92ec0a5b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003900 tx=0x7f92f80039d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:11.766 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:11.774+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f92f009c370 con 0x7f9308105ac0 2024-03-27T08:31:11.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi167 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi167 to 4272M 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: osdmap e79: 11 total, 11 up, 11 in 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:11.999 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:12.006+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f9308062a80 con 0x7f92ec0a36a0 2024-03-27T08:31:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:12 smithi167 ceph-mon[34903]: pgmap v306: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:31:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:31:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:31:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:12 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:12 smithi173 ceph-mon[35397]: pgmap v306: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:31:12.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:31:12.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:31:12.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:12 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:12 smithi164 ceph-mon[31788]: pgmap v306: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 124 KiB/s, 0 objects/s recovering 2024-03-27T08:31:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-27T08:31:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-27T08:31:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:12 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:13.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:13 smithi167 ceph-mon[34903]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:13.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:13 smithi173 ceph-mon[35397]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:14.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:13 smithi164 ceph-mon[31788]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi173:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:14.672 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:14 smithi173 ceph-mon[35397]: pgmap v307: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:31:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:14 smithi167 ceph-mon[34903]: pgmap v307: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:31:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:14 smithi164 ceph-mon[31788]: pgmap v307: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-03-27T08:31:15.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:15 smithi167 ceph-mon[34903]: pgmap v308: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-27T08:31:15.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:15 smithi173 ceph-mon[35397]: pgmap v308: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-27T08:31:16.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:15 smithi164 ceph-mon[31788]: pgmap v308: 1 pgs: 1 peering; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-03-27T08:31:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:16 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/901136481' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:16.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:16 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:16.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:16 smithi173 ceph-mon[35397]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]': finished 2024-03-27T08:31:16.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:16 smithi173 ceph-mon[35397]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T08:31:16.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:17.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:16 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/901136481' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:17.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:16 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:17.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:16 smithi164 ceph-mon[31788]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]': finished 2024-03-27T08:31:17.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:16 smithi164 ceph-mon[31788]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T08:31:17.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:17.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:16 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/901136481' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:17.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:16 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]: dispatch 2024-03-27T08:31:17.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:16 smithi167 ceph-mon[34903]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5e276690-d955-4f55-958c-de42c3d3915e"}]': finished 2024-03-27T08:31:17.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:16 smithi167 ceph-mon[34903]: osdmap e80: 12 total, 11 up, 12 in 2024-03-27T08:31:17.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:18.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:17 smithi164 ceph-mon[31788]: from='client.? 172.21.15.173:0/3543498702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:31:18.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:17 smithi164 ceph-mon[31788]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T08:31:18.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:17 smithi167 ceph-mon[34903]: from='client.? 172.21.15.173:0/3543498702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:31:18.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:17 smithi167 ceph-mon[34903]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T08:31:18.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:17 smithi173 ceph-mon[35397]: from='client.? 172.21.15.173:0/3543498702' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-27T08:31:18.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:17 smithi173 ceph-mon[35397]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 74 KiB/s, 0 objects/s recovering 2024-03-27T08:31:20.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:20 smithi173 ceph-mon[35397]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:20 smithi164 ceph-mon[31788]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:20 smithi167 ceph-mon[34903]: pgmap v311: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:22 smithi164 ceph-mon[31788]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:22.790 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:22 smithi173 ceph-mon[35397]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:22 smithi167 ceph-mon[34903]: pgmap v312: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:24.548 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:24 smithi173 ceph-mon[35397]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:24 smithi164 ceph-mon[31788]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:24 smithi167 ceph-mon[34903]: pgmap v313: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:26 smithi164 ceph-mon[31788]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T08:31:26.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:26 smithi167 ceph-mon[34903]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T08:31:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:26 smithi173 ceph-mon[35397]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-03-27T08:31:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:27.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:27 smithi173 ceph-mon[35397]: Deploying daemon osd.11 on smithi173 2024-03-27T08:31:27.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:27 smithi164 ceph-mon[31788]: Deploying daemon osd.11 on smithi173 2024-03-27T08:31:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:27 smithi167 ceph-mon[34903]: Deploying daemon osd.11 on smithi173 2024-03-27T08:31:28.656 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:28 smithi164 ceph-mon[31788]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:28.667 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:28 smithi173 ceph-mon[35397]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:28 smithi167 ceph-mon[34903]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:30.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:30 smithi173 ceph-mon[35397]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:30 smithi164 ceph-mon[31788]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:30 smithi167 ceph-mon[34903]: pgmap v316: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:32.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:32 smithi173 ceph-mon[35397]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:32.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:32 smithi164 ceph-mon[31788]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:32 smithi167 ceph-mon[34903]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:34 smithi164 ceph-mon[31788]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:34 smithi167 ceph-mon[34903]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:34.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:34.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:34.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:34 smithi173 ceph-mon[35397]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:36.694 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:36 smithi173 ceph-mon[35397]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:36.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:36 smithi164 ceph-mon[31788]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:36 smithi167 ceph-mon[34903]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:38 smithi173 ceph-mon[35397]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:38 smithi164 ceph-mon[31788]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:38 smithi167 ceph-mon[34903]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-03-27T08:31:38.822 INFO:teuthology.orchestra.run.smithi173.stdout:Created osd(s) 11 on host 'smithi173' 2024-03-27T08:31:38.822 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.829+0000 7f92fea00700 1 -- 172.21.15.173:0/2720795560 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f9308062a80 con 0x7f92ec0a36a0 2024-03-27T08:31:38.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.833+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 msgr2=0x7f92ec0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:38.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.833+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 0x7f92ec0a5b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f92f8003900 tx=0x7f92f80039d0 comp rx=0 tx=0).stop 2024-03-27T08:31:38.825 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.833+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 msgr2=0x7f930819afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.833+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f92f000d980 tx=0x7f92f000dc90 comp rx=0 tx=0).stop 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 shutdown_connections 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f92ec0a36a0 0x7f92ec0a5b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9308106460 0x7f93081a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f93081048c0 0x7f930819aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 --2- 172.21.15.173:0/2720795560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9308105ac0 0x7f930819afb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 >> 172.21.15.173:0/2720795560 conn(0x7f93080ffe60 msgr2=0x7f9308108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 shutdown_connections 2024-03-27T08:31:38.826 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:38.834+0000 7f930ce00700 1 -- 172.21.15.173:0/2720795560 wait complete. 2024-03-27T08:31:39.723 DEBUG:teuthology.orchestra.run.smithi173:osd.11> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.11.service 2024-03-27T08:31:39.729 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-03-27T08:31:39.729 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd stat -f json 2024-03-27T08:31:39.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:39.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:39.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:39.926 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T08:31:39.927 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:39.927 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: osdmap e81: 12 total, 11 up, 12 in 2024-03-27T08:31:39.927 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:39.927 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:39.927 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-mon[35397]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: osdmap e81: 12 total, 11 up, 12 in 2024-03-27T08:31:40.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:40.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:40.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:39 smithi167 ceph-mon[34903]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:40.177 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:31:40.213 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:31:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:31:39.950+0000 7f8728c00700 -1 osd.11 0 waiting for initial osdmap 2024-03-27T08:31:40.213 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:31:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:31:40.003+0000 7f8723a00700 -1 osd.11 82 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: osdmap e81: 12 total, 11 up, 12 in 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]: dispatch 2024-03-27T08:31:40.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:39 smithi164 ceph-mon[31788]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:41.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:40 smithi173 ceph-mon[35397]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:31:41.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:40 smithi173 ceph-mon[35397]: osdmap e82: 12 total, 11 up, 12 in 2024-03-27T08:31:41.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:40 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:41.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:40 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:41.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:40 smithi164 ceph-mon[31788]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:31:41.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:40 smithi164 ceph-mon[31788]: osdmap e82: 12 total, 11 up, 12 in 2024-03-27T08:31:41.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:41.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:40 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:41.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:40 smithi167 ceph-mon[34903]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi173", "root=default"]}]': finished 2024-03-27T08:31:41.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:40 smithi167 ceph-mon[34903]: osdmap e82: 12 total, 11 up, 12 in 2024-03-27T08:31:41.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:40 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:41.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:40 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: purged_snaps scrub starts 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: purged_snaps scrub ok 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] boot 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:42.229 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:41 smithi164 ceph-mon[31788]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: purged_snaps scrub starts 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: purged_snaps scrub ok 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] boot 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:42.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:41 smithi167 ceph-mon[34903]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: purged_snaps scrub starts 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: purged_snaps scrub ok 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: osd.11 [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] boot 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: osdmap e83: 12 total, 12 up, 12 in 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-03-27T08:31:42.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:41 smithi173 ceph-mon[35397]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 -- 172.21.15.164:0/1200274277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 msgr2=0x7f9edc103ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 --2- 172.21.15.164:0/1200274277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc103ce0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9ec40099c0 tx=0x7f9ec4009cd0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 -- 172.21.15.164:0/1200274277 shutdown_connections 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 --2- 172.21.15.164:0/1200274277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc10aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 --2- 172.21.15.164:0/1200274277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 0x7f9edc102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 --2- 172.21.15.164:0/1200274277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc103ce0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 -- 172.21.15.164:0/1200274277 >> 172.21.15.164:0/1200274277 conn(0x7f9edc0fdbe0 msgr2=0x7f9edc100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 -- 172.21.15.164:0/1200274277 shutdown_connections 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.396+0000 7f9ee2000700 1 -- 172.21.15.164:0/1200274277 wait complete. 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.397+0000 7f9ee2000700 1 Processor -- start 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 -- start start 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 0x7f9edc19ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc1a20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10e230 con 0x7f9edc103880 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10e0b0 con 0x7f9edc102680 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ee2000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9edc10e3b0 con 0x7f9edc104220 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ed3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ed3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42756/0 (socket says 172.21.15.164:42756) 2024-03-27T08:31:42.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9ed3e00700 1 -- 172.21.15.164:0/505598050 learned_addr learned my addr 172.21.15.164:0/505598050 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9edbe00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc1a20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.398+0000 7f9edb400700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 0x7f9edc19ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 -- 172.21.15.164:0/505598050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 msgr2=0x7f9edc1a20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc1a20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 -- 172.21.15.164:0/505598050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 msgr2=0x7f9edc19ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 0x7f9edc19ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 -- 172.21.15.164:0/505598050 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc1a2780 con 0x7f9edc103880 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9edbe00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc1a20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed3e00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4005910 tx=0x7f9ec4009510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4027070 con 0x7f9edc103880 2024-03-27T08:31:42.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9ec40041b0 con 0x7f9edc103880 2024-03-27T08:31:42.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ec4022e60 con 0x7f9edc103880 2024-03-27T08:31:42.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.399+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc1a2a10 con 0x7f9edc103880 2024-03-27T08:31:42.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.400+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9edc1a2e10 con 0x7f9edc103880 2024-03-27T08:31:42.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.401+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9edc069330 con 0x7f9edc103880 2024-03-27T08:31:42.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.403+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f9ec402a070 con 0x7f9edc103880 2024-03-27T08:31:42.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.405+0000 7f9ed8c00700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 0x7f9ec00a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:42.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.405+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f9ec40d0760 con 0x7f9edc103880 2024-03-27T08:31:42.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.405+0000 7f9edb400700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 0x7f9ec00a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:42.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.406+0000 7f9edb400700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 0x7f9ec00a5b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005950 tx=0x7f9ecc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:42.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.409+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9edc069330 con 0x7f9edc103880 2024-03-27T08:31:42.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.639+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f9edc1a3850 con 0x7f9edc103880 2024-03-27T08:31:42.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.640+0000 7f9ed8c00700 1 -- 172.21.15.164:0/505598050 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v84) ==== 74+0+133 (secure 0 0 0) 0x7f9ec4013070 con 0x7f9edc103880 2024-03-27T08:31:42.633 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.643+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 msgr2=0x7f9ec00a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.643+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 0x7f9ec00a5b60 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc005950 tx=0x7f9ecc0058e0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.643+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 msgr2=0x7f9edc19b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.643+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9ec4005910 tx=0x7f9ec4009510 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 shutdown_connections 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9ec00a36a0 0x7f9ec00a5b60 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9edc104220 0x7f9edc1a20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9edc102680 0x7f9edc19ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 --2- 172.21.15.164:0/505598050 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9edc103880 0x7f9edc19b060 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:42.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 >> 172.21.15.164:0/505598050 conn(0x7f9edc0fdbe0 msgr2=0x7f9edc074870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:42.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 shutdown_connections 2024-03-27T08:31:42.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:42.644+0000 7f9ee2000700 1 -- 172.21.15.164:0/505598050 wait complete. 2024-03-27T08:31:43.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:42 smithi164 ceph-mon[31788]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T08:31:43.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:42 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/505598050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T08:31:43.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:42 smithi167 ceph-mon[34903]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T08:31:43.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:42 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/505598050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T08:31:43.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:42 smithi173 ceph-mon[35397]: osdmap e84: 12 total, 12 up, 12 in 2024-03-27T08:31:43.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:42 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/505598050' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-27T08:31:43.441 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":84,"num_osds":12,"num_up_osds":12,"osd_up_since":1711528300,"num_in_osds":12,"osd_in_since":1711528275,"num_remapped_pgs":0} 2024-03-27T08:31:43.442 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T08:31:43.864 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:31:44.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:43 smithi164 ceph-mon[31788]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:44.186 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:43 smithi173 ceph-mon[35397]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:44.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:43 smithi167 ceph-mon[34903]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: Detected new or changed devices on smithi173 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi173 to 4272M 2024-03-27T08:31:45.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:45.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:45.506 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: Detected new or changed devices on smithi173 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi173 to 4272M 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:45.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: Detected new or changed devices on smithi173 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi173 to 4272M 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:45.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:45.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:45.576 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:46.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 -- 172.21.15.164:0/1779190575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c1051f0 msgr2=0x7f4f1c111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:46.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1779190575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c111700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400b0a0 tx=0x7f4f1400b3b0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 -- 172.21.15.164:0/1779190575 shutdown_connections 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1779190575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c111700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1779190575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 0x7f4f1c10ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1779190575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c104830 0x7f4f1c104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 -- 172.21.15.164:0/1779190575 >> 172.21.15.164:0/1779190575 conn(0x7f4f1c100320 msgr2=0x7f4f1c102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 -- 172.21.15.164:0/1779190575 shutdown_connections 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.027+0000 7f4f20e00700 1 -- 172.21.15.164:0/1779190575 wait complete. 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.028+0000 7f4f20e00700 1 Processor -- start 2024-03-27T08:31:46.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 -- start start 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c19b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 0x7f4f1c19f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c114b80 con 0x7f4f1c104830 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c114a00 con 0x7f4f1c1051f0 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f20e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4f1c114d00 con 0x7f4f1c10a830 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f19e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f19e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60474/0 (socket says 172.21.15.164:60474) 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.029+0000 7f4f19e00700 1 -- 172.21.15.164:0/1962018611 learned_addr learned my addr 172.21.15.164:0/1962018611 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19400700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c19b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f1a800700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 0x7f4f1c19f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:46.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 -- 172.21.15.164:0/1962018611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 msgr2=0x7f4f1c19f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 0x7f4f1c19f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 -- 172.21.15.164:0/1962018611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1051f0 msgr2=0x7f4f1c19b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c19b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 -- 172.21.15.164:0/1962018611 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f1c19fed0 con 0x7f4f1c104830 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f19e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00c9b0 tx=0x7f4f0c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c007b00 con 0x7f4f1c104830 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4f0c007ca0 con 0x7f4f1c104830 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f0c018780 con 0x7f4f1c104830 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.030+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f1c1a01c0 con 0x7f4f1c104830 2024-03-27T08:31:46.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.031+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f1c1a7a40 con 0x7f4f1c104830 2024-03-27T08:31:46.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.032+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f1c069300 con 0x7f4f1c104830 2024-03-27T08:31:46.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.034+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f4f0c00f450 con 0x7f4f1c104830 2024-03-27T08:31:46.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.035+0000 7f4f12a00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 0x7f4f000a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:46.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.036+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f4f0c0cfbc0 con 0x7f4f1c104830 2024-03-27T08:31:46.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.036+0000 7f4f19400700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 0x7f4f000a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:46.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.036+0000 7f4f19400700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 0x7f4f000a5be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005950 tx=0x7f4f080058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:46.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.038+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4f0c014030 con 0x7f4f1c104830 2024-03-27T08:31:46.259 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.266+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f1c19c220 con 0x7f4f1c104830 2024-03-27T08:31:46.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.269+0000 7f4f12a00700 1 -- 172.21.15.164:0/1962018611 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+18526 (secure 0 0 0) 0x7f4f0c09cca0 con 0x7f4f1c104830 2024-03-27T08:31:46.262 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:31:46.263 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":84,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:31:41.940501+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:31:46.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 msgr2=0x7f4f000a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:46.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 0x7f4f000a5be0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f08005950 tx=0x7f4f080058e0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 msgr2=0x7f4f1c19af10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f4f0c00c9b0 tx=0x7f4f0c00cd70 comp rx=0 tx=0).stop 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 shutdown_connections 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4f000a3720 0x7f4f000a5be0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4f1c10a830 0x7f4f1c19f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4f1c104830 0x7f4f1c19af10 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 --2- 172.21.15.164:0/1962018611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f1c1051f0 0x7f4f1c19b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 >> 172.21.15.164:0/1962018611 conn(0x7f4f1c100320 msgr2=0x7f4f1c1007a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.272+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 shutdown_connections 2024-03-27T08:31:46.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:46.273+0000 7f4f20e00700 1 -- 172.21.15.164:0/1962018611 wait complete. 2024-03-27T08:31:46.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:46 smithi167 ceph-mon[34903]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:46.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:46 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1962018611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:46.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:46 smithi173 ceph-mon[35397]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:46.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:46 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1962018611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:46.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:46 smithi164 ceph-mon[31788]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:46.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:46 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1962018611' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:47.004 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:31:47.005 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd pool get .mgr pg_num 2024-03-27T08:31:47.452 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:31:48.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:48 smithi167 ceph-mon[34903]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:48.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:48 smithi173 ceph-mon[35397]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:48 smithi164 ceph-mon[31788]: pgmap v329: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.774+0000 7fddd9a00700 1 -- 172.21.15.164:0/1341541703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 msgr2=0x7fddd4104d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.774+0000 7fddd9a00700 1 --2- 172.21.15.164:0/1341541703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd4104d10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fddc0009990 tx=0x7fddc0009ca0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.774+0000 7fddd9a00700 1 -- 172.21.15.164:0/1341541703 shutdown_connections 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.774+0000 7fddd9a00700 1 --2- 172.21.15.164:0/1341541703 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd4111760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.775+0000 7fddd9a00700 1 --2- 172.21.15.164:0/1341541703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd410ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.775+0000 7fddd9a00700 1 --2- 172.21.15.164:0/1341541703 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd4104d10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.775+0000 7fddd9a00700 1 -- 172.21.15.164:0/1341541703 >> 172.21.15.164:0/1341541703 conn(0x7fddd41003e0 msgr2=0x7fddd4102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:49.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.775+0000 7fddd9a00700 1 -- 172.21.15.164:0/1341541703 shutdown_connections 2024-03-27T08:31:49.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.775+0000 7fddd9a00700 1 -- 172.21.15.164:0/1341541703 wait complete. 2024-03-27T08:31:49.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.776+0000 7fddd9a00700 1 Processor -- start 2024-03-27T08:31:49.769 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.776+0000 7fddd9a00700 1 -- start start 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd419b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd419f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4114b90 con 0x7fddd4104890 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4114a10 con 0x7fddd410a890 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd9a00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fddd4114d10 con 0x7fddd4105250 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:49.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60496/0 (socket says 172.21.15.164:60496) 2024-03-27T08:31:49.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 -- 172.21.15.164:0/380824774 learned_addr learned my addr 172.21.15.164:0/380824774 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:49.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2000700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd419b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd3400700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd419f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 -- 172.21.15.164:0/380824774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 msgr2=0x7fddd419b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd419b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.777+0000 7fddd2a00700 1 -- 172.21.15.164:0/380824774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 msgr2=0x7fddd419f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd2a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd419f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd2a00700 1 -- 172.21.15.164:0/380824774 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd41a00c0 con 0x7fddd4104890 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd2000700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd3400700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd2a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c9b0 tx=0x7fddc400cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4007b00 con 0x7fddd4104890 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fddc4007ca0 con 0x7fddd4104890 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd41a03b0 con 0x7fddd4104890 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddc4018780 con 0x7fddd4104890 2024-03-27T08:31:49.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.778+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd41a7c30 con 0x7fddd4104890 2024-03-27T08:31:49.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.780+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd4069300 con 0x7fddd4104890 2024-03-27T08:31:49.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.781+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fddc400f450 con 0x7fddd4104890 2024-03-27T08:31:49.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.783+0000 7fddcb400700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 0x7fddb80a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:49.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.783+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fddc40cf930 con 0x7fddd4104890 2024-03-27T08:31:49.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.783+0000 7fddd2000700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 0x7fddb80a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:49.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.784+0000 7fddd2000700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 0x7fddb80a5b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fddc0000c00 tx=0x7fddc0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:49.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:49.788+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fddc4014030 con 0x7fddd4104890 2024-03-27T08:31:50.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.011+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fddd419c410 con 0x7fddd4104890 2024-03-27T08:31:50.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.012+0000 7fddcb400700 1 -- 172.21.15.164:0/380824774 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fddc409c900 con 0x7fddd4104890 2024-03-27T08:31:50.005 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:31:50.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 msgr2=0x7fddb80a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:50.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 0x7fddb80a5b60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fddc0000c00 tx=0x7fddc0005fb0 comp rx=0 tx=0).stop 2024-03-27T08:31:50.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 msgr2=0x7fddd419b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:50.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fddc400c9b0 tx=0x7fddc400cd70 comp rx=0 tx=0).stop 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 shutdown_connections 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fddb80a36a0 0x7fddb80a5b60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fddd410a890 0x7fddd419f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fddd4104890 0x7fddd419b100 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 --2- 172.21.15.164:0/380824774 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fddd4105250 0x7fddd419b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.015+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 >> 172.21.15.164:0/380824774 conn(0x7fddd41003e0 msgr2=0x7fddd41009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.016+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 shutdown_connections 2024-03-27T08:31:50.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:50.016+0000 7fddd9a00700 1 -- 172.21.15.164:0/380824774 wait complete. 2024-03-27T08:31:50.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:50 smithi167 ceph-mon[34903]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:50.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/380824774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:50.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:50 smithi173 ceph-mon[35397]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:50.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/380824774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:50.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:50 smithi164 ceph-mon[31788]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:50.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/380824774' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.a on smithi164 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.d on smithi164 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.g on smithi164 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.j on smithi164 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.b on smithi167 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.e on smithi167 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.h on smithi167 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.k on smithi167 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.c on smithi173 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.f on smithi173 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.i on smithi173 2024-03-27T08:31:50.927 INFO:tasks.cephadm:Adding mds.l on smithi173 2024-03-27T08:31:50.928 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph orch apply mds all '12;smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l' 2024-03-27T08:31:51.367 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:31:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:52 smithi167 ceph-mon[34903]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:52 smithi173 ceph-mon[35397]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:52.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:52 smithi164 ceph-mon[31788]: pgmap v331: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.712+0000 7f319a200700 1 -- 172.21.15.173:0/2019138213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194106460 msgr2=0x7f319410cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.712+0000 7f319a200700 1 --2- 172.21.15.173:0/2019138213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194106460 0x7f319410cd10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f318c00b0a0 tx=0x7f318c00b3b0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 -- 172.21.15.173:0/2019138213 shutdown_connections 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 --2- 172.21.15.173:0/2019138213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194106460 0x7f319410cd10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 --2- 172.21.15.173:0/2019138213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31941048c0 0x7f3194104ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 --2- 172.21.15.173:0/2019138213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3194105ac0 0x7f3194105f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 -- 172.21.15.173:0/2019138213 >> 172.21.15.173:0/2019138213 conn(0x7f31940ffe60 msgr2=0x7f31941022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 -- 172.21.15.173:0/2019138213 shutdown_connections 2024-03-27T08:31:53.706 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.713+0000 7f319a200700 1 -- 172.21.15.173:0/2019138213 wait complete. 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 Processor -- start 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 -- start start 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 0x7f319419aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3194106460 0x7f31941a20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3194110590 con 0x7f3194106460 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3194110410 con 0x7f31941048c0 2024-03-27T08:31:53.708 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.714+0000 7f319a200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3194110710 con 0x7f3194105ac0 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.173:56434/0 (socket says 172.21.15.173:56434) 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 -- 172.21.15.173:0/932255744 learned_addr learned my addr 172.21.15.173:0/932255744 (peer_addr_for_me v2:172.21.15.173:0/0) 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3193400700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 0x7f319419aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3193e00700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3194106460 0x7f31941a20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 -- 172.21.15.173:0/932255744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 msgr2=0x7f319419aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 0x7f319419aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 -- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3194106460 msgr2=0x7f31941a20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3194106460 0x7f31941a20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3192a00700 1 -- 172.21.15.173:0/932255744 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31941a2740 con 0x7f3194105ac0 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.715+0000 7f3193400700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 0x7f319419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:31:53.709 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f3192a00700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f318000b560 tx=0x7f318000b920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180015020 con 0x7f3194105ac0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3180011d00 con 0x7f3194105ac0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3180010e30 con 0x7f3194105ac0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31941a2a30 con 0x7f3194105ac0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.716+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31941a2fa0 con 0x7f3194105ac0 2024-03-27T08:31:53.710 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.718+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3194069300 con 0x7f3194105ac0 2024-03-27T08:31:53.712 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.720+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f3180018020 con 0x7f3194105ac0 2024-03-27T08:31:53.713 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.721+0000 7f318be00700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 0x7f31780a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:53.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.721+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f31800cf140 con 0x7f3194105ac0 2024-03-27T08:31:53.714 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.722+0000 7f3193400700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 0x7f31780a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:53.715 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.723+0000 7f3193400700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 0x7f31780a5b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3194105920 tx=0x7f3184008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:53.718 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.726+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f318001f020 con 0x7f3194105ac0 2024-03-27T08:31:53.951 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.958+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}) -- 0x7f3194062c80 con 0x7f31780a36a0 2024-03-27T08:31:53.969 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.976+0000 7f318be00700 1 -- 172.21.15.173:0/932255744 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f3194062c80 con 0x7f31780a36a0 2024-03-27T08:31:53.969 INFO:teuthology.orchestra.run.smithi173.stdout:Scheduled mds.all update... 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 msgr2=0x7f31780a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 0x7f31780a5b60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3194105920 tx=0x7f3184008040 comp rx=0 tx=0).stop 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 msgr2=0x7f319419b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f318000b560 tx=0x7f318000b920 comp rx=0 tx=0).stop 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 shutdown_connections 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31780a36a0 0x7f31780a5b60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3194106460 0x7f31941a20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31941048c0 0x7f319419aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.972 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 --2- 172.21.15.173:0/932255744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3194105ac0 0x7f319419b020 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:53.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 >> 172.21.15.173:0/932255744 conn(0x7f31940ffe60 msgr2=0x7f3194108d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:53.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 shutdown_connections 2024-03-27T08:31:53.973 INFO:teuthology.orchestra.run.smithi173.stderr:2024-03-27T08:31:53.979+0000 7f319a200700 1 -- 172.21.15.173:0/932255744 wait complete. 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:54.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:54.813 DEBUG:teuthology.orchestra.run.smithi164:mds.a> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.a.service 2024-03-27T08:31:54.822 DEBUG:teuthology.orchestra.run.smithi164:mds.d> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.d.service 2024-03-27T08:31:54.868 DEBUG:teuthology.orchestra.run.smithi164:mds.g> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.g.service 2024-03-27T08:31:54.913 DEBUG:teuthology.orchestra.run.smithi164:mds.j> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.j.service 2024-03-27T08:31:54.957 DEBUG:teuthology.orchestra.run.smithi167:mds.b> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.b.service 2024-03-27T08:31:54.965 DEBUG:teuthology.orchestra.run.smithi167:mds.e> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.e.service 2024-03-27T08:31:55.011 DEBUG:teuthology.orchestra.run.smithi167:mds.h> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.h.service 2024-03-27T08:31:55.056 DEBUG:teuthology.orchestra.run.smithi167:mds.k> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.k.service 2024-03-27T08:31:55.101 DEBUG:teuthology.orchestra.run.smithi173:mds.c> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.c.service 2024-03-27T08:31:55.109 DEBUG:teuthology.orchestra.run.smithi173:mds.f> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.f.service 2024-03-27T08:31:55.156 DEBUG:teuthology.orchestra.run.smithi173:mds.i> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.i.service 2024-03-27T08:31:55.201 DEBUG:teuthology.orchestra.run.smithi173:mds.l> sudo journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.l.service 2024-03-27T08:31:55.246 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-03-27T08:31:55.247 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:31:55.387 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:55 smithi173 ceph-mon[35397]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:55.387 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:55 smithi173 ceph-mon[35397]: Saving service mds.all spec with placement smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-03-27T08:31:55.387 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:55 smithi173 ceph-mon[35397]: Deploying daemon mds.l on smithi173 2024-03-27T08:31:55.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 -- 172.21.15.164:0/1231502178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10541019a0 msgr2=0x7f1054101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 --2- 172.21.15.164:0/1231502178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10541019a0 0x7f1054101dc0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1044009ca0 tx=0x7f104402c100 comp rx=0 tx=0).stop 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 -- 172.21.15.164:0/1231502178 shutdown_connections 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 --2- 172.21.15.164:0/1231502178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f1054109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 --2- 172.21.15.164:0/1231502178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1054102b90 0x7f1054103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 --2- 172.21.15.164:0/1231502178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10541019a0 0x7f1054101dc0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 -- 172.21.15.164:0/1231502178 >> 172.21.15.164:0/1231502178 conn(0x7f10540fcf30 msgr2=0x7f10540ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 -- 172.21.15.164:0/1231502178 shutdown_connections 2024-03-27T08:31:55.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.490+0000 7f1059600640 1 -- 172.21.15.164:0/1231502178 wait complete. 2024-03-27T08:31:55.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 Processor -- start 2024-03-27T08:31:55.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 -- start start 2024-03-27T08:31:55.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10541019a0 0x7f1054199df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f10541a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f105410d5f0 con 0x7f1054102b90 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f105410d470 con 0x7f1054103550 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1059600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f105410d770 con 0x7f10541019a0 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1053400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1053400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58500/0 (socket says 172.21.15.164:58500) 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.492+0000 7f1053400640 1 -- 172.21.15.164:0/3082759890 learned_addr learned my addr 172.21.15.164:0/3082759890 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053e00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10541019a0 0x7f1054199df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 -- 172.21.15.164:0/3082759890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10541019a0 msgr2=0x7f1054199df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10541019a0 0x7f1054199df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1058c00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f10541a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 -- 172.21.15.164:0/3082759890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 msgr2=0x7f10541a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f10541a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 -- 172.21.15.164:0/3082759890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10541a1a10 con 0x7f1054102b90 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1058c00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f10541a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1053400640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d950 tx=0x7f103c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c017070 con 0x7f1054102b90 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f103c009c30 con 0x7f1054102b90 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10541a1d00 con 0x7f1054102b90 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.493+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c00f6b0 con 0x7f1054102b90 2024-03-27T08:31:55.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.494+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10541a2240 con 0x7f1054102b90 2024-03-27T08:31:55.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.495+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10541a2470 con 0x7f1054102b90 2024-03-27T08:31:55.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.497+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f103c010a50 con 0x7f1054102b90 2024-03-27T08:31:55.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.499+0000 7f1050c00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 0x7f10380a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.499+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f103c0cf550 con 0x7f1054102b90 2024-03-27T08:31:55.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.499+0000 7f1053e00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 0x7f10380a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.500+0000 7f1053e00640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 0x7f10380a5b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f104402c640 tx=0x7f10440099c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:55.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.504+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f103c009de0 con 0x7f1054102b90 2024-03-27T08:31:55.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:55 smithi167 ceph-mon[34903]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:55.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:55 smithi167 ceph-mon[34903]: Saving service mds.all spec with placement smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-03-27T08:31:55.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:55 smithi167 ceph-mon[34903]: Deploying daemon mds.l on smithi173 2024-03-27T08:31:55.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.705+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f10541a2db0 con 0x7f1054102b90 2024-03-27T08:31:55.699 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.707+0000 7f1050c00640 1 -- 172.21.15.164:0/3082759890 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+18526 (secure 0 0 0) 0x7f103c09c520 con 0x7f1054102b90 2024-03-27T08:31:55.700 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:31:55.700 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":84,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:31:41.940501+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:31:55.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 msgr2=0x7f10380a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 0x7f10380a5b50 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f104402c640 tx=0x7f10440099c0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 msgr2=0x7f105419a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f103c00d950 tx=0x7f103c00de10 comp rx=0 tx=0).stop 2024-03-27T08:31:55.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 shutdown_connections 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10380a3690 0x7f10380a5b50 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1054103550 0x7f10541a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1054102b90 0x7f105419a330 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 --2- 172.21.15.164:0/3082759890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10541019a0 0x7f1054199df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 >> 172.21.15.164:0/3082759890 conn(0x7f10540fcf30 msgr2=0x7f1054073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 shutdown_connections 2024-03-27T08:31:55.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.710+0000 7f1059600640 1 -- 172.21.15.164:0/3082759890 wait complete. 2024-03-27T08:31:55.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:55 smithi164 ceph-mon[31788]: from='client.24373 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:31:55.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:55 smithi164 ceph-mon[31788]: Saving service mds.all spec with placement smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-03-27T08:31:55.719 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:55 smithi164 ceph-mon[31788]: Deploying daemon mds.l on smithi173 2024-03-27T08:31:55.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:31:55.723 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 -- 172.21.15.164:0/3419152181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728105940 msgr2=0x7fe72810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 --2- 172.21.15.164:0/3419152181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728105940 0x7fe72810c1d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe720009ca0 tx=0x7fe72002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 -- 172.21.15.164:0/3419152181 shutdown_connections 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 --2- 172.21.15.164:0/3419152181 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728105940 0x7fe72810c1d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 --2- 172.21.15.164:0/3419152181 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe728104f80 0x7fe728105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 --2- 172.21.15.164:0/3419152181 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728103d90 0x7fe7281041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 -- 172.21.15.164:0/3419152181 >> 172.21.15.164:0/3419152181 conn(0x7fe7280ff300 msgr2=0x7fe728101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 -- 172.21.15.164:0/3419152181 shutdown_connections 2024-03-27T08:31:55.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.949+0000 7fe72d800640 1 -- 172.21.15.164:0/3419152181 wait complete. 2024-03-27T08:31:55.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.950+0000 7fe72d800640 1 Processor -- start 2024-03-27T08:31:55.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.950+0000 7fe72d800640 1 -- start start 2024-03-27T08:31:55.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe728104f80 0x7fe72819a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728105940 0x7fe7281a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810f9f0 con 0x7fe728103d90 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810f870 con 0x7fe728105940 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe72d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe72810fb70 con 0x7fe728104f80 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe726a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe726a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58510/0 (socket says 172.21.15.164:58510) 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe726a00640 1 -- 172.21.15.164:0/52131741 learned_addr learned my addr 172.21.15.164:0/52131741 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe727400640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728105940 0x7fe7281a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.951+0000 7fe726a00640 1 -- 172.21.15.164:0/52131741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe728104f80 msgr2=0x7fe72819a520 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe726a00640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe728104f80 0x7fe72819a520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe726a00640 1 -- 172.21.15.164:0/52131741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728105940 msgr2=0x7fe7281a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe726a00640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728105940 0x7fe7281a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe726a00640 1 -- 172.21.15.164:0/52131741 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7281a1c00 con 0x7fe728103d90 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe726a00640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d770 tx=0x7fe71800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:55.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718017070 con 0x7fe728103d90 2024-03-27T08:31:55.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe718009c30 con 0x7fe728103d90 2024-03-27T08:31:55.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe718003e10 con 0x7fe728103d90 2024-03-27T08:31:55.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7281a1ef0 con 0x7fe728103d90 2024-03-27T08:31:55.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.952+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7281a2350 con 0x7fe728103d90 2024-03-27T08:31:55.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.953+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe72810b050 con 0x7fe728103d90 2024-03-27T08:31:55.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.955+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fe718004020 con 0x7fe728103d90 2024-03-27T08:31:55.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.956+0000 7fe71fe00640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 0x7fe70c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:55.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.957+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fe7180cf700 con 0x7fe728103d90 2024-03-27T08:31:55.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.957+0000 7fe71e000640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 0x7fe70c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:55.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.958+0000 7fe71e000640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 0x7fe70c0a5ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe72819b4f0 tx=0x7fe71000b370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:55.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:55.961+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe71809c6d0 con 0x7fe728103d90 2024-03-27T08:31:56.152 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.160+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe72802d620 con 0x7fe728103d90 2024-03-27T08:31:56.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.161+0000 7fe71fe00640 1 -- 172.21.15.164:0/52131741 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7fe71809bfd0 con 0x7fe728103d90 2024-03-27T08:31:56.153 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.163+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 msgr2=0x7fe70c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.163+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 0x7fe70c0a5ad0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe72819b4f0 tx=0x7fe71000b370 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.163+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 msgr2=0x7fe728199fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.163+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe71800d770 tx=0x7fe71800dc30 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 shutdown_connections 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe70c0a3610 0x7fe70c0a5ad0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe728105940 0x7fe7281a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe728104f80 0x7fe72819a520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 --2- 172.21.15.164:0/52131741 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe728103d90 0x7fe728199fe0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 >> 172.21.15.164:0/52131741 conn(0x7fe7280ff300 msgr2=0x7fe728108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:56.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 shutdown_connections 2024-03-27T08:31:56.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.164+0000 7fe72d800640 1 -- 172.21.15.164:0/52131741 wait complete. 2024-03-27T08:31:56.175 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:31:56.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 -- 172.21.15.164:0/355544407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 msgr2=0x7f6a04105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 --2- 172.21.15.164:0/355544407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a04105400 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009900 tx=0x7f69ec02bc30 comp rx=0 tx=0).stop 2024-03-27T08:31:56.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 -- 172.21.15.164:0/355544407 shutdown_connections 2024-03-27T08:31:56.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 --2- 172.21.15.164:0/355544407 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a04105940 0x7f6a0410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 --2- 172.21.15.164:0/355544407 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a04105400 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 --2- 172.21.15.164:0/355544407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a041041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 -- 172.21.15.164:0/355544407 >> 172.21.15.164:0/355544407 conn(0x7f6a040ff300 msgr2=0x7f6a04101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:56.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 -- 172.21.15.164:0/355544407 shutdown_connections 2024-03-27T08:31:56.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.396+0000 7f6a0a400640 1 -- 172.21.15.164:0/355544407 wait complete. 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.397+0000 7f6a0a400640 1 Processor -- start 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.397+0000 7f6a0a400640 1 -- start start 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.397+0000 7f6a0a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a0419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.397+0000 7f6a0a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.397+0000 7f6a0a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a04105940 0x7f6a041a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:56.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a0a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0410fa00 con 0x7f6a04104f80 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a0a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0410f880 con 0x7f6a04103d90 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a0a400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0410fb80 con 0x7f6a04105940 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58534/0 (socket says 172.21.15.164:58534) 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 -- 172.21.15.164:0/1502879472 learned_addr learned my addr 172.21.15.164:0/1502879472 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a03400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a0419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 -- 172.21.15.164:0/1502879472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a04105940 msgr2=0x7f6a041a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a04105940 0x7f6a041a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 -- 172.21.15.164:0/1502879472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 msgr2=0x7f6a0419a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a0419a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a02a00640 1 -- 172.21.15.164:0/1502879472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a041a1c70 con 0x7f6a04104f80 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.398+0000 7f6a03400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a0419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:31:56.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f6a02a00640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009230 tx=0x7f69ec004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec043020 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f69ec004350 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a041a1f00 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69ec003ca0 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.399+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a041a2410 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.400+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0410b0b0 con 0x7f6a04104f80 2024-03-27T08:31:56.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.402+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f69ec046020 con 0x7f6a04104f80 2024-03-27T08:31:56.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.403+0000 7f69fbe00640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 0x7f69e80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:56.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.404+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f69ec0f16b0 con 0x7f6a04104f80 2024-03-27T08:31:56.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.404+0000 7f6a03400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 0x7f69e80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:56.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.404+0000 7f6a03400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 0x7f69e80a5b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a04104de0 tx=0x7f69f4005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:56.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.407+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f69ec04d070 con 0x7f6a04104f80 2024-03-27T08:31:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:56 smithi164 ceph-mon[31788]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3082759890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:56.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/52131741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:56.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:56 smithi167 ceph-mon[34903]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:56.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3082759890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:56.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/52131741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:56 smithi173 ceph-mon[35397]: pgmap v333: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3082759890' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:31:56.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/52131741' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:31:56.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.648+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a040627f0 con 0x7f6a04104f80 2024-03-27T08:31:56.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.649+0000 7f69fbe00640 1 -- 172.21.15.164:0/1502879472 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+569 (secure 0 0 0) 0x7f69ec0be680 con 0x7f6a04104f80 2024-03-27T08:31:56.641 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:31:56.641 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":1,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-03-27T08:31:56.641 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 1 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 msgr2=0x7f69e80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 0x7f69e80a5b50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a04104de0 tx=0x7f69f4005e70 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 msgr2=0x7f6a0419a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f69ec009230 tx=0x7f69ec004ea0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 shutdown_connections 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f69e80a3690 0x7f69e80a5b50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a04105940 0x7f6a041a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a04104f80 0x7f6a0419a590 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 --2- 172.21.15.164:0/1502879472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a04103d90 0x7f6a0419a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 >> 172.21.15.164:0/1502879472 conn(0x7f6a040ff300 msgr2=0x7f6a04108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 shutdown_connections 2024-03-27T08:31:56.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:56.652+0000 7f6a0a400640 1 -- 172.21.15.164:0/1502879472 wait complete. 2024-03-27T08:31:57.452 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:57 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1502879472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:31:57.729 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 podman[65332]: 2024-03-27 08:31:57.491620295 +0000 UTC m=+0.160663060 container create 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326) 2024-03-27T08:31:57.729 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 podman[65332]: 2024-03-27 08:31:57.736778337 +0000 UTC m=+0.405821145 container init 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:31:57.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:57 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1502879472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:31:57.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:57 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1502879472' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:31:58.075 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 podman[65332]: 2024-03-27 08:31:57.748150273 +0000 UTC m=+0.417193020 container start 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T08:31:58.075 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 ceph-mds[65352]: -- 172.21.15.173:0/2284885545 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f55041fa40 con 0x55f5503f2800 2024-03-27T08:31:58.075 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l[65348]: starting mds.l at 2024-03-27T08:31:58.075 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 bash[65332]: 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 2024-03-27T08:31:58.075 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:31:57 smithi173 systemd[1]: Started Ceph mds.l for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:31:58.657 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:58.657 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.173:6832/3929947876,v1:172.21.15.173:6833/3929947876] up:boot 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: fsmap 1 up:standby 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:58.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:58 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:58.663 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:31:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.173:6832/3929947876,v1:172.21.15.173:6833/3929947876] up:boot 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: fsmap 1 up:standby 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:58 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: pgmap v334: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.173:6832/3929947876,v1:172.21.15.173:6833/3929947876] up:boot 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: fsmap 1 up:standby 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:31:58.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:31:58.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:58 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 -- 172.21.15.164:0/2473396130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0103d70 msgr2=0x7f19f0104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 --2- 172.21.15.164:0/2473396130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0103d70 0x7f19f0104190 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f19e4009900 tx=0x7f19e402bc30 comp rx=0 tx=0).stop 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 -- 172.21.15.164:0/2473396130 shutdown_connections 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 --2- 172.21.15.164:0/2473396130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0105920 0x7f19f010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 --2- 172.21.15.164:0/2473396130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0104f60 0x7f19f01053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:58.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 --2- 172.21.15.164:0/2473396130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0103d70 0x7f19f0104190 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:58.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 -- 172.21.15.164:0/2473396130 >> 172.21.15.164:0/2473396130 conn(0x7f19f00ff300 msgr2=0x7f19f0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:58.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 -- 172.21.15.164:0/2473396130 shutdown_connections 2024-03-27T08:31:58.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.885+0000 7f19f7e00640 1 -- 172.21.15.164:0/2473396130 wait complete. 2024-03-27T08:31:58.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.886+0000 7f19f7e00640 1 Processor -- start 2024-03-27T08:31:58.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.886+0000 7f19f7e00640 1 -- start start 2024-03-27T08:31:58.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.886+0000 7f19f7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0103d70 0x7f19f019a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 0x7f19f01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f7e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010fa80 con 0x7f19f0104f60 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010f900 con 0x7f19f0103d70 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f7e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19f010fc00 con 0x7f19f0105920 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58556/0 (socket says 172.21.15.164:58556) 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 -- 172.21.15.164:0/934930707 learned_addr learned my addr 172.21.15.164:0/934930707 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f5400640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0103d70 0x7f19f019a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:58.881 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f5e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 0x7f19f01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 -- 172.21.15.164:0/934930707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 msgr2=0x7f19f01a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 0x7f19f01a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 -- 172.21.15.164:0/934930707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0103d70 msgr2=0x7f19f019a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0103d70 0x7f19f019a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f4a00640 1 -- 172.21.15.164:0/934930707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f01a1d40 con 0x7f19f0104f60 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.887+0000 7f19f5e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 0x7f19f01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19f4a00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00b4a0 tx=0x7f19dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc014070 con 0x7f19f0104f60 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f19dc010ae0 con 0x7f19f0104f60 2024-03-27T08:31:58.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19dc017c70 con 0x7f19f0104f60 2024-03-27T08:31:58.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19f01a1fd0 con 0x7f19f0104f60 2024-03-27T08:31:58.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.888+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19f01a25c0 con 0x7f19f0104f60 2024-03-27T08:31:58.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.889+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f010b090 con 0x7f19f0104f60 2024-03-27T08:31:58.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.893+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f19dc017070 con 0x7f19f0104f60 2024-03-27T08:31:58.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.895+0000 7f19ee000640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 0x7f19d80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:31:58.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.895+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f19dc0cec30 con 0x7f19f0104f60 2024-03-27T08:31:58.887 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.895+0000 7f19f5400640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 0x7f19d80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:31:58.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.896+0000 7f19f5400640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 0x7f19d80a5b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19e402c170 tx=0x7f19e402c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:31:58.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:58.900+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f19dc09bc00 con 0x7f19f0104f60 2024-03-27T08:31:59.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.139+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f19f0062780 con 0x7f19f0104f60 2024-03-27T08:31:59.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.140+0000 7f19ee000640 1 -- 172.21.15.164:0/934930707 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f19dc09b500 con 0x7f19f0104f60 2024-03-27T08:31:59.132 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:31:59.132 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-27T08:31:59.132 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 2 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.142+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 msgr2=0x7f19d80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.142+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 0x7f19d80a5b50 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f19e402c170 tx=0x7f19e402c820 comp rx=0 tx=0).stop 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.142+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 msgr2=0x7f19f019a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.142+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f19dc00b4a0 tx=0x7f19dc00b960 comp rx=0 tx=0).stop 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 shutdown_connections 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19d80a3690 0x7f19d80a5b50 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19f0105920 0x7f19f01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:59.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19f0104f60 0x7f19f019a660 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:59.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 --2- 172.21.15.164:0/934930707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19f0103d70 0x7f19f019a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:31:59.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 >> 172.21.15.164:0/934930707 conn(0x7f19f00ff300 msgr2=0x7f19f0108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:31:59.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 shutdown_connections 2024-03-27T08:31:59.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:31:59.143+0000 7f19f7e00640 1 -- 172.21.15.164:0/934930707 wait complete. 2024-03-27T08:31:59.433 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:59 smithi167 ceph-mon[34903]: Deploying daemon mds.k on smithi167 2024-03-27T08:31:59.433 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:31:59 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/934930707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:31:59.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:59 smithi164 ceph-mon[31788]: Deploying daemon mds.k on smithi167 2024-03-27T08:31:59.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:31:59 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/934930707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:31:59.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:59 smithi173 ceph-mon[35397]: Deploying daemon mds.k on smithi167 2024-03-27T08:31:59.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:31:59 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/934930707' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:00.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:00 smithi164 ceph-mon[31788]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:00.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:00 smithi167 ceph-mon[34903]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:00.727 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:00 smithi173 ceph-mon[35397]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:01.153 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:01.319 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:00 smithi167 systemd[1]: Starting Ceph mds.k for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 -- 172.21.15.164:0/4083917435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c109180 msgr2=0x7f488c109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 --2- 172.21.15.164:0/4083917435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c109180 0x7f488c109600 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4874009900 tx=0x7f487402bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 -- 172.21.15.164:0/4083917435 shutdown_connections 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 --2- 172.21.15.164:0/4083917435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 --2- 172.21.15.164:0/4083917435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c109180 0x7f488c109600 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 --2- 172.21.15.164:0/4083917435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c107f90 0x7f488c1083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.382+0000 7f488b200640 1 -- 172.21.15.164:0/4083917435 >> 172.21.15.164:0/4083917435 conn(0x7f488c076f20 msgr2=0x7f488c079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.383+0000 7f488b200640 1 -- 172.21.15.164:0/4083917435 shutdown_connections 2024-03-27T08:32:01.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.383+0000 7f488b200640 1 -- 172.21.15.164:0/4083917435 wait complete. 2024-03-27T08:32:01.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.383+0000 7f488b200640 1 Processor -- start 2024-03-27T08:32:01.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 -- start start 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 0x7f488c19e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113d40 con 0x7f488c107f90 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113bc0 con 0x7f488c109b40 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488b200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f488c113ec0 con 0x7f488c109180 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f4889e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f4889e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58564/0 (socket says 172.21.15.164:58564) 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f4889e00640 1 -- 172.21.15.164:0/2007836019 learned_addr learned my addr 172.21.15.164:0/2007836019 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f4883e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 0x7f488c19e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.384+0000 7f488a800640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:01.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 -- 172.21.15.164:0/2007836019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 msgr2=0x7f488c19e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 0x7f488c19e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 -- 172.21.15.164:0/2007836019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 msgr2=0x7f488c1a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 -- 172.21.15.164:0/2007836019 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488c1a6040 con 0x7f488c107f90 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4883e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 0x7f488c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f488a800640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4889e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f487c00b450 tx=0x7f487c00b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c015020 con 0x7f488c107f90 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f487c011d60 con 0x7f488c107f90 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00f340 con 0x7f488c107f90 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488c1a6330 con 0x7f488c107f90 2024-03-27T08:32:01.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.385+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f488c1a6900 con 0x7f488c107f90 2024-03-27T08:32:01.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.386+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f488c10f300 con 0x7f488c107f90 2024-03-27T08:32:01.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.388+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f487c018020 con 0x7f488c107f90 2024-03-27T08:32:01.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.389+0000 7f4882a00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 0x7f48700a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:01.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.390+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f487c0cf480 con 0x7f488c107f90 2024-03-27T08:32:01.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.390+0000 7f4883e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 0x7f48700a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:01.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.390+0000 7f4883e00640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 0x7f48700a5b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48740096c0 tx=0x7f4874005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:01.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.394+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f487c01f020 con 0x7f488c107f90 2024-03-27T08:32:01.607 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 podman[64249]: 2024-03-27 08:32:01.235230691 +0000 UTC m=+0.033642868 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:01.608 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 podman[64249]: 2024-03-27 08:32:01.378616671 +0000 UTC m=+0.177028885 container create dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:32:01.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.619+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f488c02d590 con 0x7f488c107f90 2024-03-27T08:32:01.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.620+0000 7f4882a00640 1 -- 172.21.15.164:0/2007836019 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7f487c00d040 con 0x7f488c107f90 2024-03-27T08:32:01.612 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:01.612 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-27T08:32:01.612 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 2 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.622+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 msgr2=0x7f48700a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.622+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 0x7f48700a5b50 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f48740096c0 tx=0x7f4874005fd0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.622+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 msgr2=0x7f488c19e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.622+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f487c00b450 tx=0x7f487c00b910 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 shutdown_connections 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48700a3690 0x7f48700a5b50 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f488c109b40 0x7f488c1a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f488c109180 0x7f488c19e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 --2- 172.21.15.164:0/2007836019 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f488c107f90 0x7f488c19e470 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:01.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 >> 172.21.15.164:0/2007836019 conn(0x7f488c076f20 msgr2=0x7f488c10c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:01.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 shutdown_connections 2024-03-27T08:32:01.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:01.623+0000 7f488b200640 1 -- 172.21.15.164:0/2007836019 wait complete. 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 podman[64249]: 2024-03-27 08:32:01.615703054 +0000 UTC m=+0.414115341 container init dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 podman[64249]: 2024-03-27 08:32:01.626833916 +0000 UTC m=+0.425246163 container start dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, ceph=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS) 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 ceph-mds[64269]: -- 172.21.15.167:0/2789282477 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555f92c75a40 con 0x555f92c48800 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k[64264]: starting mds.k at 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 bash[64249]: dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 2024-03-27T08:32:01.873 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:32:01 smithi167 systemd[1]: Started Ceph mds.k for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2007836019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:02.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:02.570 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:02 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2007836019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:02.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:02 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2007836019' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:02.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:02 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:03 smithi164 ceph-mon[31788]: Deploying daemon mds.j on smithi164 2024-03-27T08:32:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:03 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6832/2990296948,v1:172.21.15.167:6833/2990296948] up:boot 2024-03-27T08:32:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:03 smithi164 ceph-mon[31788]: fsmap 2 up:standby 2024-03-27T08:32:03.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:03 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T08:32:03.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:03 smithi173 ceph-mon[35397]: Deploying daemon mds.j on smithi164 2024-03-27T08:32:03.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:03 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6832/2990296948,v1:172.21.15.167:6833/2990296948] up:boot 2024-03-27T08:32:03.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:03 smithi173 ceph-mon[35397]: fsmap 2 up:standby 2024-03-27T08:32:03.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:03 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T08:32:03.632 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:03.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:03 smithi167 ceph-mon[34903]: Deploying daemon mds.j on smithi164 2024-03-27T08:32:03.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:03 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6832/2990296948,v1:172.21.15.167:6833/2990296948] up:boot 2024-03-27T08:32:03.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:03 smithi167 ceph-mon[34903]: fsmap 2 up:standby 2024-03-27T08:32:03.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:03 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-03-27T08:32:03.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 -- 172.21.15.164:0/3586844606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 msgr2=0x7f9a3810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:03.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 --2- 172.21.15.164:0/3586844606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a3810c1d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9a30009ca0 tx=0x7f9a3002c100 comp rx=0 tx=0).stop 2024-03-27T08:32:03.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 -- 172.21.15.164:0/3586844606 shutdown_connections 2024-03-27T08:32:03.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 --2- 172.21.15.164:0/3586844606 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a3810c1d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:03.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 --2- 172.21.15.164:0/3586844606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38104f80 0x7f9a38105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:03.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 --2- 172.21.15.164:0/3586844606 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38103d90 0x7f9a381041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:03.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 -- 172.21.15.164:0/3586844606 >> 172.21.15.164:0/3586844606 conn(0x7f9a380ff300 msgr2=0x7f9a38101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:03.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 -- 172.21.15.164:0/3586844606 shutdown_connections 2024-03-27T08:32:03.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.854+0000 7f9a3e400640 1 -- 172.21.15.164:0/3586844606 wait complete. 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.855+0000 7f9a3e400640 1 Processor -- start 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.855+0000 7f9a3e400640 1 -- start start 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 0x7f9a38199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 0x7f9a3819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3810fa00 con 0x7f9a38105940 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3810f880 con 0x7f9a38103d90 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a3e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9a3810fb80 con 0x7f9a38104f80 2024-03-27T08:32:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58582/0 (socket says 172.21.15.164:58582) 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 -- 172.21.15.164:0/2438047716 learned_addr learned my addr 172.21.15.164:0/2438047716 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 0x7f9a38199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a36a00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 0x7f9a3819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 -- 172.21.15.164:0/2438047716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 msgr2=0x7f9a3819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 0x7f9a3819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 -- 172.21.15.164:0/2438047716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 msgr2=0x7f9a38199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 0x7f9a38199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37e00640 1 -- 172.21.15.164:0/2438047716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a381a1bb0 con 0x7f9a38105940 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a36a00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 0x7f9a3819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.856+0000 7f9a37400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 0x7f9a38199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a37e00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005e30 tx=0x7f9a30034cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a30039050 con 0x7f9a38105940 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9a3003a040 con 0x7f9a38105940 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a381a1e40 con 0x7f9a38105940 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a300046e0 con 0x7f9a38105940 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.857+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a381a2300 con 0x7f9a38105940 2024-03-27T08:32:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.858+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3810b0b0 con 0x7f9a38105940 2024-03-27T08:32:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.860+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f9a30003970 con 0x7f9a38105940 2024-03-27T08:32:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.861+0000 7f9a2fe00640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 0x7f9a1c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.862+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f9a300f21c0 con 0x7f9a38105940 2024-03-27T08:32:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.862+0000 7f9a37400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 0x7f9a1c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:03.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.862+0000 7f9a37400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 0x7f9a1c0a5b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a38104de0 tx=0x7f9a28005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:03.858 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:03.866+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9a300bf190 con 0x7f9a38105940 2024-03-27T08:32:04.100 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.109+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a380627f0 con 0x7f9a38105940 2024-03-27T08:32:04.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.109+0000 7f9a2fe00640 1 -- 172.21.15.164:0/2438047716 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2224 (secure 0 0 0) 0x7f9a300bea90 con 0x7f9a38105940 2024-03-27T08:32:04.101 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:04.101 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T08:32:04.102 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 3 2024-03-27T08:32:04.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 msgr2=0x7f9a1c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 0x7f9a1c0a5b50 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f9a38104de0 tx=0x7f9a28005e70 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 msgr2=0x7f9a381a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9a30005e30 tx=0x7f9a30034cf0 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 shutdown_connections 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9a1c0a3690 0x7f9a1c0a5b50 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9a38105940 0x7f9a381a1540 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9a38104f80 0x7f9a3819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 --2- 172.21.15.164:0/2438047716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a38103d90 0x7f9a38199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.112+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 >> 172.21.15.164:0/2438047716 conn(0x7f9a380ff300 msgr2=0x7f9a38108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.113+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 shutdown_connections 2024-03-27T08:32:04.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:04.113+0000 7f9a3e400640 1 -- 172.21.15.164:0/2438047716 wait complete. 2024-03-27T08:32:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:04 smithi164 ceph-mon[31788]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:04.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2438047716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:04 smithi167 ceph-mon[34903]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2438047716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:04 smithi173 ceph-mon[35397]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2438047716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:05.254 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:04 smithi164 systemd[1]: Starting Ceph mds.j for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:05.514 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 podman[73233]: 2024-03-27 08:32:05.17414283 +0000 UTC m=+0.031954922 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:05.514 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 podman[73233]: 2024-03-27 08:32:05.349152091 +0000 UTC m=+0.206964213 container create 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-03-27T08:32:06.004 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 podman[73233]: 2024-03-27 08:32:05.611229302 +0000 UTC m=+0.469041431 container init 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0) 2024-03-27T08:32:06.005 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 podman[73233]: 2024-03-27 08:32:05.621636415 +0000 UTC m=+0.479448515 container start 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:32:06.005 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 ceph-mds[73252]: -- 172.21.15.164:0/3588451641 <== mon.0 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e8fa37a40 con 0x557e8fa0b000 2024-03-27T08:32:06.005 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j[73248]: starting mds.j at 2024-03-27T08:32:06.005 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 bash[73233]: 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 2024-03-27T08:32:06.005 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:32:05 smithi164 systemd[1]: Started Ceph mds.j for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:06.127 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:06.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 -- 172.21.15.164:0/405374971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590105920 msgr2=0x7f159010c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:06.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 --2- 172.21.15.164:0/405374971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590105920 0x7f159010c1b0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1588009ca0 tx=0x7f158802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 -- 172.21.15.164:0/405374971 shutdown_connections 2024-03-27T08:32:06.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 --2- 172.21.15.164:0/405374971 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590105920 0x7f159010c1b0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 --2- 172.21.15.164:0/405374971 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 0x7f15901053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 --2- 172.21.15.164:0/405374971 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590103d70 0x7f1590104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 -- 172.21.15.164:0/405374971 >> 172.21.15.164:0/405374971 conn(0x7f15900ff300 msgr2=0x7f1590101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:06.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 -- 172.21.15.164:0/405374971 shutdown_connections 2024-03-27T08:32:06.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.351+0000 7f1598000640 1 -- 172.21.15.164:0/405374971 wait complete. 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.352+0000 7f1598000640 1 Processor -- start 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.352+0000 7f1598000640 1 -- start start 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.352+0000 7f1598000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1598000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 0x7f159019a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1598000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 0x7f15901a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1598000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f9d0 con 0x7f1590103d70 2024-03-27T08:32:06.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1598000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f850 con 0x7f1590104f60 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1598000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f159010fb50 con 0x7f1590105920 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45532/0 (socket says 172.21.15.164:45532) 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 -- 172.21.15.164:0/4281615841 learned_addr learned my addr 172.21.15.164:0/4281615841 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1594c00640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 0x7f159019a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1596000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 0x7f15901a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 -- 172.21.15.164:0/4281615841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 msgr2=0x7f15901a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 0x7f15901a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 -- 172.21.15.164:0/4281615841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 msgr2=0x7f159019a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 0x7f159019a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1595600640 1 -- 172.21.15.164:0/4281615841 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15901a1c30 con 0x7f1590103d70 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.353+0000 7f1596000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 0x7f15901a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:06.347 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f1595600640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158400d950 tx=0x7f158400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1584017070 con 0x7f1590103d70 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1584009c30 con 0x7f1590103d70 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15901a1f20 con 0x7f1590103d70 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158400f620 con 0x7f1590103d70 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.354+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a2380 con 0x7f1590103d70 2024-03-27T08:32:06.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.356+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159010b110 con 0x7f1590103d70 2024-03-27T08:32:06.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.357+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f158401a070 con 0x7f1590103d70 2024-03-27T08:32:06.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.359+0000 7f158e000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 0x7f15780a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:06.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.359+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f15840cf3b0 con 0x7f1590103d70 2024-03-27T08:32:06.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.359+0000 7f1594c00640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 0x7f15780a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:06.351 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.360+0000 7f1594c00640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 0x7f15780a5b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f157c005fd0 tx=0x7f157c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:06.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.363+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1584009de0 con 0x7f1590103d70 2024-03-27T08:32:06.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:06.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:06.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:06.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:06 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:06.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.613+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f159002d370 con 0x7f1590103d70 2024-03-27T08:32:06.605 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.613+0000 7f158e000640 1 -- 172.21.15.164:0/4281615841 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f158409c380 con 0x7f1590103d70 2024-03-27T08:32:06.605 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:06.606 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T08:32:06.606 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 4 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 msgr2=0x7f15780a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 0x7f15780a5b50 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f157c005fd0 tx=0x7f157c005850 comp rx=0 tx=0).stop 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 msgr2=0x7f159019a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f158400d950 tx=0x7f158400de10 comp rx=0 tx=0).stop 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 shutdown_connections 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f15780a3690 0x7f15780a5b50 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1590105920 0x7f15901a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.608 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1590104f60 0x7f159019a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 --2- 172.21.15.164:0/4281615841 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1590103d70 0x7f159019a010 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:06.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 >> 172.21.15.164:0/4281615841 conn(0x7f15900ff300 msgr2=0x7f15901082e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:06.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 shutdown_connections 2024-03-27T08:32:06.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:06.616+0000 7f1598000640 1 -- 172.21.15.164:0/4281615841 wait complete. 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:06.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:06 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:06.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:06.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:06.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:06 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:07.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:07 smithi164 ceph-mon[31788]: Deploying daemon mds.d on smithi164 2024-03-27T08:32:07.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:07 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.164:6834/96681599,v1:172.21.15.164:6835/96681599] up:boot 2024-03-27T08:32:07.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:07 smithi164 ceph-mon[31788]: fsmap 3 up:standby 2024-03-27T08:32:07.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:07 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T08:32:07.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:07 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4281615841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:07.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:07 smithi167 ceph-mon[34903]: Deploying daemon mds.d on smithi164 2024-03-27T08:32:07.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:07 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.164:6834/96681599,v1:172.21.15.164:6835/96681599] up:boot 2024-03-27T08:32:07.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:07 smithi167 ceph-mon[34903]: fsmap 3 up:standby 2024-03-27T08:32:07.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:07 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T08:32:07.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:07 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4281615841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:07.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:07 smithi173 ceph-mon[35397]: Deploying daemon mds.d on smithi164 2024-03-27T08:32:07.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:07 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.164:6834/96681599,v1:172.21.15.164:6835/96681599] up:boot 2024-03-27T08:32:07.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:07 smithi173 ceph-mon[35397]: fsmap 3 up:standby 2024-03-27T08:32:07.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:07 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-03-27T08:32:07.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:07 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4281615841' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:08.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:08.694 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:08 smithi164 ceph-mon[31788]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:08.720 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:08 smithi167 ceph-mon[34903]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:08 smithi173 ceph-mon[35397]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 -- 172.21.15.164:0/1550188725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 msgr2=0x7f46c8109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 --2- 172.21.15.164:0/1550188725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c8109fa0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f46c0009ca0 tx=0x7f46c002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 -- 172.21.15.164:0/1550188725 shutdown_connections 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 --2- 172.21.15.164:0/1550188725 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c8109fa0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 --2- 172.21.15.164:0/1550188725 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 0x7f46c81031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 --2- 172.21.15.164:0/1550188725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 0x7f46c8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 -- 172.21.15.164:0/1550188725 >> 172.21.15.164:0/1550188725 conn(0x7f46c80fd0f0 msgr2=0x7f46c80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:08.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 -- 172.21.15.164:0/1550188725 shutdown_connections 2024-03-27T08:32:08.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.960+0000 7f46cde00640 1 -- 172.21.15.164:0/1550188725 wait complete. 2024-03-27T08:32:08.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 Processor -- start 2024-03-27T08:32:08.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 -- start start 2024-03-27T08:32:08.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 0x7f46c8199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:08.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 0x7f46c819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f46c810d7c0 con 0x7f46c8103710 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f46c810d640 con 0x7f46c8101b60 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.961+0000 7f46cde00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f46c810d940 con 0x7f46c8102d50 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.962+0000 7f46c7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.962+0000 7f46c7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45548/0 (socket says 172.21.15.164:45548) 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.962+0000 7f46c7400640 1 -- 172.21.15.164:0/1465986006 learned_addr learned my addr 172.21.15.164:0/1465986006 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.962+0000 7f46c6a00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 0x7f46c8199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.962+0000 7f46c6000640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 0x7f46c819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 -- 172.21.15.164:0/1465986006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 msgr2=0x7f46c819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 0x7f46c819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 -- 172.21.15.164:0/1465986006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 msgr2=0x7f46c8199f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 0x7f46c8199f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:08.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 -- 172.21.15.164:0/1465986006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c81a1bb0 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46c7400640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46c002c630 tx=0x7f46c0032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0039050 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f46c003a040 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46c81a1e40 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46c0040450 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.963+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46c81a2300 con 0x7f46c8103710 2024-03-27T08:32:08.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.965+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46c81a25f0 con 0x7f46c8103710 2024-03-27T08:32:08.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.967+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f46c0003c70 con 0x7f46c8103710 2024-03-27T08:32:08.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.968+0000 7f46cca00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 0x7f46ac0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:08.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.968+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f46c00f3310 con 0x7f46c8103710 2024-03-27T08:32:08.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.969+0000 7f46c6a00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 0x7f46ac0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:08.961 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.969+0000 7f46c6a00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 0x7f46ac0a5bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46c8102bb0 tx=0x7f46b8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:08.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:08.971+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f46c00c0400 con 0x7f46c8103710 2024-03-27T08:32:09.004 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:08 smithi164 systemd[1]: Starting Ceph mds.d for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:09.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.225+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46c81a2980 con 0x7f46c8103710 2024-03-27T08:32:09.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.226+0000 7f46cca00640 1 -- 172.21.15.164:0/1465986006 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3046 (secure 0 0 0) 0x7f46c00bfd00 con 0x7f46c8103710 2024-03-27T08:32:09.218 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:09.218 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":4,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T08:32:09.219 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 4 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.228+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 msgr2=0x7f46ac0a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.228+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 0x7f46ac0a5bd0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f46c8102bb0 tx=0x7f46b8005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 msgr2=0x7f46c81a1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f46c002c630 tx=0x7f46c0032980 comp rx=0 tx=0).stop 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 shutdown_connections 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f46ac0a3710 0x7f46ac0a5bd0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f46c8103710 0x7f46c81a1540 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f46c8102d50 0x7f46c819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:09.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 --2- 172.21.15.164:0/1465986006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f46c8101b60 0x7f46c8199f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 >> 172.21.15.164:0/1465986006 conn(0x7f46c80fd0f0 msgr2=0x7f46c8073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 shutdown_connections 2024-03-27T08:32:09.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:09.229+0000 7f46cde00640 1 -- 172.21.15.164:0/1465986006 wait complete. 2024-03-27T08:32:09.498 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:09 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1465986006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:09.498 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 podman[73618]: 2024-03-27 08:32:09.116830266 +0000 UTC m=+0.034353553 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:09.499 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 podman[73618]: 2024-03-27 08:32:09.235721933 +0000 UTC m=+0.153245211 container create fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-27T08:32:09.499 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 podman[73618]: 2024-03-27 08:32:09.506480241 +0000 UTC m=+0.424003574 container init fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True) 2024-03-27T08:32:09.754 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 podman[73618]: 2024-03-27 08:32:09.516764446 +0000 UTC m=+0.434287766 container start fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:32:09.755 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 ceph-mds[73639]: -- 172.21.15.164:0/2066648107 <== mon.0 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5557146bba40 con 0x55571468f000 2024-03-27T08:32:09.755 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d[73635]: starting mds.d at 2024-03-27T08:32:09.755 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 bash[73618]: fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f 2024-03-27T08:32:09.755 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:32:09 smithi164 systemd[1]: Started Ceph mds.d for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:09.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:09 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1465986006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:09.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:09 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1465986006' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:10.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:10.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:10 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:10.772 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:10.772 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.773 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.773 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.773 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:10.773 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:10.773 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:10 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:10.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:10 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:11.242 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:11.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 -- 172.21.15.164:0/268143247 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109d20 msgr2=0x7f674c1105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:11.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 --2- 172.21.15.164:0/268143247 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109d20 0x7f674c1105b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f6744009900 tx=0x7f674402bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:11.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 -- 172.21.15.164:0/268143247 shutdown_connections 2024-03-27T08:32:11.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 --2- 172.21.15.164:0/268143247 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109d20 0x7f674c1105b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 --2- 172.21.15.164:0/268143247 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109360 0x7f674c1097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 --2- 172.21.15.164:0/268143247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 0x7f674c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 -- 172.21.15.164:0/268143247 >> 172.21.15.164:0/268143247 conn(0x7f674c077130 msgr2=0x7f674c079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:11.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 -- 172.21.15.164:0/268143247 shutdown_connections 2024-03-27T08:32:11.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.482+0000 7f6750e00640 1 -- 172.21.15.164:0/268143247 wait complete. 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 Processor -- start 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 -- start start 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 0x7f674c19e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109d20 0x7f674c1a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:11.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f674c113e20 con 0x7f674c109360 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f674c113ca0 con 0x7f674c108170 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6750e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f674c113fa0 con 0x7f674c109d20 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.483+0000 7f6741400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45590/0 (socket says 172.21.15.164:45590) 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 -- 172.21.15.164:0/1596459697 learned_addr learned my addr 172.21.15.164:0/1596459697 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6749e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 0x7f674c19e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f674a800640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109d20 0x7f674c1a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 -- 172.21.15.164:0/1596459697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109d20 msgr2=0x7f674c1a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109d20 0x7f674c1a59e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 -- 172.21.15.164:0/1596459697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 msgr2=0x7f674c19e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 0x7f674c19e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 -- 172.21.15.164:0/1596459697 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f674c1a6050 con 0x7f674c109360 2024-03-27T08:32:11.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6741400640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f673400cce0 tx=0x7f673400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6734004b20 con 0x7f674c109360 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6734004cc0 con 0x7f674c109360 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f673400f810 con 0x7f674c109360 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.484+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f674c1a6340 con 0x7f674c109360 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.485+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f674c1a6840 con 0x7f674c109360 2024-03-27T08:32:11.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.486+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f674c10f430 con 0x7f674c109360 2024-03-27T08:32:11.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.489+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f673400f9b0 con 0x7f674c109360 2024-03-27T08:32:11.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.491+0000 7f6743400640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 0x7f67300a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:11.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.491+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f67340cfed0 con 0x7f674c109360 2024-03-27T08:32:11.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.491+0000 7f6749e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 0x7f67300a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:11.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.492+0000 7f6749e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 0x7f67300a5ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f673c005db0 tx=0x7f673c005d40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:11.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.494+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6734014030 con 0x7f674c109360 2024-03-27T08:32:11.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.739+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f674c02d5e0 con 0x7f674c109360 2024-03-27T08:32:11.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.740+0000 7f6743400640 1 -- 172.21.15.164:0/1596459697 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f673409cea0 con 0x7f674c109360 2024-03-27T08:32:11.733 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:11.733 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T08:32:11.733 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 5 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 msgr2=0x7f67300a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 0x7f67300a5ad0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f673c005db0 tx=0x7f673c005d40 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 msgr2=0x7f674c19e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f673400cce0 tx=0x7f673400a620 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 shutdown_connections 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67300a3610 0x7f67300a5ad0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f674c109d20 0x7f674c1a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f674c109360 0x7f674c19e970 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 --2- 172.21.15.164:0/1596459697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f674c108170 0x7f674c19e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.743+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 >> 172.21.15.164:0/1596459697 conn(0x7f674c077130 msgr2=0x7f674c10c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.744+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 shutdown_connections 2024-03-27T08:32:11.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:11.744+0000 7f6750e00640 1 -- 172.21.15.164:0/1596459697 wait complete. 2024-03-27T08:32:11.752 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:11 smithi164 ceph-mon[31788]: Deploying daemon mds.e on smithi167 2024-03-27T08:32:11.752 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:11 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.164:6836/3048161214,v1:172.21.15.164:6837/3048161214] up:boot 2024-03-27T08:32:11.752 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:11 smithi164 ceph-mon[31788]: fsmap 4 up:standby 2024-03-27T08:32:11.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:11 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T08:32:11.802 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:11 smithi167 ceph-mon[34903]: Deploying daemon mds.e on smithi167 2024-03-27T08:32:11.802 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:11 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.164:6836/3048161214,v1:172.21.15.164:6837/3048161214] up:boot 2024-03-27T08:32:11.802 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:11 smithi167 ceph-mon[34903]: fsmap 4 up:standby 2024-03-27T08:32:11.802 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:11 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T08:32:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:11 smithi173 ceph-mon[35397]: Deploying daemon mds.e on smithi167 2024-03-27T08:32:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:11 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.164:6836/3048161214,v1:172.21.15.164:6837/3048161214] up:boot 2024-03-27T08:32:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:11 smithi173 ceph-mon[35397]: fsmap 4 up:standby 2024-03-27T08:32:11.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:11 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-03-27T08:32:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:12 smithi164 ceph-mon[31788]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:12 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1596459697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:12.772 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:12 smithi173 ceph-mon[35397]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:12.772 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:12 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1596459697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:12.794 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:12 smithi167 ceph-mon[34903]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:12.794 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:12 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1596459697' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:13.068 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:12 smithi167 systemd[1]: Starting Ceph mds.e for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:13.412 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 podman[64563]: 2024-03-27 08:32:13.058008763 +0000 UTC m=+0.032110194 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:13.412 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 podman[64563]: 2024-03-27 08:32:13.173893607 +0000 UTC m=+0.147995075 container create d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:32:13.412 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 podman[64563]: 2024-03-27 08:32:13.419479023 +0000 UTC m=+0.393580498 container init d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:32:13.759 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:13.819 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 podman[64563]: 2024-03-27 08:32:13.42915409 +0000 UTC m=+0.403255565 container start d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-03-27T08:32:13.819 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 ceph-mds[64582]: -- 172.21.15.167:0/3667239597 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5566d3999a40 con 0x5566d396d000 2024-03-27T08:32:13.819 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e[64578]: starting mds.e at 2024-03-27T08:32:13.819 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 bash[64563]: d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 2024-03-27T08:32:13.819 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:32:13 smithi167 systemd[1]: Started Ceph mds.e for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 -- 172.21.15.164:0/3316363049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8109360 msgr2=0x7f4ca81097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 --2- 172.21.15.164:0/3316363049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8109360 0x7f4ca81097e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4c94009900 tx=0x7f4c9402bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 -- 172.21.15.164:0/3316363049 shutdown_connections 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 --2- 172.21.15.164:0/3316363049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109d20 0x7f4ca81105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 --2- 172.21.15.164:0/3316363049 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8109360 0x7f4ca81097e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 --2- 172.21.15.164:0/3316363049 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca8108170 0x7f4ca8108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.987+0000 7f4caea00640 1 -- 172.21.15.164:0/3316363049 >> 172.21.15.164:0/3316363049 conn(0x7f4ca8077130 msgr2=0x7f4ca8079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.988+0000 7f4caea00640 1 -- 172.21.15.164:0/3316363049 shutdown_connections 2024-03-27T08:32:13.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.988+0000 7f4caea00640 1 -- 172.21.15.164:0/3316363049 wait complete. 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 Processor -- start 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 -- start start 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109360 0x7f4ca819ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca8109d20 0x7f4ca81a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113dd0 con 0x7f4ca8108170 2024-03-27T08:32:13.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113c50 con 0x7f4ca8109360 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4caea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ca8113f50 con 0x7f4ca8109d20 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4ca7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45614/0 (socket says 172.21.15.164:45614) 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.989+0000 7f4ca7e00640 1 -- 172.21.15.164:0/2336642384 learned_addr learned my addr 172.21.15.164:0/2336642384 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7400640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109360 0x7f4ca819ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 -- 172.21.15.164:0/2336642384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca8109d20 msgr2=0x7f4ca81a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca8109d20 0x7f4ca81a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 -- 172.21.15.164:0/2336642384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109360 msgr2=0x7f4ca819ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109360 0x7f4ca819ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 -- 172.21.15.164:0/2336642384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ca81a6120 con 0x7f4ca8108170 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca7e00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800d950 tx=0x7f4c9800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c98017070 con 0x7f4ca8108170 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c98009c30 con 0x7f4ca8108170 2024-03-27T08:32:13.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ca81a6410 con 0x7f4ca8108170 2024-03-27T08:32:13.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.990+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c9800f620 con 0x7f4ca8108170 2024-03-27T08:32:13.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.991+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ca81a6960 con 0x7f4ca8108170 2024-03-27T08:32:13.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.992+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ca810f430 con 0x7f4ca8108170 2024-03-27T08:32:13.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.994+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f4c9801a070 con 0x7f4ca8108170 2024-03-27T08:32:13.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.995+0000 7f4ca4c00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 0x7f4c8c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:13.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.995+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f4c980cf3a0 con 0x7f4ca8108170 2024-03-27T08:32:13.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.995+0000 7f4ca7400640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 0x7f4c8c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:13.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.996+0000 7f4ca7400640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 0x7f4c8c0a5b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4ca819fa10 tx=0x7f4c94000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:13.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:13.998+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4c98009de0 con 0x7f4ca8108170 2024-03-27T08:32:14.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.239+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ca802d370 con 0x7f4ca8108170 2024-03-27T08:32:14.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.240+0000 7f4ca4c00640 1 -- 172.21.15.164:0/2336642384 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3874 (secure 0 0 0) 0x7f4c9809c3f0 con 0x7f4ca8108170 2024-03-27T08:32:14.233 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:14.233 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-03-27T08:32:14.233 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 5 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 msgr2=0x7f4c8c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 0x7f4c8c0a5b50 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f4ca819fa10 tx=0x7f4c94000bc0 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 msgr2=0x7f4ca819e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f4c9800d950 tx=0x7f4c9800de10 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 shutdown_connections 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c8c0a3690 0x7f4c8c0a5b50 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ca8109d20 0x7f4ca81a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ca8109360 0x7f4ca819ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 --2- 172.21.15.164:0/2336642384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ca8108170 0x7f4ca819e500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:14.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 >> 172.21.15.164:0/2336642384 conn(0x7f4ca8077130 msgr2=0x7f4ca810c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:14.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 shutdown_connections 2024-03-27T08:32:14.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:14.243+0000 7f4caea00640 1 -- 172.21.15.164:0/2336642384 wait complete. 2024-03-27T08:32:14.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:14.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:14 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2336642384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:14.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:14 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2336642384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:14.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:14 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2336642384' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:15.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:15 smithi164 ceph-mon[31788]: Deploying daemon mds.f on smithi173 2024-03-27T08:32:15.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:15 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:boot 2024-03-27T08:32:15.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:15 smithi164 ceph-mon[31788]: fsmap 5 up:standby 2024-03-27T08:32:15.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:15 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T08:32:15.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:15 smithi167 ceph-mon[34903]: Deploying daemon mds.f on smithi173 2024-03-27T08:32:15.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:15 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:boot 2024-03-27T08:32:15.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:15 smithi167 ceph-mon[34903]: fsmap 5 up:standby 2024-03-27T08:32:15.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:15 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T08:32:15.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:15 smithi173 ceph-mon[35397]: Deploying daemon mds.f on smithi173 2024-03-27T08:32:15.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:15 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:boot 2024-03-27T08:32:15.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:15 smithi173 ceph-mon[35397]: fsmap 5 up:standby 2024-03-27T08:32:15.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:15 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-03-27T08:32:16.257 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 -- 172.21.15.164:0/376669560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 msgr2=0x7faec41041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 --2- 172.21.15.164:0/376669560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec41041b0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7faeb8009900 tx=0x7faeb802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 -- 172.21.15.164:0/376669560 shutdown_connections 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 --2- 172.21.15.164:0/376669560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec4105940 0x7faec410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 --2- 172.21.15.164:0/376669560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4104f80 0x7faec4105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 --2- 172.21.15.164:0/376669560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec41041b0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.483+0000 7faecc200640 1 -- 172.21.15.164:0/376669560 >> 172.21.15.164:0/376669560 conn(0x7faec40ff300 msgr2=0x7faec4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:16.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.484+0000 7faecc200640 1 -- 172.21.15.164:0/376669560 shutdown_connections 2024-03-27T08:32:16.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.484+0000 7faecc200640 1 -- 172.21.15.164:0/376669560 wait complete. 2024-03-27T08:32:16.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 Processor -- start 2024-03-27T08:32:16.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 -- start start 2024-03-27T08:32:16.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:16.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec4104f80 0x7faec419a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:16.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 0x7faec41a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7faec410faa0 con 0x7faec4103d90 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7faec410f920 con 0x7faec4105940 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faecc200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7faec410fc20 con 0x7faec4104f80 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.485+0000 7faec9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45184/0 (socket says 172.21.15.164:45184) 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 -- 172.21.15.164:0/906221382 learned_addr learned my addr 172.21.15.164:0/906221382 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faeca200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 0x7faec41a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 -- 172.21.15.164:0/906221382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec4104f80 msgr2=0x7faec419a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec4104f80 0x7faec419a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 -- 172.21.15.164:0/906221382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 msgr2=0x7faec41a1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 0x7faec41a1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 -- 172.21.15.164:0/906221382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faec41a1c70 con 0x7faec4103d90 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faeca200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 0x7faec41a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:16.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.486+0000 7faec9800640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faeb802c170 tx=0x7faeb8004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.487+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8043020 con 0x7faec4103d90 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.487+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faeb8004410 con 0x7faec4103d90 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.487+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faec41a1f00 con 0x7faec4103d90 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.487+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faeb8003df0 con 0x7faec4103d90 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.487+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faec41a2440 con 0x7faec4103d90 2024-03-27T08:32:16.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.488+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faec410b0b0 con 0x7faec4103d90 2024-03-27T08:32:16.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.490+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7faeb8046020 con 0x7faec4103d90 2024-03-27T08:32:16.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.491+0000 7faec2000640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 0x7faeac0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:16.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.491+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7faeb80f2110 con 0x7faec4103d90 2024-03-27T08:32:16.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.492+0000 7faec8e00640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 0x7faeac0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:16.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.492+0000 7faec8e00640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 0x7faeac0a5ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faec419b560 tx=0x7faeb0005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:16.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.496+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7faeb804d020 con 0x7faec4103d90 2024-03-27T08:32:16.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.740+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faec402d370 con 0x7faec4103d90 2024-03-27T08:32:16.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.741+0000 7faec2000640 1 -- 172.21.15.164:0/906221382 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4702 (secure 0 0 0) 0x7faeb80bf180 con 0x7faec4103d90 2024-03-27T08:32:16.734 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:16.734 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-27T08:32:16.734 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 6 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 msgr2=0x7faeac0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 0x7faeac0a5ad0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faec419b560 tx=0x7faeb0005c70 comp rx=0 tx=0).stop 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 msgr2=0x7faec419a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7faeb802c170 tx=0x7faeb8004f10 comp rx=0 tx=0).stop 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 shutdown_connections 2024-03-27T08:32:16.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faeac0a3610 0x7faeac0a5ad0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7faec4105940 0x7faec41a1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7faec4104f80 0x7faec419a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 --2- 172.21.15.164:0/906221382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7faec4103d90 0x7faec419a050 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 >> 172.21.15.164:0/906221382 conn(0x7faec40ff300 msgr2=0x7faec4108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 shutdown_connections 2024-03-27T08:32:16.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:16.744+0000 7faecc200640 1 -- 172.21.15.164:0/906221382 wait complete. 2024-03-27T08:32:16.744 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:16 smithi173 ceph-mon[35397]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:16.751 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:16 smithi164 ceph-mon[31788]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:16 smithi167 ceph-mon[34903]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:17.075 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:16 smithi173 systemd[1]: Starting Ceph mds.f for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:17.356 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 podman[65645]: 2024-03-27 08:32:17.003362173 +0000 UTC m=+0.035014362 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:17.356 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 podman[65645]: 2024-03-27 08:32:17.127852997 +0000 UTC m=+0.159505193 container create 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-03-27T08:32:17.645 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:17 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/906221382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 podman[65645]: 2024-03-27 08:32:17.364216699 +0000 UTC m=+0.395868876 container init 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326) 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 podman[65645]: 2024-03-27 08:32:17.374041937 +0000 UTC m=+0.405694110 container start 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 ceph-mds[65665]: -- 172.21.15.173:0/1614874875 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a1a74d9a40 con 0x55a1a74ad000 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f[65660]: starting mds.f at 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 bash[65645]: 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc 2024-03-27T08:32:17.646 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:32:17 smithi173 systemd[1]: Started Ceph mds.f for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:17.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:17 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/906221382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:17.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:17 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/906221382' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:18.754 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:18.795 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.173:6834/4213841901,v1:172.21.15.173:6835/4213841901] up:boot 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: fsmap 6 up:standby 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:18.796 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.173:6834/4213841901,v1:172.21.15.173:6835/4213841901] up:boot 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: fsmap 6 up:standby 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.173:6834/4213841901,v1:172.21.15.173:6835/4213841901] up:boot 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: fsmap 6 up:standby 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:18.840 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:18.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 -- 172.21.15.164:0/4116155333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 msgr2=0x7fa790104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 --2- 172.21.15.164:0/4116155333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa790104190 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fa784009900 tx=0x7fa78402bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 -- 172.21.15.164:0/4116155333 shutdown_connections 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 --2- 172.21.15.164:0/4116155333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 0x7fa79010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 --2- 172.21.15.164:0/4116155333 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa7901053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 --2- 172.21.15.164:0/4116155333 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa790104190 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 -- 172.21.15.164:0/4116155333 >> 172.21.15.164:0/4116155333 conn(0x7fa7900ff300 msgr2=0x7fa790101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 -- 172.21.15.164:0/4116155333 shutdown_connections 2024-03-27T08:32:18.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.985+0000 7fa797e00640 1 -- 172.21.15.164:0/4116155333 wait complete. 2024-03-27T08:32:18.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.986+0000 7fa797e00640 1 Processor -- start 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 -- start start 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa79019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 0x7fa7901a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa79010fa20 con 0x7fa790103d70 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa79010f8a0 con 0x7fa790105920 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa797e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa79010fba0 con 0x7fa790104f60 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa795400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa795400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45210/0 (socket says 172.21.15.164:45210) 2024-03-27T08:32:18.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa795400640 1 -- 172.21.15.164:0/3567695870 learned_addr learned my addr 172.21.15.164:0/3567695870 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.987+0000 7fa794a00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa79019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 0x7fa7901a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 -- 172.21.15.164:0/3567695870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 msgr2=0x7fa79019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa79019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 -- 172.21.15.164:0/3567695870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 msgr2=0x7fa7901a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 0x7fa7901a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 -- 172.21.15.164:0/3567695870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7901a1cb0 con 0x7fa790103d70 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa794a00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa79019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa795400640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa784000c00 tx=0x7fa784005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784043020 con 0x7fa790103d70 2024-03-27T08:32:18.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa784005470 con 0x7fa790103d70 2024-03-27T08:32:18.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7901a1f40 con 0x7fa790103d70 2024-03-27T08:32:18.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.988+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa784003c90 con 0x7fa790103d70 2024-03-27T08:32:18.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.989+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7901a23a0 con 0x7fa790103d70 2024-03-27T08:32:18.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.990+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79010b090 con 0x7fa790103d70 2024-03-27T08:32:18.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.992+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fa784046020 con 0x7fa790103d70 2024-03-27T08:32:18.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.993+0000 7fa78e000640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 0x7fa7780a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:18.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.993+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fa7840f1f40 con 0x7fa790103d70 2024-03-27T08:32:18.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.993+0000 7fa794a00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 0x7fa7780a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:18.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.994+0000 7fa794a00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 0x7fa7780a5ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa79019b5a0 tx=0x7fa780005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:18.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:18.996+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa78404d020 con 0x7fa790103d70 2024-03-27T08:32:19.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.239+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa79002d5c0 con 0x7fa790103d70 2024-03-27T08:32:19.231 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.240+0000 7fa78e000640 1 -- 172.21.15.164:0/3567695870 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7fa78403e450 con 0x7fa790103d70 2024-03-27T08:32:19.232 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:19.232 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-27T08:32:19.232 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2024-03-27T08:32:19.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 msgr2=0x7fa7780a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:19.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 0x7fa7780a5ad0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fa79019b5a0 tx=0x7fa780005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:19.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 msgr2=0x7fa79019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa784000c00 tx=0x7fa784005e40 comp rx=0 tx=0).stop 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 shutdown_connections 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7780a3610 0x7fa7780a5ad0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa790105920 0x7fa7901a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa790104f60 0x7fa79019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 --2- 172.21.15.164:0/3567695870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa790103d70 0x7fa79019a090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 >> 172.21.15.164:0/3567695870 conn(0x7fa7900ff300 msgr2=0x7fa790108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.242+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 shutdown_connections 2024-03-27T08:32:19.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:19.243+0000 7fa797e00640 1 -- 172.21.15.164:0/3567695870 wait complete. 2024-03-27T08:32:19.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:19 smithi167 ceph-mon[34903]: Deploying daemon mds.c on smithi173 2024-03-27T08:32:19.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:19 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3567695870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:19 smithi173 ceph-mon[35397]: Deploying daemon mds.c on smithi173 2024-03-27T08:32:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:19 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3567695870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:20.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:19 smithi164 ceph-mon[31788]: Deploying daemon mds.c on smithi173 2024-03-27T08:32:20.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:19 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3567695870' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:20.782 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:20 smithi173 ceph-mon[35397]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:20 smithi167 ceph-mon[34903]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:20 smithi164 ceph-mon[31788]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:21.075 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:20 smithi173 systemd[1]: Starting Ceph mds.c for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:21.255 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:21.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 -- 172.21.15.164:0/3298154917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf80780f0 msgr2=0x7fcbf8078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3298154917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf80780f0 0x7fcbf8078990 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbf0009ca0 tx=0x7fcbf002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 -- 172.21.15.164:0/3298154917 shutdown_connections 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3298154917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf80780f0 0x7fcbf8078990 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3298154917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf8077750 0x7fcbf8077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3298154917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8076510 0x7fcbf8076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 -- 172.21.15.164:0/3298154917 >> 172.21.15.164:0/3298154917 conn(0x7fcbf80ff300 msgr2=0x7fcbf8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 -- 172.21.15.164:0/3298154917 shutdown_connections 2024-03-27T08:32:21.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.479+0000 7fcbfd400640 1 -- 172.21.15.164:0/3298154917 wait complete. 2024-03-27T08:32:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 Processor -- start 2024-03-27T08:32:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 -- start start 2024-03-27T08:32:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8077750 0x7fcbf819e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:21.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf80780f0 0x7fcbf81a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8113df0 con 0x7fcbf8076510 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8113c70 con 0x7fcbf80780f0 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.480+0000 7fcbfd400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf8113f70 con 0x7fcbf8077750 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45224/0 (socket says 172.21.15.164:45224) 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 -- 172.21.15.164:0/3096890702 learned_addr learned my addr 172.21.15.164:0/3096890702 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 -- 172.21.15.164:0/3096890702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8077750 msgr2=0x7fcbf819e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbefe00640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8077750 0x7fcbf819e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf7200640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf80780f0 0x7fcbf81a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8077750 0x7fcbf819e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 -- 172.21.15.164:0/3096890702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf80780f0 msgr2=0x7fcbf81a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:21.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf80780f0 0x7fcbf81a59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 -- 172.21.15.164:0/3096890702 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf81a6020 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.481+0000 7fcbf6800640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d770 tx=0x7fcbe800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.482+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8017070 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.482+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcbe80054f0 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.482+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf81a6310 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.482+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbe8004d60 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.482+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf81a6810 con 0x7fcbf8076510 2024-03-27T08:32:21.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.483+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf8110840 con 0x7fcbf8076510 2024-03-27T08:32:21.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.485+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fcbe8004f00 con 0x7fcbf8076510 2024-03-27T08:32:21.478 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 podman[65958]: 2024-03-27 08:32:21.035178048 +0000 UTC m=+0.031313943 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:21.478 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 podman[65958]: 2024-03-27 08:32:21.189566427 +0000 UTC m=+0.185702359 container create 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:32:21.478 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 podman[65958]: 2024-03-27 08:32:21.484876488 +0000 UTC m=+0.481012426 container init 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T08:32:21.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.486+0000 7fcbef400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 0x7fcbdc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:21.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.486+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fcbe80cf3d0 con 0x7fcbf8076510 2024-03-27T08:32:21.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.486+0000 7fcbefe00640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 0x7fcbdc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:21.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.487+0000 7fcbefe00640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 0x7fcbdc0a5ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0005fd0 tx=0x7fcbe0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:21.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.491+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcbe809c440 con 0x7fcbf8076510 2024-03-27T08:32:21.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.726+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcbf802d370 con 0x7fcbf8076510 2024-03-27T08:32:21.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.731+0000 7fcbef400640 1 -- 172.21.15.164:0/3096890702 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5530 (secure 0 0 0) 0x7fcbe809bd40 con 0x7fcbf8076510 2024-03-27T08:32:21.724 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:21.724 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-27T08:32:21.724 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 7 2024-03-27T08:32:21.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 msgr2=0x7fcbdc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:21.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 0x7fcbdc0a5ad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fcbe0005fd0 tx=0x7fcbe0005850 comp rx=0 tx=0).stop 2024-03-27T08:32:21.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 msgr2=0x7fcbf819e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fcbe800d770 tx=0x7fcbe800dc30 comp rx=0 tx=0).stop 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 shutdown_connections 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbdc0a3610 0x7fcbdc0a5ad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf80780f0 0x7fcbf81a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf8077750 0x7fcbf819e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 --2- 172.21.15.164:0/3096890702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf8076510 0x7fcbf819e400 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 >> 172.21.15.164:0/3096890702 conn(0x7fcbf80ff300 msgr2=0x7fcbf8100960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 shutdown_connections 2024-03-27T08:32:21.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:21.734+0000 7fcbfd400640 1 -- 172.21.15.164:0/3096890702 wait complete. 2024-03-27T08:32:21.825 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 podman[65958]: 2024-03-27 08:32:21.495224112 +0000 UTC m=+0.491360012 container start 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-03-27T08:32:21.825 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 ceph-mds[65976]: -- 172.21.15.173:0/3856890987 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5587b269fa40 con 0x5587b2673000 2024-03-27T08:32:21.825 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c[65972]: starting mds.c at 2024-03-27T08:32:21.825 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 bash[65958]: 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb 2024-03-27T08:32:21.825 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:32:21 smithi173 systemd[1]: Started Ceph mds.c for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3096890702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3096890702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:22.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:23.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3096890702' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:23.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:23.746 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:23.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:23 smithi167 ceph-mon[34903]: Deploying daemon mds.h on smithi167 2024-03-27T08:32:23.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:23 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.173:6836/3514225451,v1:172.21.15.173:6837/3514225451] up:boot 2024-03-27T08:32:23.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:23 smithi167 ceph-mon[34903]: fsmap 7 up:standby 2024-03-27T08:32:23.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T08:32:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:23 smithi173 ceph-mon[35397]: Deploying daemon mds.h on smithi167 2024-03-27T08:32:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:23 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.173:6836/3514225451,v1:172.21.15.173:6837/3514225451] up:boot 2024-03-27T08:32:23.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:23 smithi173 ceph-mon[35397]: fsmap 7 up:standby 2024-03-27T08:32:23.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T08:32:23.833 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:23 smithi164 ceph-mon[31788]: Deploying daemon mds.h on smithi167 2024-03-27T08:32:23.833 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:23 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.173:6836/3514225451,v1:172.21.15.173:6837/3514225451] up:boot 2024-03-27T08:32:23.833 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:23 smithi164 ceph-mon[31788]: fsmap 7 up:standby 2024-03-27T08:32:23.833 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-03-27T08:32:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 -- 172.21.15.164:0/235218165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 msgr2=0x7f71f4104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 --2- 172.21.15.164:0/235218165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f4104190 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f71e8009900 tx=0x7f71e802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 -- 172.21.15.164:0/235218165 shutdown_connections 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 --2- 172.21.15.164:0/235218165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4105920 0x7f71f410c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 --2- 172.21.15.164:0/235218165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4104f60 0x7f71f41053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 --2- 172.21.15.164:0/235218165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f4104190 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 -- 172.21.15.164:0/235218165 >> 172.21.15.164:0/235218165 conn(0x7f71f40ff300 msgr2=0x7f71f4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 -- 172.21.15.164:0/235218165 shutdown_connections 2024-03-27T08:32:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.976+0000 7f71fb800640 1 -- 172.21.15.164:0/235218165 wait complete. 2024-03-27T08:32:23.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.977+0000 7f71fb800640 1 Processor -- start 2024-03-27T08:32:23.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.977+0000 7f71fb800640 1 -- start start 2024-03-27T08:32:23.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4104f60 0x7f71f419a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4105920 0x7f71f41a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410fa20 con 0x7f71f4103d70 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410f8a0 con 0x7f71f4105920 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71fb800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f71f410fba0 con 0x7f71f4104f60 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45238/0 (socket says 172.21.15.164:45238) 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 -- 172.21.15.164:0/3281527470 learned_addr learned my addr 172.21.15.164:0/3281527470 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f9800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4105920 0x7f71f41a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f3e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4104f60 0x7f71f419a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 -- 172.21.15.164:0/3281527470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4104f60 msgr2=0x7f71f419a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4104f60 0x7f71f419a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 -- 172.21.15.164:0/3281527470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4105920 msgr2=0x7f71f41a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4105920 0x7f71f41a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.978+0000 7f71f8e00640 1 -- 172.21.15.164:0/3281527470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f41a1ca0 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71f8e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e8005ab0 tx=0x7f71e8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8043020 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f71e8005460 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f41a1f30 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71e8003d00 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.979+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f41a2390 con 0x7f71f4103d70 2024-03-27T08:32:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.980+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f410b030 con 0x7f71f4103d70 2024-03-27T08:32:23.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.982+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f71e8046020 con 0x7f71f4103d70 2024-03-27T08:32:23.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.984+0000 7f71f1600640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 0x7f71dc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.984+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f71e80f2080 con 0x7f71f4103d70 2024-03-27T08:32:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.984+0000 7f71f3e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 0x7f71dc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:23.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.985+0000 7f71f3e00640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 0x7f71dc0a5ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005fd0 tx=0x7f71e4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:23.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:23.987+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f71e804d020 con 0x7f71f4103d70 2024-03-27T08:32:24.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.217+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71f402d5c0 con 0x7f71f4103d70 2024-03-27T08:32:24.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.219+0000 7f71f1600640 1 -- 172.21.15.164:0/3281527470 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6358 (secure 0 0 0) 0x7f71e80bf050 con 0x7f71f4103d70 2024-03-27T08:32:24.211 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:24.211 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":8,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-03-27T08:32:24.212 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 8 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.221+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 msgr2=0x7f71dc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.221+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 0x7f71dc0a5ad0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f71e4005fd0 tx=0x7f71e4005850 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.221+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 msgr2=0x7f71f419a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.221+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f71e8005ab0 tx=0x7f71e8004e20 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 shutdown_connections 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f71dc0a3610 0x7f71dc0a5ad0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f71f4105920 0x7f71f41a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f71f4104f60 0x7f71f419a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 --2- 172.21.15.164:0/3281527470 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f71f4103d70 0x7f71f419a080 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 >> 172.21.15.164:0/3281527470 conn(0x7f71f40ff300 msgr2=0x7f71f4108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:24.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 shutdown_connections 2024-03-27T08:32:24.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:24.222+0000 7f71fb800640 1 -- 172.21.15.164:0/3281527470 wait complete. 2024-03-27T08:32:24.779 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:24 smithi167 ceph-mon[34903]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:24.780 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:24 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3281527470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:24.780 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:24 smithi167 systemd[1]: Starting Ceph mds.h for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:24 smithi173 ceph-mon[35397]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:24 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3281527470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:24 smithi164 ceph-mon[31788]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3281527470' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:25.431 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 podman[64868]: 2024-03-27 08:32:25.055226477 +0000 UTC m=+0.036386930 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:25.431 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 podman[64868]: 2024-03-27 08:32:25.160169547 +0000 UTC m=+0.141330025 container create 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD) 2024-03-27T08:32:25.432 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 podman[64868]: 2024-03-27 08:32:25.438873485 +0000 UTC m=+0.420033970 container init 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:32:25.819 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 podman[64868]: 2024-03-27 08:32:25.449272914 +0000 UTC m=+0.430433362 container start 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:32:25.819 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 ceph-mds[64887]: -- 172.21.15.167:0/1733953409 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a2e9d5da40 con 0x55a2e9d30800 2024-03-27T08:32:25.819 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: starting mds.h at 2024-03-27T08:32:25.819 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 bash[64868]: 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 2024-03-27T08:32:25.819 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:32:25 smithi167 systemd[1]: Started Ceph mds.h for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:26.232 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:26.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 -- 172.21.15.164:0/4073055815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 msgr2=0x7fbf74103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:26.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 --2- 172.21.15.164:0/4073055815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74103fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbf68009900 tx=0x7fbf6802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:26.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 -- 172.21.15.164:0/4073055815 shutdown_connections 2024-03-27T08:32:26.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 --2- 172.21.15.164:0/4073055815 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 0x7fbf7410bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 --2- 172.21.15.164:0/4073055815 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf741051f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 --2- 172.21.15.164:0/4073055815 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74103fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 -- 172.21.15.164:0/4073055815 >> 172.21.15.164:0/4073055815 conn(0x7fbf740ff0f0 msgr2=0x7fbf74101530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:26.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 -- 172.21.15.164:0/4073055815 shutdown_connections 2024-03-27T08:32:26.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.455+0000 7fbf7a600640 1 -- 172.21.15.164:0/4073055815 wait complete. 2024-03-27T08:32:26.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.456+0000 7fbf7a600640 1 Processor -- start 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.456+0000 7fbf7a600640 1 -- start start 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf7419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 0x7fbf741a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410f8b0 con 0x7fbf74103b80 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410f730 con 0x7fbf74105730 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf7a600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbf7410fa30 con 0x7fbf74104d70 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf79200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf79200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37274/0 (socket says 172.21.15.164:37274) 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf79200640 1 -- 172.21.15.164:0/2886571903 learned_addr learned my addr 172.21.15.164:0/2886571903 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:26.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf79c00640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 0x7fbf741a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.457+0000 7fbf73e00640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf7419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 -- 172.21.15.164:0/2886571903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 msgr2=0x7fbf7419a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf7419a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 -- 172.21.15.164:0/2886571903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 msgr2=0x7fbf741a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 0x7fbf741a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 -- 172.21.15.164:0/2886571903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf741a1b20 con 0x7fbf74103b80 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf73e00640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf7419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf79200640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000c00 tx=0x7fbf68004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68043020 con 0x7fbf74103b80 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf680054d0 con 0x7fbf74103b80 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf741a1db0 con 0x7fbf74103b80 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf68003d40 con 0x7fbf74103b80 2024-03-27T08:32:26.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.458+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf741a22a0 con 0x7fbf74103b80 2024-03-27T08:32:26.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.459+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf7410af20 con 0x7fbf74103b80 2024-03-27T08:32:26.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.461+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fbf68046020 con 0x7fbf74103b80 2024-03-27T08:32:26.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.464+0000 7fbf71600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 0x7fbf5c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:26.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.464+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fbf680f1ce0 con 0x7fbf74103b80 2024-03-27T08:32:26.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.464+0000 7fbf73e00640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 0x7fbf5c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:26.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.464+0000 7fbf73e00640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 0x7fbf5c0a5ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf7419b410 tx=0x7fbf60005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:26.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.468+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fbf6804d020 con 0x7fbf74103b80 2024-03-27T08:32:26.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.710+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbf7402d370 con 0x7fbf74103b80 2024-03-27T08:32:26.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.711+0000 7fbf71600640 1 -- 172.21.15.164:0/2886571903 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7fbf680becb0 con 0x7fbf74103b80 2024-03-27T08:32:26.703 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:26.703 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:26.703 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 9 2024-03-27T08:32:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 msgr2=0x7fbf5c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 0x7fbf5c0a5ad0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbf7419b410 tx=0x7fbf60005e50 comp rx=0 tx=0).stop 2024-03-27T08:32:26.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 msgr2=0x7fbf74199f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fbf68000c00 tx=0x7fbf68004f10 comp rx=0 tx=0).stop 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 shutdown_connections 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbf5c0a3610 0x7fbf5c0a5ad0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf74105730 0x7fbf741a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbf74104d70 0x7fbf7419a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 --2- 172.21.15.164:0/2886571903 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbf74103b80 0x7fbf74199f00 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 >> 172.21.15.164:0/2886571903 conn(0x7fbf740ff0f0 msgr2=0x7fbf741080f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.713+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 shutdown_connections 2024-03-27T08:32:26.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:26.714+0000 7fbf7a600640 1 -- 172.21.15.164:0/2886571903 wait complete. 2024-03-27T08:32:26.721 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:boot 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: fsmap 8 up:standby 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:26.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:boot 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: fsmap 8 up:standby 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:boot 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: fsmap 8 up:standby 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:26.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:27 smithi173 ceph-mon[35397]: Deploying daemon mds.i on smithi173 2024-03-27T08:32:27.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:27 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2886571903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:27 smithi164 ceph-mon[31788]: Deploying daemon mds.i on smithi173 2024-03-27T08:32:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:27 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2886571903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:28.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:27 smithi167 ceph-mon[34903]: Deploying daemon mds.i on smithi173 2024-03-27T08:32:28.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:27 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2886571903' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:28.724 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:28.791 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:28 smithi173 ceph-mon[35397]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:28.906 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:28 smithi164 ceph-mon[31788]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.955+0000 7f020fa00640 1 -- 172.21.15.164:0/3734511217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0208077750 msgr2=0x7f0208077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.955+0000 7f020fa00640 1 --2- 172.21.15.164:0/3734511217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0208077750 0x7f0208077bb0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f01f4009900 tx=0x7f01f402bc50 comp rx=0 tx=0).stop 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 -- 172.21.15.164:0/3734511217 shutdown_connections 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 --2- 172.21.15.164:0/3734511217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02080780f0 0x7f0208078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 --2- 172.21.15.164:0/3734511217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0208077750 0x7f0208077bb0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 --2- 172.21.15.164:0/3734511217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 0x7f0208076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 -- 172.21.15.164:0/3734511217 >> 172.21.15.164:0/3734511217 conn(0x7f02080ff300 msgr2=0x7f0208101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 -- 172.21.15.164:0/3734511217 shutdown_connections 2024-03-27T08:32:28.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.956+0000 7f020fa00640 1 -- 172.21.15.164:0/3734511217 wait complete. 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 Processor -- start 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 -- start start 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 0x7f020819e420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0208077750 0x7f020819e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0208113e30 con 0x7f02080780f0 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0208113cb0 con 0x7f0208077750 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020fa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0208113fb0 con 0x7f0208076510 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020da00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:28.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020da00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37290/0 (socket says 172.21.15.164:37290) 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.957+0000 7f020da00640 1 -- 172.21.15.164:0/2732813602 learned_addr learned my addr 172.21.15.164:0/2732813602 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020d000640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 0x7f020819e420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f0207e00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0208077750 0x7f020819e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 -- 172.21.15.164:0/2732813602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 msgr2=0x7f020819e420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 0x7f020819e420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 -- 172.21.15.164:0/2732813602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0208077750 msgr2=0x7f020819e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0208077750 0x7f020819e960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 -- 172.21.15.164:0/2732813602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02081a6040 con 0x7f02080780f0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020da00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f020000cce0 tx=0x7f020000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f020000f450 con 0x7f02080780f0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f020000fac0 con 0x7f02080780f0 2024-03-27T08:32:28.952 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0200018be0 con 0x7f02080780f0 2024-03-27T08:32:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.958+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02081a6330 con 0x7f02080780f0 2024-03-27T08:32:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.959+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02081a6800 con 0x7f02080780f0 2024-03-27T08:32:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.960+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0208110850 con 0x7f02080780f0 2024-03-27T08:32:28.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.962+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f020000fc70 con 0x7f02080780f0 2024-03-27T08:32:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.963+0000 7f0205600640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 0x7f01f00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.963+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f02000cffe0 con 0x7f02080780f0 2024-03-27T08:32:28.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.963+0000 7f020d000640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 0x7f01f00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:28.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.964+0000 7f020d000640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 0x7f01f00a5ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009bd0 tx=0x7f01fc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:28.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:28.968+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0200014030 con 0x7f02080780f0 2024-03-27T08:32:29.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:28 smithi167 ceph-mon[34903]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:29.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.209+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f020802d370 con 0x7f02080780f0 2024-03-27T08:32:29.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.211+0000 7f0205600640 1 -- 172.21.15.164:0/2732813602 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7186 (secure 0 0 0) 0x7f020009cff0 con 0x7f02080780f0 2024-03-27T08:32:29.203 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:29.203 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:29.203 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 9 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 msgr2=0x7f01f00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 0x7f01f00a5ad0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f01fc009bd0 tx=0x7f01fc005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 msgr2=0x7f02081a59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f020000cce0 tx=0x7f020000a620 comp rx=0 tx=0).stop 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 shutdown_connections 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f01f00a3610 0x7f01f00a5ad0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02080780f0 0x7f02081a59d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0208077750 0x7f020819e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 --2- 172.21.15.164:0/2732813602 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0208076510 0x7f020819e420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 >> 172.21.15.164:0/2732813602 conn(0x7f02080ff300 msgr2=0x7f02081009c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 shutdown_connections 2024-03-27T08:32:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:29.214+0000 7f020fa00640 1 -- 172.21.15.164:0/2732813602 wait complete. 2024-03-27T08:32:29.464 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 podman[66260]: 2024-03-27 08:32:29.19297653 +0000 UTC m=+0.168434702 container create 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-27T08:32:29.465 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 podman[66260]: 2024-03-27 08:32:29.471721485 +0000 UTC m=+0.447179664 container init 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-27T08:32:29.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:29 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2732813602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:29.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:29 smithi173 ceph-mon[35397]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:29.825 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 podman[66260]: 2024-03-27 08:32:29.481859596 +0000 UTC m=+0.457317775 container start 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-03-27T08:32:29.825 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 ceph-mds[66278]: -- 172.21.15.173:0/259230961 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x564abd2e04e0 con 0x564abd2b6800 2024-03-27T08:32:29.825 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 ceph-mds[66278]: -- 172.21.15.173:0/259230961 <== mon.1 v2:172.21.15.173:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564abd2e3a40 con 0x564abd2b6800 2024-03-27T08:32:29.825 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i[66274]: starting mds.i at 2024-03-27T08:32:29.826 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 bash[66260]: 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f 2024-03-27T08:32:29.826 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:32:29 smithi173 systemd[1]: Started Ceph mds.i for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:29.875 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:29 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2732813602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:29.875 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:29 smithi164 ceph-mon[31788]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:30.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:29 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2732813602' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:30.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:29 smithi167 ceph-mon[34903]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:30.945 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.173:6838/2691398042,v1:172.21.15.173:6839/2691398042] up:boot 2024-03-27T08:32:30.945 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: fsmap 9 up:standby 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:30.946 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:30 smithi164 ceph-mon[31788]: Deploying daemon mds.g on smithi164 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.173:6838/2691398042,v1:172.21.15.173:6839/2691398042] up:boot 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: fsmap 9 up:standby 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:31.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:30 smithi167 ceph-mon[34903]: Deploying daemon mds.g on smithi164 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.173:6838/2691398042,v1:172.21.15.173:6839/2691398042] up:boot 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: fsmap 9 up:standby 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:30 smithi173 ceph-mon[35397]: Deploying daemon mds.g on smithi164 2024-03-27T08:32:31.226 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:31.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 -- 172.21.15.164:0/3383271760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c103b70 msgr2=0x7f209c103f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 --2- 172.21.15.164:0/3383271760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c103b70 0x7f209c103f90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2090009900 tx=0x7f209002bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 -- 172.21.15.164:0/3383271760 shutdown_connections 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 --2- 172.21.15.164:0/3383271760 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209c105720 0x7f209c10bfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 --2- 172.21.15.164:0/3383271760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c104d60 0x7f209c1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 --2- 172.21.15.164:0/3383271760 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c103b70 0x7f209c103f90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 -- 172.21.15.164:0/3383271760 >> 172.21.15.164:0/3383271760 conn(0x7f209c0ff0e0 msgr2=0x7f209c101520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:31.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 -- 172.21.15.164:0/3383271760 shutdown_connections 2024-03-27T08:32:31.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.463+0000 7f20a2c00640 1 -- 172.21.15.164:0/3383271760 wait complete. 2024-03-27T08:32:31.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.464+0000 7f20a2c00640 1 Processor -- start 2024-03-27T08:32:31.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.464+0000 7f20a2c00640 1 -- start start 2024-03-27T08:32:31.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.464+0000 7f20a2c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 0x7f209c199de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:31.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209c104d60 0x7f209c19a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10f820 con 0x7f209c105720 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10f6a0 con 0x7f209c103b70 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f209c10f9a0 con 0x7f209c104d60 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37302/0 (socket says 172.21.15.164:37302) 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 -- 172.21.15.164:0/2097014754 learned_addr learned my addr 172.21.15.164:0/2097014754 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a1800640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 0x7f209c199de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:31.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 -- 172.21.15.164:0/2097014754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209c104d60 msgr2=0x7f209c19a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209c104d60 0x7f209c19a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 -- 172.21.15.164:0/2097014754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 msgr2=0x7f209c199de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 0x7f209c199de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a2200640 1 -- 172.21.15.164:0/2097014754 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f209c1a1a00 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.465+0000 7f20a1800640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 0x7f209c199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f20a2200640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f209400eaa0 tx=0x7f209400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209400cdb0 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2094005020 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20940116b0 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f209c1a1cf0 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.466+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f209c1a21f0 con 0x7f209c105720 2024-03-27T08:32:31.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.467+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c10adc0 con 0x7f209c105720 2024-03-27T08:32:31.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.469+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f20940051d0 con 0x7f209c105720 2024-03-27T08:32:31.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.470+0000 7f209a000640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 0x7f20840a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:31.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.470+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f20940cfb20 con 0x7f209c105720 2024-03-27T08:32:31.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.470+0000 7f20a1800640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 0x7f20840a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:31.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.471+0000 7f20a1800640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 0x7f20840a5b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f20900096c0 tx=0x7f2090005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:31.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.474+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2094016030 con 0x7f209c105720 2024-03-27T08:32:31.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.721+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f209c02d370 con 0x7f209c105720 2024-03-27T08:32:31.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.722+0000 7f209a000640 1 -- 172.21.15.164:0/2097014754 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8016 (secure 0 0 0) 0x7f209409caf0 con 0x7f209c105720 2024-03-27T08:32:31.715 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:31.715 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:31.715 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 10 2024-03-27T08:32:31.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 msgr2=0x7f20840a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:31.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 0x7f20840a5b50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f20900096c0 tx=0x7f2090005fd0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 msgr2=0x7f209c1a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:31.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f209400eaa0 tx=0x7f209400ef60 comp rx=0 tx=0).stop 2024-03-27T08:32:31.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 shutdown_connections 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f20840a3690 0x7f20840a5b50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f209c105720 0x7f209c1a1390 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f209c104d60 0x7f209c19a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 --2- 172.21.15.164:0/2097014754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f209c103b70 0x7f209c199de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 >> 172.21.15.164:0/2097014754 conn(0x7f209c0ff0e0 msgr2=0x7f209c107f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 shutdown_connections 2024-03-27T08:32:31.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:31.725+0000 7f20a2c00640 1 -- 172.21.15.164:0/2097014754 wait complete. 2024-03-27T08:32:31.864 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:31 smithi164 ceph-mon[31788]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:32.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:31 smithi167 ceph-mon[34903]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:32.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:31 smithi173 ceph-mon[35397]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:32.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:32 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2097014754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:32 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2097014754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:33.005 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:32 smithi164 systemd[1]: Starting Ceph mds.g for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:33.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:32 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2097014754' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:33.322 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 podman[74302]: 2024-03-27 08:32:32.936813346 +0000 UTC m=+0.036860717 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:33.322 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 podman[74302]: 2024-03-27 08:32:33.065993603 +0000 UTC m=+0.166041010 container create af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:32:33.322 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 podman[74302]: 2024-03-27 08:32:33.328108784 +0000 UTC m=+0.428156234 container init af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-03-27T08:32:33.616 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 podman[74302]: 2024-03-27 08:32:33.33856195 +0000 UTC m=+0.438609343 container start af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD) 2024-03-27T08:32:33.637 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 ceph-mds[74320]: -- 172.21.15.164:0/3313788364 <== mon.0 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559c927d5a40 con 0x559c927a9000 2024-03-27T08:32:33.637 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g[74316]: starting mds.g at 2024-03-27T08:32:33.637 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 bash[74302]: af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a 2024-03-27T08:32:33.637 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:32:33 smithi164 systemd[1]: Started Ceph mds.g for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:33.638 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:33 smithi164 ceph-mon[31788]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:33.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:33.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 -- 172.21.15.164:0/1187630254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4102d50 msgr2=0x7f9fb41031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/1187630254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4102d50 0x7f9fb41031d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c009900 tx=0x7f9f9c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 -- 172.21.15.164:0/1187630254 shutdown_connections 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/1187630254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4103710 0x7f9fb4109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/1187630254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4102d50 0x7f9fb41031d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/1187630254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4101b60 0x7f9fb4101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 -- 172.21.15.164:0/1187630254 >> 172.21.15.164:0/1187630254 conn(0x7f9fb40fd0f0 msgr2=0x7f9fb40ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 -- 172.21.15.164:0/1187630254 shutdown_connections 2024-03-27T08:32:33.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.947+0000 7f9fb8e00640 1 -- 172.21.15.164:0/1187630254 wait complete. 2024-03-27T08:32:33.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.948+0000 7f9fb8e00640 1 Processor -- start 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.948+0000 7f9fb8e00640 1 -- start start 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101b60 0x7f9fb4075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4102d50 0x7f9fb4073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb410d810 con 0x7f9fb4103710 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb410d690 con 0x7f9fb4102d50 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb8e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9fb410d990 con 0x7f9fb4101b60 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb2800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb2800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:37344/0 (socket says 172.21.15.164:37344) 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb2800640 1 -- 172.21.15.164:0/308732211 learned_addr learned my addr 172.21.15.164:0/308732211 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fb1e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101b60 0x7f9fb4075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.949+0000 7f9fabe00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4102d50 0x7f9fb4073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:33.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 -- 172.21.15.164:0/308732211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101b60 msgr2=0x7f9fb4075900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101b60 0x7f9fb4075900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 -- 172.21.15.164:0/308732211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4102d50 msgr2=0x7f9fb4073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4102d50 0x7f9fb4073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 -- 172.21.15.164:0/308732211 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fb4074d10 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb2800640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00eaa0 tx=0x7f9fac00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac00cdb0 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9fac005020 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fb41a1f30 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.950+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fac0116b0 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.951+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fb41a2390 con 0x7f9fb4103710 2024-03-27T08:32:33.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.952+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fb4108e80 con 0x7f9fb4103710 2024-03-27T08:32:33.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.954+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f9fac0051d0 con 0x7f9fb4103710 2024-03-27T08:32:33.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.956+0000 7f9faaa00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 0x7f9f980a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:33.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.957+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f9fac0cf9f0 con 0x7f9fb4103710 2024-03-27T08:32:33.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.957+0000 7f9fb1e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 0x7f9f980a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:33.949 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.957+0000 7f9fb1e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 0x7f9f980a5b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4102bb0 tx=0x7f9fa400b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:33.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:33.961+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9fac016030 con 0x7f9fb4103710 2024-03-27T08:32:34.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:33 smithi167 ceph-mon[34903]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:33 smithi173 ceph-mon[35397]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:34.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.205+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9fb402d370 con 0x7f9fb4103710 2024-03-27T08:32:34.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.206+0000 7f9faaa00640 1 -- 172.21.15.164:0/308732211 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8845 (secure 0 0 0) 0x7f9fac09c370 con 0x7f9fb4103710 2024-03-27T08:32:34.198 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:34.198 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:34.199 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 11 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 msgr2=0x7f9f980a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 0x7f9f980a5b50 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9fb4102bb0 tx=0x7f9fa400b390 comp rx=0 tx=0).stop 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 msgr2=0x7f9fb4074480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9fac00eaa0 tx=0x7f9fac00ef60 comp rx=0 tx=0).stop 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 shutdown_connections 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9f980a3690 0x7f9f980a5b50 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9fb4103710 0x7f9fb4074480 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9fb4102d50 0x7f9fb4073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:34.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 --2- 172.21.15.164:0/308732211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9fb4101b60 0x7f9fb4075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 >> 172.21.15.164:0/308732211 conn(0x7f9fb40fd0f0 msgr2=0x7f9fb4106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 shutdown_connections 2024-03-27T08:32:34.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:34.209+0000 7f9fb8e00640 1 -- 172.21.15.164:0/308732211 wait complete. 2024-03-27T08:32:34.879 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.164:6838/2287850216,v1:172.21.15.164:6839/2287850216] up:boot 2024-03-27T08:32:34.879 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: fsmap 10 up:standby 2024-03-27T08:32:34.879 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T08:32:34.879 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: Deploying daemon mds.a on smithi164 2024-03-27T08:32:34.880 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:34 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/308732211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.164:6838/2287850216,v1:172.21.15.164:6839/2287850216] up:boot 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: fsmap 10 up:standby 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: Deploying daemon mds.a on smithi164 2024-03-27T08:32:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:34 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/308732211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.164:6838/2287850216,v1:172.21.15.164:6839/2287850216] up:boot 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: fsmap 10 up:standby 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: Deploying daemon mds.a on smithi164 2024-03-27T08:32:35.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:34 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/308732211' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:35.722 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:35 smithi164 ceph-mon[31788]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:36.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:35 smithi167 ceph-mon[34903]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:36.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:35 smithi173 ceph-mon[35397]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:36.220 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 -- 172.21.15.164:0/4280876934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481016b0 msgr2=0x7f3848101b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 --2- 172.21.15.164:0/4280876934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481016b0 0x7f3848101b30 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3840009ca0 tx=0x7f384002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 -- 172.21.15.164:0/4280876934 shutdown_connections 2024-03-27T08:32:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 --2- 172.21.15.164:0/4280876934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481016b0 0x7f3848101b30 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.705 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 --2- 172.21.15.164:0/4280876934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 0x7f3848101170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 --2- 172.21.15.164:0/4280876934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481003b0 0x7f38481007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 -- 172.21.15.164:0/4280876934 >> 172.21.15.164:0/4280876934 conn(0x7f38480fbfb0 msgr2=0x7f38480fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:36.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 -- 172.21.15.164:0/4280876934 shutdown_connections 2024-03-27T08:32:36.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.713+0000 7f3850000640 1 -- 172.21.15.164:0/4280876934 wait complete. 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 Processor -- start 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 -- start start 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 0x7f384819a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481016b0 0x7f38481a1540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f384810f9b0 con 0x7f38481003b0 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f384810f830 con 0x7f38481016b0 2024-03-27T08:32:36.708 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.714+0000 7f3850000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f384810fb30 con 0x7f3848100d10 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60644/0 (socket says 172.21.15.164:60644) 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 -- 172.21.15.164:0/1986620214 learned_addr learned my addr 172.21.15.164:0/1986620214 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384e000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481016b0 0x7f38481a1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384cc00640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 0x7f384819a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 -- 172.21.15.164:0/1986620214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 msgr2=0x7f384819a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 0x7f384819a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 -- 172.21.15.164:0/1986620214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481016b0 msgr2=0x7f38481a1540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481016b0 0x7f38481a1540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.715+0000 7f384d600640 1 -- 172.21.15.164:0/1986620214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38481a1bb0 con 0x7f38481003b0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f384d600640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f383c00d950 tx=0x7f383c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c017070 con 0x7f38481003b0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f383c009c30 con 0x7f38481003b0 2024-03-27T08:32:36.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38481a1ea0 con 0x7f38481003b0 2024-03-27T08:32:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383c00f6b0 con 0x7f38481003b0 2024-03-27T08:32:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.716+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38481a2300 con 0x7f38481003b0 2024-03-27T08:32:36.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.717+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384810b250 con 0x7f38481003b0 2024-03-27T08:32:36.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.719+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f383c010a50 con 0x7f38481003b0 2024-03-27T08:32:36.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.721+0000 7f3846000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 0x7f38300a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:36.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.721+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f383c0cf5c0 con 0x7f38481003b0 2024-03-27T08:32:36.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.721+0000 7f384cc00640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 0x7f38300a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:36.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.722+0000 7f384cc00640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 0x7f38300a5ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3834005fd0 tx=0x7f3834005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:36.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.726+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f383c009de0 con 0x7f38481003b0 2024-03-27T08:32:36.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.977+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f384802d5e0 con 0x7f38481003b0 2024-03-27T08:32:36.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.979+0000 7f3846000640 1 -- 172.21.15.164:0/1986620214 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8845 (secure 0 0 0) 0x7f383c09c630 con 0x7f38481003b0 2024-03-27T08:32:36.971 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:36.971 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":11,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:36.971 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 11 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 msgr2=0x7f38300a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 0x7f38300a5ad0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3834005fd0 tx=0x7f3834005850 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 msgr2=0x7f3848199f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f383c00d950 tx=0x7f383c00de10 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 shutdown_connections 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38300a3610 0x7f38300a5ad0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38481016b0 0x7f38481a1540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3848100d10 0x7f384819a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 --2- 172.21.15.164:0/1986620214 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f38481003b0 0x7f3848199f90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.981+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 >> 172.21.15.164:0/1986620214 conn(0x7f38480fbfb0 msgr2=0x7f38480fd690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:36.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.982+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 shutdown_connections 2024-03-27T08:32:36.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:36.982+0000 7f3850000640 1 -- 172.21.15.164:0/1986620214 wait complete. 2024-03-27T08:32:36.979 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:36 smithi164 systemd[1]: Starting Ceph mds.a for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:37.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:37 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1986620214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:37.255 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:36 smithi164 podman[74678]: 2024-03-27 08:32:36.892184192 +0000 UTC m=+0.033361917 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:37.255 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 podman[74678]: 2024-03-27 08:32:37.016337794 +0000 UTC m=+0.157515508 container create a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:32:37.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:37 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1986620214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:37.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:37 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1986620214' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 podman[74678]: 2024-03-27 08:32:37.273375745 +0000 UTC m=+0.414553496 container init a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 podman[74678]: 2024-03-27 08:32:37.283347184 +0000 UTC m=+0.424524939 container start a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 ceph-mds[74698]: -- 172.21.15.164:0/3020787949 <== mon.0 v2:172.21.15.164:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55cb1916ba40 con 0x55cb1913e800 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a[74694]: starting mds.a at 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 bash[74678]: a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf 2024-03-27T08:32:37.755 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:32:37 smithi164 systemd[1]: Started Ceph mds.a for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.164:6840/429709986,v1:172.21.15.164:6841/429709986] up:boot 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: fsmap 11 up:standby 2024-03-27T08:32:38.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:38 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:38.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.164:6840/429709986,v1:172.21.15.164:6841/429709986] up:boot 2024-03-27T08:32:38.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: fsmap 11 up:standby 2024-03-27T08:32:38.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:38 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T08:32:38.996 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-27T08:32:39.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-27T08:32:39.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:39.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.164:6840/429709986,v1:172.21.15.164:6841/429709986] up:boot 2024-03-27T08:32:39.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: fsmap 11 up:standby 2024-03-27T08:32:39.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:38 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-03-27T08:32:39.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 -- 172.21.15.164:0/2825398424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 msgr2=0x7fad60077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 --2- 172.21.15.164:0/2825398424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad60077bb0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fad48009900 tx=0x7fad4802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 -- 172.21.15.164:0/2825398424 shutdown_connections 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 --2- 172.21.15.164:0/2825398424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad600780f0 0x7fad60078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 --2- 172.21.15.164:0/2825398424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad60077bb0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 --2- 172.21.15.164:0/2825398424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad60076510 0x7fad60076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 -- 172.21.15.164:0/2825398424 >> 172.21.15.164:0/2825398424 conn(0x7fad600ff300 msgr2=0x7fad60101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 -- 172.21.15.164:0/2825398424 shutdown_connections 2024-03-27T08:32:39.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.223+0000 7fad65e00640 1 -- 172.21.15.164:0/2825398424 wait complete. 2024-03-27T08:32:39.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.224+0000 7fad65e00640 1 Processor -- start 2024-03-27T08:32:39.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.224+0000 7fad65e00640 1 -- start start 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 0x7fad6019e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 0x7fad601a5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fad60113e30 con 0x7fad60077750 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad60113cb0 con 0x7fad600780f0 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad65e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad60113fb0 con 0x7fad60076510 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60684/0 (socket says 172.21.15.164:60684) 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 -- 172.21.15.164:0/1970068415 learned_addr learned my addr 172.21.15.164:0/1970068415 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad5ea00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 0x7fad6019e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad5f400640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 0x7fad601a5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 -- 172.21.15.164:0/1970068415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 msgr2=0x7fad6019e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 0x7fad6019e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 -- 172.21.15.164:0/1970068415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 msgr2=0x7fad601a5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:39.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 0x7fad601a5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad57e00640 1 -- 172.21.15.164:0/1970068415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad601a6070 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad5ea00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 0x7fad6019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.225+0000 7fad5f400640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 0x7fad601a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad57e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fad48000c00 tx=0x7fad48004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48043020 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad480054d0 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad601a6300 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad48003d40 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.226+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad601a68a0 con 0x7fad60077750 2024-03-27T08:32:39.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.227+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad60110850 con 0x7fad60077750 2024-03-27T08:32:39.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.229+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fad48046020 con 0x7fad60077750 2024-03-27T08:32:39.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.231+0000 7fad64a00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 0x7fad440a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:39.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.231+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fad480f1c70 con 0x7fad60077750 2024-03-27T08:32:39.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.231+0000 7fad5ea00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 0x7fad440a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:39.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.232+0000 7fad5ea00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 0x7fad440a5b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad50009b40 tx=0x7fad50005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:39.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.235+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fad4804d020 con 0x7fad60077750 2024-03-27T08:32:39.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.473+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad60062750 con 0x7fad60077750 2024-03-27T08:32:39.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.474+0000 7fad64a00640 1 -- 172.21.15.164:0/1970068415 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9671 (secure 0 0 0) 0x7fad480bec40 con 0x7fad60077750 2024-03-27T08:32:39.466 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:39.466 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-03-27T08:32:39.467 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 12 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 msgr2=0x7fad440a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 0x7fad440a5b50 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fad50009b40 tx=0x7fad50005e50 comp rx=0 tx=0).stop 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 msgr2=0x7fad6019e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fad48000c00 tx=0x7fad48004f10 comp rx=0 tx=0).stop 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 shutdown_connections 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fad440a3690 0x7fad440a5b50 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad600780f0 0x7fad601a5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad60077750 0x7fad6019e990 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 --2- 172.21.15.164:0/1970068415 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad60076510 0x7fad6019e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:39.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 >> 172.21.15.164:0/1970068415 conn(0x7fad600ff300 msgr2=0x7fad601009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:39.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 shutdown_connections 2024-03-27T08:32:39.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:39.477+0000 7fad65e00640 1 -- 172.21.15.164:0/1970068415 wait complete. 2024-03-27T08:32:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:39 smithi164 ceph-mon[31788]: Deploying daemon mds.b on smithi167 2024-03-27T08:32:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:39 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1970068415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:39.786 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:39 smithi167 ceph-mon[34903]: Deploying daemon mds.b on smithi167 2024-03-27T08:32:39.786 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:39 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1970068415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:39.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:39 smithi173 ceph-mon[35397]: Deploying daemon mds.b on smithi167 2024-03-27T08:32:39.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:39 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1970068415' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:40.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:40 smithi167 ceph-mon[34903]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:40 smithi173 ceph-mon[35397]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:40.881 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:40 smithi164 ceph-mon[31788]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:40.965 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:40 smithi167 systemd[1]: Starting Ceph mds.b for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:32:41.252 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:40 smithi167 podman[65181]: 2024-03-27 08:32:40.87679095 +0000 UTC m=+0.033126282 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:32:41.252 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 podman[65181]: 2024-03-27 08:32:41.013251788 +0000 UTC m=+0.169587176 container create ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:32:41.252 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 podman[65181]: 2024-03-27 08:32:41.258841081 +0000 UTC m=+0.415176459 container init ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True) 2024-03-27T08:32:41.488 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:41.569 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 podman[65181]: 2024-03-27 08:32:41.269138721 +0000 UTC m=+0.425474096 container start ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-27T08:32:41.569 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 ceph-mds[65200]: -- 172.21.15.167:0/3571456802 <== mon.2 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5604fd251a40 con 0x5604fd224c00 2024-03-27T08:32:41.569 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b[65196]: starting mds.b at 2024-03-27T08:32:41.569 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 bash[65181]: ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 2024-03-27T08:32:41.569 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:41 smithi167 systemd[1]: Started Ceph mds.b for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:32:41.710 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 -- 172.21.15.164:0/3920547590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624109360 msgr2=0x7f56241097e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 --2- 172.21.15.164:0/3920547590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624109360 0x7f56241097e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f560c009900 tx=0x7f560c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 -- 172.21.15.164:0/3920547590 shutdown_connections 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 --2- 172.21.15.164:0/3920547590 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109d20 0x7f56241105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 --2- 172.21.15.164:0/3920547590 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624109360 0x7f56241097e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 --2- 172.21.15.164:0/3920547590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624108170 0x7f5624108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 -- 172.21.15.164:0/3920547590 >> 172.21.15.164:0/3920547590 conn(0x7f5624077130 msgr2=0x7f5624079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.718+0000 7f562bc00640 1 -- 172.21.15.164:0/3920547590 shutdown_connections 2024-03-27T08:32:41.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.719+0000 7f562bc00640 1 -- 172.21.15.164:0/3920547590 wait complete. 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.719+0000 7f562bc00640 1 Processor -- start 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 -- start start 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109360 0x7f562419e980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624109d20 0x7f56241a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:41.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5624113e20 con 0x7f5624108170 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5624113ca0 con 0x7f5624109d20 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f562bc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5624113fa0 con 0x7f5624109360 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f5629200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f5629200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60692/0 (socket says 172.21.15.164:60692) 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f5629200640 1 -- 172.21.15.164:0/588477155 learned_addr learned my addr 172.21.15.164:0/588477155 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.720+0000 7f5629c00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624109d20 0x7f56241a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f561be00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109360 0x7f562419e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 -- 172.21.15.164:0/588477155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109360 msgr2=0x7f562419e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109360 0x7f562419e980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 -- 172.21.15.164:0/588477155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624109d20 msgr2=0x7f56241a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624109d20 0x7f56241a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 -- 172.21.15.164:0/588477155 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56241a6060 con 0x7f5624108170 2024-03-27T08:32:41.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5629200640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f561400d770 tx=0x7f561400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614017070 con 0x7f5624108170 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5614009c30 con 0x7f5624108170 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241a6350 con 0x7f5624108170 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5614003e10 con 0x7f5624108170 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.721+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a68c0 con 0x7f5624108170 2024-03-27T08:32:41.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.722+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f562410f490 con 0x7f5624108170 2024-03-27T08:32:41.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.724+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f5614004020 con 0x7f5624108170 2024-03-27T08:32:41.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.726+0000 7f5622000640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 0x7f56080a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:41.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.726+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f56140cf6e0 con 0x7f5624108170 2024-03-27T08:32:41.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.726+0000 7f561be00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 0x7f56080a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:41.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.727+0000 7f561be00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 0x7f56080a5b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f560c006010 tx=0x7f560c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:41.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.730+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f561409c6b0 con 0x7f5624108170 2024-03-27T08:32:41.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.988+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f562402d370 con 0x7f5624108170 2024-03-27T08:32:41.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.989+0000 7f5622000640 1 -- 172.21.15.164:0/588477155 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10500 (secure 0 0 0) 0x7f561409bfb0 con 0x7f5624108170 2024-03-27T08:32:41.981 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:41.981 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24448,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34403,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34430,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34463,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34502,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-03-27T08:32:41.981 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 13 2024-03-27T08:32:41.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.991+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 msgr2=0x7f56080a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:41.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.991+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 0x7f56080a5b50 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f560c006010 tx=0x7f560c000bc0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.991+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 msgr2=0x7f562419e440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.991+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f561400d770 tx=0x7f561400dc30 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 shutdown_connections 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56080a3690 0x7f56080a5b50 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624109d20 0x7f56241a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5624109360 0x7f562419e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 --2- 172.21.15.164:0/588477155 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5624108170 0x7f562419e440 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 >> 172.21.15.164:0/588477155 conn(0x7f5624077130 msgr2=0x7f562410c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 shutdown_connections 2024-03-27T08:32:41.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:41.992+0000 7f562bc00640 1 -- 172.21.15.164:0/588477155 wait complete. 2024-03-27T08:32:42.006 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 -- 172.21.15.164:0/2493497281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988100860 msgr2=0x7fb988100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 --2- 172.21.15.164:0/2493497281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988100860 0x7fb988100c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fb978009900 tx=0x7fb97802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 -- 172.21.15.164:0/2493497281 shutdown_connections 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 --2- 172.21.15.164:0/2493497281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 0x7fb988108ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 --2- 172.21.15.164:0/2493497281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988101a50 0x7fb988101ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 --2- 172.21.15.164:0/2493497281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988100860 0x7fb988100c80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.211+0000 7fb987e00640 1 -- 172.21.15.164:0/2493497281 >> 172.21.15.164:0/2493497281 conn(0x7fb9880fbdd0 msgr2=0x7fb9880fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.212+0000 7fb987e00640 1 -- 172.21.15.164:0/2493497281 shutdown_connections 2024-03-27T08:32:42.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.212+0000 7fb987e00640 1 -- 172.21.15.164:0/2493497281 wait complete. 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 Processor -- start 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 -- start start 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 0x7fb988197c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 0x7fb98819f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810c510 con 0x7fb988101a50 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810c390 con 0x7fb988100860 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb987e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb98810c690 con 0x7fb988102410 2024-03-27T08:32:42.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb986000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb986a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 0x7fb988197c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb986000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60698/0 (socket says 172.21.15.164:60698) 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.213+0000 7fb986000640 1 -- 172.21.15.164:0/1214301191 learned_addr learned my addr 172.21.15.164:0/1214301191 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb987400640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 0x7fb98819f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 -- 172.21.15.164:0/1214301191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 msgr2=0x7fb98819f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 0x7fb98819f1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 -- 172.21.15.164:0/1214301191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 msgr2=0x7fb988197c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 0x7fb988197c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 -- 172.21.15.164:0/1214301191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb98819f890 con 0x7fb988101a50 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986a00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 0x7fb988197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb986000640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb97400d950 tx=0x7fb97400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb974017070 con 0x7fb988101a50 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb974009c30 con 0x7fb988101a50 2024-03-27T08:32:42.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.214+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb98819fb80 con 0x7fb988101a50 2024-03-27T08:32:42.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.215+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb97400f6b0 con 0x7fb988101a50 2024-03-27T08:32:42.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.215+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9881a00f0 con 0x7fb988101a50 2024-03-27T08:32:42.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.216+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9881a02c0 con 0x7fb988101a50 2024-03-27T08:32:42.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.219+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fb974010a50 con 0x7fb988101a50 2024-03-27T08:32:42.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.220+0000 7fb97f400640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 0x7fb96c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.220+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7fb9740cf560 con 0x7fb988101a50 2024-03-27T08:32:42.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.221+0000 7fb986a00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 0x7fb96c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.221+0000 7fb986a00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 0x7fb96c0a5b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb97802c170 tx=0x7fb97802c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:42.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.222+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb974009de0 con 0x7fb988101a50 2024-03-27T08:32:42.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.426+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9881a0650 con 0x7fb988101a50 2024-03-27T08:32:42.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.428+0000 7fb97f400640 1 -- 172.21.15.164:0/1214301191 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+18526 (secure 0 0 0) 0x7fb97409c5b0 con 0x7fb988101a50 2024-03-27T08:32:42.422 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:42.423 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":84,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:31:41.940501+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":78,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:32:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 msgr2=0x7fb96c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 0x7fb96c0a5b50 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb97802c170 tx=0x7fb97802c820 comp rx=0 tx=0).stop 2024-03-27T08:32:42.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 msgr2=0x7fb9881981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb97400d950 tx=0x7fb97400de10 comp rx=0 tx=0).stop 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 shutdown_connections 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb96c0a3690 0x7fb96c0a5b50 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb988102410 0x7fb98819f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb988101a50 0x7fb9881981c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 --2- 172.21.15.164:0/1214301191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb988100860 0x7fb988197c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 >> 172.21.15.164:0/1214301191 conn(0x7fb9880fbdd0 msgr2=0x7fb988068cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.430+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 shutdown_connections 2024-03-27T08:32:42.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.431+0000 7fb987e00640 1 -- 172.21.15.164:0/1214301191 wait complete. 2024-03-27T08:32:42.442 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:32:42.442 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.651+0000 7f384a200640 1 -- 172.21.15.164:0/1655967323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 msgr2=0x7f384410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.651+0000 7f384a200640 1 --2- 172.21.15.164:0/1655967323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f384410c1d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f383c009ca0 tx=0x7f383c02c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 -- 172.21.15.164:0/1655967323 shutdown_connections 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 --2- 172.21.15.164:0/1655967323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f384410c1d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 --2- 172.21.15.164:0/1655967323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 0x7f3844105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 --2- 172.21.15.164:0/1655967323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f38441041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 -- 172.21.15.164:0/1655967323 >> 172.21.15.164:0/1655967323 conn(0x7f38440ff300 msgr2=0x7f3844101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 -- 172.21.15.164:0/1655967323 shutdown_connections 2024-03-27T08:32:42.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.652+0000 7f384a200640 1 -- 172.21.15.164:0/1655967323 wait complete. 2024-03-27T08:32:42.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 Processor -- start 2024-03-27T08:32:42.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 -- start start 2024-03-27T08:32:42.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 0x7f384419a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f384410f9f0 con 0x7f3844105940 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f384410f870 con 0x7f3844103d90 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f384a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f384410fb70 con 0x7f3844104f80 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3843400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3843e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3843400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36112/0 (socket says 172.21.15.164:36112) 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3843400640 1 -- 172.21.15.164:0/801109535 learned_addr learned my addr 172.21.15.164:0/801109535 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3843e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60712/0 (socket says 172.21.15.164:60712) 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.653+0000 7f3842a00640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 0x7f384419a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 -- 172.21.15.164:0/801109535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 msgr2=0x7f384419a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 0x7f384419a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 -- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 msgr2=0x7f38441a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 -- 172.21.15.164:0/801109535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38441a1c30 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843e00640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f3843400640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f383400e9c0 tx=0x7f383400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.654+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383400cd80 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.655+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38441a1f20 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.655+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f38340035f0 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.655+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3834010690 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.655+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38441a2380 con 0x7f3844103d90 2024-03-27T08:32:42.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.656+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f384410b050 con 0x7f3844103d90 2024-03-27T08:32:42.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.658+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f38340037a0 con 0x7f3844103d90 2024-03-27T08:32:42.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.659+0000 7f383be00640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 0x7f38280a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:42.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.659+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f38340cfce0 con 0x7f3844103d90 2024-03-27T08:32:42.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.660+0000 7f3842a00640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 0x7f38280a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:42.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.660+0000 7f3842a00640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 0x7f38280a5ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f384419b520 tx=0x7f3830005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:42.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.664+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f383409ccb0 con 0x7f3844103d90 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:boot 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: fsmap 12 up:standby 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/588477155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:42 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1214301191' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:boot 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: fsmap 12 up:standby 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/588477155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:42 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1214301191' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:boot 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: fsmap 12 up:standby 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/588477155' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:42 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1214301191' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:42.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.872+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3844062850 con 0x7f3844103d90 2024-03-27T08:32:42.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.873+0000 7f383be00640 1 -- 172.21.15.164:0/801109535 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f383409c5b0 con 0x7f3844103d90 2024-03-27T08:32:42.866 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:32:42.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 msgr2=0x7f38280a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 0x7f38280a5ad0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f384419b520 tx=0x7f3830005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 msgr2=0x7f384419a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f383400e9c0 tx=0x7f383400ee80 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 shutdown_connections 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f38280a3610 0x7f38280a5ad0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3844105940 0x7f38441a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3844104f80 0x7f384419a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 --2- 172.21.15.164:0/801109535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3844103d90 0x7f384419a010 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 >> 172.21.15.164:0/801109535 conn(0x7f38440ff300 msgr2=0x7f3844108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.875+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 shutdown_connections 2024-03-27T08:32:42.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:42.876+0000 7f384a200640 1 -- 172.21.15.164:0/801109535 wait complete. 2024-03-27T08:32:42.885 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-27T08:32:43.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 -- 172.21.15.164:0/222460137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 msgr2=0x7f883010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 --2- 172.21.15.164:0/222460137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f883010c1d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8828009ca0 tx=0x7f882802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 -- 172.21.15.164:0/222460137 shutdown_connections 2024-03-27T08:32:43.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 --2- 172.21.15.164:0/222460137 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f883010c1d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 --2- 172.21.15.164:0/222460137 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830104f80 0x7f8830105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 --2- 172.21.15.164:0/222460137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830103d90 0x7f88301041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 -- 172.21.15.164:0/222460137 >> 172.21.15.164:0/222460137 conn(0x7f88300ff300 msgr2=0x7f8830101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:43.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 -- 172.21.15.164:0/222460137 shutdown_connections 2024-03-27T08:32:43.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.075+0000 7f8835c00640 1 -- 172.21.15.164:0/222460137 wait complete. 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.076+0000 7f8835c00640 1 Processor -- start 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.076+0000 7f8835c00640 1 -- start start 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830103d90 0x7f883019a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 0x7f883019a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f883010f9f0 con 0x7f8830105940 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f883010f870 con 0x7f8830104f80 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f8835c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f883010fb70 con 0x7f8830103d90 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60726/0 (socket says 172.21.15.164:60726) 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 -- 172.21.15.164:0/3683814112 learned_addr learned my addr 172.21.15.164:0/3683814112 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882ea00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830103d90 0x7f883019a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882e000640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 0x7f883019a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 -- 172.21.15.164:0/3683814112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830103d90 msgr2=0x7f883019a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830103d90 0x7f883019a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 -- 172.21.15.164:0/3683814112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 msgr2=0x7f883019a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 0x7f883019a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882f400640 1 -- 172.21.15.164:0/3683814112 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88301a1c60 con 0x7f8830105940 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.077+0000 7f882e000640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 0x7f883019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:43.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f882f400640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f882802c630 tx=0x7f8828032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828039050 con 0x7f8830105940 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f882803a040 con 0x7f8830105940 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88301a1ef0 con 0x7f8830105940 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8828040450 con 0x7f8830105940 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.078+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88301a2350 con 0x7f8830105940 2024-03-27T08:32:43.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.079+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f883010b0b0 con 0x7f8830105940 2024-03-27T08:32:43.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.081+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f8828003b70 con 0x7f8830105940 2024-03-27T08:32:43.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.083+0000 7f8827400640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 0x7f88140a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.084+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f88280f2480 con 0x7f8830105940 2024-03-27T08:32:43.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.084+0000 7f882ea00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 0x7f88140a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.084+0000 7f882ea00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 0x7f88140a5ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8830104de0 tx=0x7f8820005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:43.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.088+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f88280bf450 con 0x7f8830105940 2024-03-27T08:32:43.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.280+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f8830062750 con 0x7f8830105940 2024-03-27T08:32:43.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.280+0000 7f8827400640 1 -- 172.21.15.164:0/3683814112 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v84) ==== 84+0+65 (secure 0 0 0) 0x7f88280bed50 con 0x7f8830105940 2024-03-27T08:32:43.273 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:43.273 INFO:teuthology.orchestra.run.smithi164.stdout:[ 2024-03-27T08:32:43.274 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:32:43.274 INFO:teuthology.orchestra.run.smithi164.stdout: "poolnum": 1, 2024-03-27T08:32:43.274 INFO:teuthology.orchestra.run.smithi164.stdout: "poolname": ".mgr" 2024-03-27T08:32:43.274 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:32:43.274 INFO:teuthology.orchestra.run.smithi164.stdout:] 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 msgr2=0x7f88140a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 0x7f88140a5ad0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8830104de0 tx=0x7f8820005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 msgr2=0x7f88301a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f882802c630 tx=0x7f8828032900 comp rx=0 tx=0).stop 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 shutdown_connections 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f88140a3610 0x7f88140a5ad0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8830105940 0x7f88301a15f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8830104f80 0x7f883019a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 --2- 172.21.15.164:0/3683814112 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8830103d90 0x7f883019a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 >> 172.21.15.164:0/3683814112 conn(0x7f88300ff300 msgr2=0x7f8830108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:43.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 shutdown_connections 2024-03-27T08:32:43.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.283+0000 7f8835c00640 1 -- 172.21.15.164:0/3683814112 wait complete. 2024-03-27T08:32:43.296 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-27T08:32:43.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-27T08:32:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 -- 172.21.15.164:0/3551175233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109260 msgr2=0x7f7de41096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 --2- 172.21.15.164:0/3551175233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109260 0x7f7de41096e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7dcc009900 tx=0x7f7dcc02bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:43.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 -- 172.21.15.164:0/3551175233 shutdown_connections 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 --2- 172.21.15.164:0/3551175233 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109c20 0x7f7de41104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 --2- 172.21.15.164:0/3551175233 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109260 0x7f7de41096e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 --2- 172.21.15.164:0/3551175233 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 0x7f7de4108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 -- 172.21.15.164:0/3551175233 >> 172.21.15.164:0/3551175233 conn(0x7f7de4077020 msgr2=0x7f7de4079440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 -- 172.21.15.164:0/3551175233 shutdown_connections 2024-03-27T08:32:43.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.504+0000 7f7de9200640 1 -- 172.21.15.164:0/3551175233 wait complete. 2024-03-27T08:32:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 Processor -- start 2024-03-27T08:32:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 -- start start 2024-03-27T08:32:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 0x7f7de419e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109260 0x7f7de419e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4113d20 con 0x7f7de4109c20 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4113ba0 con 0x7f7de4108070 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.505+0000 7f7de9200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7de4113ea0 con 0x7f7de4109260 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60740/0 (socket says 172.21.15.164:60740) 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 -- 172.21.15.164:0/3892850849 learned_addr learned my addr 172.21.15.164:0/3892850849 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3400640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 0x7f7de419e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7ddaa00640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109260 0x7f7de419e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 -- 172.21.15.164:0/3892850849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109260 msgr2=0x7f7de419e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109260 0x7f7de419e820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 -- 172.21.15.164:0/3892850849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 msgr2=0x7f7de419e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 0x7f7de419e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:43.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 -- 172.21.15.164:0/3892850849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7de41a5f00 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.506+0000 7f7de3e00640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c970 tx=0x7f7ddc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.507+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc007bb0 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.507+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7ddc007d50 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.507+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7de41a61f0 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.507+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ddc018790 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.507+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7de41a66c0 con 0x7f7de4109c20 2024-03-27T08:32:43.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.508+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de410f390 con 0x7f7de4109c20 2024-03-27T08:32:43.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.510+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f7ddc00fab0 con 0x7f7de4109c20 2024-03-27T08:32:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.511+0000 7f7de0c00640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 0x7f7dc80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.511+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 7127+0+0 (secure 0 0 0) 0x7f7ddc0cfab0 con 0x7f7de4109c20 2024-03-27T08:32:43.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.511+0000 7f7de3400640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 0x7f7dc80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:43.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.512+0000 7f7de3400640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 0x7f7dc80a5ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a300 tx=0x7f7dd400a290 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:43.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.515+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7ddc014030 con 0x7f7de4109c20 2024-03-27T08:32:43.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:43.719+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7de4062750 con 0x7f7de4109c20 2024-03-27T08:32:43.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/801109535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:32:43.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:43 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3683814112' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T08:32:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/801109535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:32:43.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:43 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3683814112' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T08:32:44.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/801109535' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:32:44.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:43 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3683814112' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-03-27T08:32:44.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.535+0000 7f7de0c00640 1 -- 172.21.15.164:0/3892850849 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v85) ==== 138+0+0 (secure 0 0 0) 0x7f7ddc09ca80 con 0x7f7de4109c20 2024-03-27T08:32:44.528 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_metadata' created 2024-03-27T08:32:44.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 msgr2=0x7f7dc80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:44.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 0x7f7dc80a5ad0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f7dd400a300 tx=0x7f7dd400a290 comp rx=0 tx=0).stop 2024-03-27T08:32:44.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 msgr2=0x7f7de41a5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:44.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7ddc00c970 tx=0x7f7ddc00ce30 comp rx=0 tx=0).stop 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 shutdown_connections 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7dc80a3610 0x7f7dc80a5ad0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7de4109c20 0x7f7de41a5890 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7de4109260 0x7f7de419e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 --2- 172.21.15.164:0/3892850849 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7de4108070 0x7f7de419e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.538+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 >> 172.21.15.164:0/3892850849 conn(0x7f7de4077020 msgr2=0x7f7de410c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.539+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 shutdown_connections 2024-03-27T08:32:44.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.539+0000 7f7de9200640 1 -- 172.21.15.164:0/3892850849 wait complete. 2024-03-27T08:32:44.562 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-27T08:32:44.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 -- 172.21.15.164:0/2049663968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc074550 msgr2=0x7fe0fc0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 --2- 172.21.15.164:0/2049663968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc074550 0x7fe0fc0749b0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fe0e8009900 tx=0x7fe0e802bcd0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 -- 172.21.15.164:0/2049663968 shutdown_connections 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 --2- 172.21.15.164:0/2049663968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc10bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 --2- 172.21.15.164:0/2049663968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc074550 0x7fe0fc0749b0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 --2- 172.21.15.164:0/2049663968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc075b30 0x7fe0fc073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.766+0000 7fe0fb200640 1 -- 172.21.15.164:0/2049663968 >> 172.21.15.164:0/2049663968 conn(0x7fe0fc0fcfc0 msgr2=0x7fe0fc0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.767+0000 7fe0fb200640 1 -- 172.21.15.164:0/2049663968 shutdown_connections 2024-03-27T08:32:44.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.767+0000 7fe0fb200640 1 -- 172.21.15.164:0/2049663968 wait complete. 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.768+0000 7fe0fb200640 1 Processor -- start 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.768+0000 7fe0fb200640 1 -- start start 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.768+0000 7fe0fb200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc074550 0x7fe0fc199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fb200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc075b30 0x7fe0fc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fb200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc10f900 con 0x7fe0fc1098e0 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fb200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc10f780 con 0x7fe0fc075b30 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fb200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe0fc10fa80 con 0x7fe0fc074550 2024-03-27T08:32:44.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:44.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60754/0 (socket says 172.21.15.164:60754) 2024-03-27T08:32:44.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 -- 172.21.15.164:0/3003381182 learned_addr learned my addr 172.21.15.164:0/3003381182 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:44.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0f9e00640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc074550 0x7fe0fc199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:44.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0f9400640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc075b30 0x7fe0fc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 -- 172.21.15.164:0/3003381182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc074550 msgr2=0x7fe0fc199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc074550 0x7fe0fc199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 -- 172.21.15.164:0/3003381182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc075b30 msgr2=0x7fe0fc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc075b30 0x7fe0fc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.769+0000 7fe0fa800640 1 -- 172.21.15.164:0/3003381182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0fc1a1b90 con 0x7fe0fc1098e0 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0fa800640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400eaa0 tx=0x7fe0f400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:44.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f400cdb0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0fc1a1e80 con 0x7fe0fc1098e0 2024-03-27T08:32:44.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0f4005020 con 0x7fe0fc1098e0 2024-03-27T08:32:44.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0f40116b0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.770+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0fc1a22f0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.771+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0fc1086a0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.773+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fe0f40051d0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.775+0000 7fe0f2a00640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 0x7fe0e00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:44.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.775+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 7497+0+0 (secure 0 0 0) 0x7fe0f40cfff0 con 0x7fe0fc1098e0 2024-03-27T08:32:44.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.775+0000 7fe0f9e00640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 0x7fe0e00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:44.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.776+0000 7fe0f9e00640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 0x7fe0e00a5ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009bd0 tx=0x7fe0ec005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:44.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:44.780+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe0f4016030 con 0x7fe0fc1098e0 2024-03-27T08:32:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:44 smithi167 ceph-mon[34903]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:44 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T08:32:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:44 smithi173 ceph-mon[35397]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:44 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T08:32:44.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.004+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe0fc02d370 con 0x7fe0fc1098e0 2024-03-27T08:32:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:44 smithi164 ceph-mon[31788]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:44 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-03-27T08:32:45.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.544+0000 7fe0f2a00640 1 -- 172.21.15.164:0/3003381182 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v86) ==== 170+0+0 (secure 0 0 0) 0x7fe0f409cef0 con 0x7fe0fc1098e0 2024-03-27T08:32:45.538 INFO:teuthology.orchestra.run.smithi164.stderr:pool 'cephfs_data' created 2024-03-27T08:32:45.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.548+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 msgr2=0x7fe0e00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:45.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.548+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 0x7fe0e00a5ad0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec009bd0 tx=0x7fe0ec005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:45.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.548+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 msgr2=0x7fe0fc1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:45.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.548+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fe0f400eaa0 tx=0x7fe0f400ef60 comp rx=0 tx=0).stop 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 shutdown_connections 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0e00a3610 0x7fe0e00a5ad0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe0fc1098e0 0x7fe0fc1a1520 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0fc075b30 0x7fe0fc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 --2- 172.21.15.164:0/3003381182 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe0fc074550 0x7fe0fc199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 >> 172.21.15.164:0/3003381182 conn(0x7fe0fc0fcfc0 msgr2=0x7fe0fc105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 shutdown_connections 2024-03-27T08:32:45.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.549+0000 7fe0fb200640 1 -- 172.21.15.164:0/3003381182 wait complete. 2024-03-27T08:32:45.577 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-27T08:32:45.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.779+0000 7f32c4200640 1 -- 172.21.15.164:0/1255628349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc108190 msgr2=0x7f32bc1085b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:45.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.779+0000 7f32c4200640 1 --2- 172.21.15.164:0/1255628349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc108190 0x7f32bc1085b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f32b0009900 tx=0x7f32b002bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:45.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 -- 172.21.15.164:0/1255628349 shutdown_connections 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 --2- 172.21.15.164:0/1255628349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc109d40 0x7f32bc1105d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 --2- 172.21.15.164:0/1255628349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109380 0x7f32bc109800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 --2- 172.21.15.164:0/1255628349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc108190 0x7f32bc1085b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 -- 172.21.15.164:0/1255628349 >> 172.21.15.164:0/1255628349 conn(0x7f32bc077140 msgr2=0x7f32bc079560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 -- 172.21.15.164:0/1255628349 shutdown_connections 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.780+0000 7f32c4200640 1 -- 172.21.15.164:0/1255628349 wait complete. 2024-03-27T08:32:45.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.781+0000 7f32c4200640 1 Processor -- start 2024-03-27T08:32:45.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.781+0000 7f32c4200640 1 -- start start 2024-03-27T08:32:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc108190 0x7f32bc19e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109d40 0x7f32bc1a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc113e40 con 0x7f32bc109380 2024-03-27T08:32:45.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc113cc0 con 0x7f32bc109d40 2024-03-27T08:32:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c4200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f32bc113fc0 con 0x7f32bc108190 2024-03-27T08:32:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45298/0 (socket says 172.21.15.164:45298) 2024-03-27T08:32:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 -- 172.21.15.164:0/4110552937 learned_addr learned my addr 172.21.15.164:0/4110552937 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:45.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c1800640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc108190 0x7f32bc19e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:45.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c2200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109d40 0x7f32bc1a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:45.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 -- 172.21.15.164:0/4110552937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc108190 msgr2=0x7f32bc19e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:45.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc108190 0x7f32bc19e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 -- 172.21.15.164:0/4110552937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109d40 msgr2=0x7f32bc1a5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109d40 0x7f32bc1a5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.782+0000 7f32c0e00640 1 -- 172.21.15.164:0/4110552937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32bc1a6080 con 0x7f32bc109380 2024-03-27T08:32:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32c0e00640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32a800d950 tx=0x7f32a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:45.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8017070 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32bc1a6370 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f32a8009c30 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a8020060 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.783+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32bc1a68c0 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.784+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32bc10f4b0 con 0x7f32bc109380 2024-03-27T08:32:45.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.787+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f32a8010a50 con 0x7f32bc109380 2024-03-27T08:32:45.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.788+0000 7f32ba000640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 0x7f32a40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:45.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.789+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 7879+0+0 (secure 0 0 0) 0x7f32a80cfe40 con 0x7f32bc109380 2024-03-27T08:32:45.787 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.789+0000 7f32c1800640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 0x7f32a40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:45.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.789+0000 7f32c1800640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 0x7f32a40a5ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f32b002c170 tx=0x7f32b002c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:45.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:45.791+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f32a8009de0 con 0x7f32bc109380 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:45 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T08:32:45.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:45.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:45 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T08:32:46.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3892850849' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-03-27T08:32:46.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: osdmap e85: 12 total, 12 up, 12 in 2024-03-27T08:32:46.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:45 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-03-27T08:32:46.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.028+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f32bc0627f0 con 0x7f32bc109380 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: pgmap v359: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T08:32:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:46 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: pgmap v359: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T08:32:46.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:46 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:46.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.949+0000 7f32ba000640 1 -- 172.21.15.164:0/4110552937 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f32a809cb20 con 0x7f32bc109380 2024-03-27T08:32:46.943 INFO:teuthology.orchestra.run.smithi164.stderr:new fs with metadata pool 2 and data pool 3 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.953+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 msgr2=0x7f32a40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.953+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 0x7f32a40a5ad0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f32b002c170 tx=0x7f32b002c820 comp rx=0 tx=0).stop 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.953+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 msgr2=0x7f32bc19e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.953+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f32a800d950 tx=0x7f32a800de10 comp rx=0 tx=0).stop 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 shutdown_connections 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f32a40a3610 0x7f32a40a5ad0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f32bc109d40 0x7f32bc1a5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32bc109380 0x7f32bc19e9a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:46.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 --2- 172.21.15.164:0/4110552937 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32bc108190 0x7f32bc19e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 >> 172.21.15.164:0/4110552937 conn(0x7f32bc077140 msgr2=0x7f32bc10c680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 shutdown_connections 2024-03-27T08:32:46.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:46.954+0000 7f32c4200640 1 -- 172.21.15.164:0/4110552937 wait complete. 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: pgmap v359: 33 pgs: 1 creating+peering, 1 active+clean, 31 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3003381182' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: osdmap e86: 12 total, 12 up, 12 in 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-03-27T08:32:46.971 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:46 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:32:46.972 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.176+0000 7fd4b6600640 1 -- 172.21.15.164:0/3031118077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0107850 msgr2=0x7fd4b0109ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 --2- 172.21.15.164:0/3031118077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0107850 0x7fd4b0109ca0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009ca0 tx=0x7fd4a802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 -- 172.21.15.164:0/3031118077 shutdown_connections 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 --2- 172.21.15.164:0/3031118077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0107850 0x7fd4b0109ca0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 --2- 172.21.15.164:0/3031118077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0104f20 0x7fd4b0107310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 --2- 172.21.15.164:0/3031118077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b01049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 -- 172.21.15.164:0/3031118077 >> 172.21.15.164:0/3031118077 conn(0x7fd4b00fbfe0 msgr2=0x7fd4b00fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:47.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 -- 172.21.15.164:0/3031118077 shutdown_connections 2024-03-27T08:32:47.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.177+0000 7fd4b6600640 1 -- 172.21.15.164:0/3031118077 wait complete. 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.178+0000 7fd4b6600640 1 Processor -- start 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.178+0000 7fd4b6600640 1 -- start start 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.178+0000 7fd4b6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b0101f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.178+0000 7fd4b6600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.178+0000 7fd4b6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0107850 0x7fd4b0100a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4b6600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b010d7f0 con 0x7fd4b0104f20 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4b6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b010d670 con 0x7fd4b01025f0 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4b6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd4b010d970 con 0x7fd4b0107850 2024-03-27T08:32:47.173 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4aea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b0101f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4aea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45316/0 (socket says 172.21.15.164:45316) 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4aea00640 1 -- 172.21.15.164:0/4114489696 learned_addr learned my addr 172.21.15.164:0/4114489696 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4afe00640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0107850 0x7fd4b0100a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 -- 172.21.15.164:0/4114489696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0107850 msgr2=0x7fd4b0100a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0107850 0x7fd4b0100a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 -- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 msgr2=0x7fd4b0100550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4af400640 1 -- 172.21.15.164:0/4114489696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4b0101350 con 0x7fd4b01025f0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.179+0000 7fd4aea00640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4af400640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b0101f10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000e9f0 tx=0x7fd4a000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a000ccc0 con 0x7fd4b01025f0 2024-03-27T08:32:47.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4b00721e0 con 0x7fd4b01025f0 2024-03-27T08:32:47.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd4a0010900 con 0x7fd4b01025f0 2024-03-27T08:32:47.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a0018960 con 0x7fd4b01025f0 2024-03-27T08:32:47.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.180+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4b0072780 con 0x7fd4b01025f0 2024-03-27T08:32:47.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.181+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4b0073b60 con 0x7fd4b01025f0 2024-03-27T08:32:47.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.183+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fd4a0010ab0 con 0x7fd4b01025f0 2024-03-27T08:32:47.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.184+0000 7fd4a7e00640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 0x7fd4940a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.185+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 7979+0+0 (secure 0 0 0) 0x7fd4a00d0080 con 0x7fd4b01025f0 2024-03-27T08:32:47.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.185+0000 7fd4aea00640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 0x7fd4940a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.185+0000 7fd4aea00640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 0x7fd4940a5ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0101c80 tx=0x7fd49c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:47.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.188+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd4a009c730 con 0x7fd4b01025f0 2024-03-27T08:32:47.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.397+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd4b0062750 con 0x7fd4b01025f0 2024-03-27T08:32:47.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.400+0000 7fd4a7e00640 1 -- 172.21.15.164:0/4114489696 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+22302 (secure 0 0 0) 0x7fd4a00a0a30 con 0x7fd4b01025f0 2024-03-27T08:32:47.394 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:47.394 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":87,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:32:46.030385+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 msgr2=0x7fd4940a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 0x7fd4940a5ad0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd4b0101c80 tx=0x7fd49c005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 msgr2=0x7fd4b0101f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b0101f10 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd4a000e9f0 tx=0x7fd4a000eeb0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 shutdown_connections 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd4940a3610 0x7fd4940a5ad0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd4b0107850 0x7fd4b0100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd4b0104f20 0x7fd4b0100550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 --2- 172.21.15.164:0/4114489696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd4b01025f0 0x7fd4b0101f10 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 >> 172.21.15.164:0/4114489696 conn(0x7fd4b00fbfe0 msgr2=0x7fd4b0102f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:47.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 shutdown_connections 2024-03-27T08:32:47.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.403+0000 7fd4b6600640 1 -- 172.21.15.164:0/4114489696 wait complete. 2024-03-27T08:32:47.413 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.623+0000 7f518d200640 1 -- 172.21.15.164:0/3775590062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188102690 msgr2=0x7f5188104a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.623+0000 7f518d200640 1 --2- 172.21.15.164:0/3775590062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188102690 0x7f5188104a80 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5178009900 tx=0x7f517802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 -- 172.21.15.164:0/3775590062 shutdown_connections 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 --2- 172.21.15.164:0/3775590062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f5188109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 --2- 172.21.15.164:0/3775590062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188104fc0 0x7f51881073b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 --2- 172.21.15.164:0/3775590062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188102690 0x7f5188104a80 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 -- 172.21.15.164:0/3775590062 >> 172.21.15.164:0/3775590062 conn(0x7f51880fbfe0 msgr2=0x7f51880fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 -- 172.21.15.164:0/3775590062 shutdown_connections 2024-03-27T08:32:47.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.624+0000 7f518d200640 1 -- 172.21.15.164:0/3775590062 wait complete. 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 Processor -- start 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 -- start start 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188102690 0x7f5188197ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f518819f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f518810d920 con 0x7f5188104fc0 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f518810d7a0 con 0x7f51881078f0 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f518d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f518810daa0 con 0x7f5188102690 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f5185400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f5185400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45328/0 (socket says 172.21.15.164:45328) 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.625+0000 7f5185400640 1 -- 172.21.15.164:0/1721233394 learned_addr learned my addr 172.21.15.164:0/1721233394 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185e00640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188102690 0x7f5188197ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5186800640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f518819f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 -- 172.21.15.164:0/1721233394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188102690 msgr2=0x7f5188197ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188102690 0x7f5188197ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 -- 172.21.15.164:0/1721233394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 msgr2=0x7f518819f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f518819f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 -- 172.21.15.164:0/1721233394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f518819fc10 con 0x7f5188104fc0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5186800640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f518819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.626+0000 7f5185400640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f517000b450 tx=0x7f517000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.627+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5170015020 con 0x7f5188104fc0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.627+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5170011d60 con 0x7f5188104fc0 2024-03-27T08:32:47.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.627+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f517000f340 con 0x7f5188104fc0 2024-03-27T08:32:47.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.627+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f518819ff00 con 0x7f5188104fc0 2024-03-27T08:32:47.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.627+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51881a03f0 con 0x7f5188104fc0 2024-03-27T08:32:47.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.628+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51880fdad0 con 0x7f5188104fc0 2024-03-27T08:32:47.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.630+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f5170018020 con 0x7f5188104fc0 2024-03-27T08:32:47.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.631+0000 7f517ea00640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 0x7f516c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:47.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.631+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f51700cf770 con 0x7f5188104fc0 2024-03-27T08:32:47.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.632+0000 7f5185e00640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 0x7f516c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:47.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.632+0000 7f5185e00640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 0x7f516c0a5b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5178005790 tx=0x7f5178005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:47.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.641+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f517001f020 con 0x7f5188104fc0 2024-03-27T08:32:47.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:47 smithi164 ceph-mon[31788]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T08:32:47.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:47 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T08:32:47.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:47 smithi164 ceph-mon[31788]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T08:32:47.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:47 smithi164 ceph-mon[31788]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T08:32:47.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:47 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4114489696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:47.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.841+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5188062850 con 0x7f5188104fc0 2024-03-27T08:32:47.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.844+0000 7f517ea00640 1 -- 172.21.15.164:0/1721233394 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22289 (secure 0 0 0) 0x7f517000d040 con 0x7f5188104fc0 2024-03-27T08:32:47.837 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:47.838 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":88,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:32:47.569637+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 msgr2=0x7f516c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 0x7f516c0a5b50 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5178005790 tx=0x7f5178005fd0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 msgr2=0x7f5188198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f517000b450 tx=0x7f517000b910 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 shutdown_connections 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f516c0a3690 0x7f516c0a5b50 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51881078f0 0x7f518819f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5188104fc0 0x7f5188198530 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 --2- 172.21.15.164:0/1721233394 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5188102690 0x7f5188197ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:47.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 >> 172.21.15.164:0/1721233394 conn(0x7f51880fbfe0 msgr2=0x7f5188103150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:47.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 shutdown_connections 2024-03-27T08:32:47.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:47.847+0000 7f518d200640 1 -- 172.21.15.164:0/1721233394 wait complete. 2024-03-27T08:32:47.856 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-27T08:32:48.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 -- 172.21.15.164:0/1916945312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e0074550 msgr2=0x7fc1e00749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1916945312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e0074550 0x7fc1e00749b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc1c8009900 tx=0x7fc1c802bcd0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 -- 172.21.15.164:0/1916945312 shutdown_connections 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1916945312 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e01098c0 0x7fc1e010bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1916945312 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e0074550 0x7fc1e00749b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1916945312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 0x7fc1e0073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 -- 172.21.15.164:0/1916945312 >> 172.21.15.164:0/1916945312 conn(0x7fc1e00fcfc0 msgr2=0x7fc1e00ff3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 -- 172.21.15.164:0/1916945312 shutdown_connections 2024-03-27T08:32:48.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.071+0000 7fc1e5000640 1 -- 172.21.15.164:0/1916945312 wait complete. 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 Processor -- start 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 -- start start 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e0074550 0x7fc1e0199f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 0x7fc1e019a450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010f8e0 con 0x7fc1e01098c0 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010f760 con 0x7fc1e0075b30 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.073+0000 7fc1e5000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc1e010fa60 con 0x7fc1e0074550 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45354/0 (socket says 172.21.15.164:45354) 2024-03-27T08:32:48.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 -- 172.21.15.164:0/1749729402 learned_addr learned my addr 172.21.15.164:0/1749729402 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1df400640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e0074550 0x7fc1e0199f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1d7e00640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 0x7fc1e019a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 -- 172.21.15.164:0/1749729402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e0074550 msgr2=0x7fc1e0199f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e0074550 0x7fc1e0199f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 -- 172.21.15.164:0/1749729402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 msgr2=0x7fc1e019a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 0x7fc1e019a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 -- 172.21.15.164:0/1749729402 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1e01a1b30 con 0x7fc1e01098c0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.074+0000 7fc1dfe00640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800eaa0 tx=0x7fc1d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.075+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d800cdb0 con 0x7fc1e01098c0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.075+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc1d8005020 con 0x7fc1e01098c0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.075+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1e01a1e20 con 0x7fc1e01098c0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.075+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1d80116b0 con 0x7fc1e01098c0 2024-03-27T08:32:48.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.075+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1e01a22e0 con 0x7fc1e01098c0 2024-03-27T08:32:48.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:47 smithi167 ceph-mon[34903]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T08:32:48.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:47 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T08:32:48.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:47 smithi167 ceph-mon[34903]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T08:32:48.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:47 smithi167 ceph-mon[34903]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T08:32:48.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:47 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4114489696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:48.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.076+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1e0108680 con 0x7fc1e01098c0 2024-03-27T08:32:48.071 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.078+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fc1d80051d0 con 0x7fc1e01098c0 2024-03-27T08:32:48.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.079+0000 7fc1dcc00640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 0x7fc1c40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:48.072 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.080+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fc1d80cfd90 con 0x7fc1e01098c0 2024-03-27T08:32:48.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.080+0000 7fc1df400640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 0x7fc1c40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:48.073 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.080+0000 7fc1df400640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 0x7fc1c40a5ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009bd0 tx=0x7fc1d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:48.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:47 smithi173 ceph-mon[35397]: osdmap e87: 12 total, 12 up, 12 in 2024-03-27T08:32:48.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:47 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4110552937' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-03-27T08:32:48.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:47 smithi173 ceph-mon[35397]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-03-27T08:32:48.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:47 smithi173 ceph-mon[35397]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-03-27T08:32:48.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:47 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4114489696' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:48.076 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.084+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc1d8016030 con 0x7fc1e01098c0 2024-03-27T08:32:48.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.345+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc1e002d570 con 0x7fc1e01098c0 2024-03-27T08:32:48.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.974+0000 7fc1dcc00640 1 -- 172.21.15.164:0/1749729402 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v17) ==== 118+0+0 (secure 0 0 0) 0x7fc1d809c460 con 0x7fc1e01098c0 2024-03-27T08:32:48.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.976+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 msgr2=0x7fc1c40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.976+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 0x7fc1c40a5ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0009bd0 tx=0x7fc1d0005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 msgr2=0x7fc1e01a14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc1d800eaa0 tx=0x7fc1d800ef60 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 shutdown_connections 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc1c40a3610 0x7fc1c40a5ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc1e01098c0 0x7fc1e01a14c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc1e0075b30 0x7fc1e019a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 --2- 172.21.15.164:0/1749729402 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc1e0074550 0x7fc1e0199f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 >> 172.21.15.164:0/1749729402 conn(0x7fc1e00fcfc0 msgr2=0x7fc1e0105850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 shutdown_connections 2024-03-27T08:32:48.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:48.977+0000 7fc1e5000640 1 -- 172.21.15.164:0/1749729402 wait complete. 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: pgmap v362: 97 pgs: 14 active+clean, 10 creating+peering, 73 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1721233394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: Cluster is now healthy 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:active 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:48.987 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:48 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T08:32:48.989 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'}} 2024-03-27T08:32:48.989 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-03-27T08:32:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: pgmap v362: 97 pgs: 14 active+clean, 10 creating+peering, 73 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1721233394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: Cluster is now healthy 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:active 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:49.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:48 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T08:32:49.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: pgmap v362: 97 pgs: 14 active+clean, 10 creating+peering, 73 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: osdmap e88: 12 total, 12 up, 12 in 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1721233394' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: Cluster is now healthy 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] up:active 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:48 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.210+0000 7f0710a00640 1 -- 172.21.15.164:0/3887227338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 msgr2=0x7f070c1030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.210+0000 7f0710a00640 1 --2- 172.21.15.164:0/3887227338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c1030c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f06f8009900 tx=0x7f06f802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 -- 172.21.15.164:0/3887227338 shutdown_connections 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 --2- 172.21.15.164:0/3887227338 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 --2- 172.21.15.164:0/3887227338 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c1030c0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 --2- 172.21.15.164:0/3887227338 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 0x7f070c101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:49.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 -- 172.21.15.164:0/3887227338 >> 172.21.15.164:0/3887227338 conn(0x7f070c0fcfc0 msgr2=0x7f070c0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:49.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 -- 172.21.15.164:0/3887227338 shutdown_connections 2024-03-27T08:32:49.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.211+0000 7f0710a00640 1 -- 172.21.15.164:0/3887227338 wait complete. 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 Processor -- start 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 -- start start 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 0x7f070c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:49.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10d700 con 0x7f070c102c40 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10d580 con 0x7f070c103600 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0710a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f070c10d880 con 0x7f070c101a50 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0709e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0709e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45370/0 (socket says 172.21.15.164:45370) 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.212+0000 7f0709e00640 1 -- 172.21.15.164:0/3952983738 learned_addr learned my addr 172.21.15.164:0/3952983738 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f070a800640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 0x7f070c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f070b200640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 -- 172.21.15.164:0/3952983738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 msgr2=0x7f070c199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 0x7f070c199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 -- 172.21.15.164:0/3952983738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 msgr2=0x7f070c1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:49.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 -- 172.21.15.164:0/3952983738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f070c1a1b20 con 0x7f070c102c40 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f070b200640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0709e00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000c00 tx=0x7f06f8004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8043020 con 0x7f070c102c40 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.213+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f070c1a1db0 con 0x7f070c102c40 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.214+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f06f80054d0 con 0x7f070c102c40 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.214+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f8003d40 con 0x7f070c102c40 2024-03-27T08:32:49.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.214+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f070c1a2280 con 0x7f070c102c40 2024-03-27T08:32:49.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.215+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f070c1a2450 con 0x7f070c102c40 2024-03-27T08:32:49.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.217+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f06f8046020 con 0x7f070c102c40 2024-03-27T08:32:49.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.218+0000 7f0703400640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 0x7f06f00a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:49.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.219+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f06f80f1f50 con 0x7f070c102c40 2024-03-27T08:32:49.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.219+0000 7f070a800640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 0x7f06f00a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:49.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.220+0000 7f070a800640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 0x7f06f00a5b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06fc005fd0 tx=0x7f06fc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:49.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.223+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f06f804d020 con 0x7f070c102c40 2024-03-27T08:32:49.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:49.470+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f070c1a27e0 con 0x7f070c102c40 2024-03-27T08:32:50.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.176+0000 7f0703400640 1 -- 172.21.15.164:0/3952983738 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v18) ==== 105+0+0 (secure 0 0 0) 0x7f06f80bec70 con 0x7f070c102c40 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 msgr2=0x7f06f00a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 0x7f06f00a5b50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f06fc005fd0 tx=0x7f06fc005850 comp rx=0 tx=0).stop 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 msgr2=0x7f070c19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f06f8000c00 tx=0x7f06f8004f10 comp rx=0 tx=0).stop 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 shutdown_connections 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06f00a3690 0x7f06f00a5b50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f070c103600 0x7f070c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f070c102c40 0x7f070c19a440 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 --2- 172.21.15.164:0/3952983738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f070c101a50 0x7f070c199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.180+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 >> 172.21.15.164:0/3952983738 conn(0x7f070c0fcfc0 msgr2=0x7f070c073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:50.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.181+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 shutdown_connections 2024-03-27T08:32:50.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.181+0000 7f0710a00640 1 -- 172.21.15.164:0/3952983738 wait complete. 2024-03-27T08:32:50.203 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay true 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: pgmap v364: 97 pgs: 64 active+clean, 10 creating+peering, 23 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-03-27T08:32:50.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:49 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T08:32:50.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: pgmap v364: 97 pgs: 64 active+clean, 10 creating+peering, 23 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-03-27T08:32:50.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:49 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1749729402' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: pgmap v364: 97 pgs: 64 active+clean, 10 creating+peering, 23 unknown; 577 KiB data, 353 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 6 op/s 2024-03-27T08:32:50.326 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:49 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-03-27T08:32:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 -- 172.21.15.164:0/1199491538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4104f10 msgr2=0x7fd5d4107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1199491538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4104f10 0x7fd5d4107300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009900 tx=0x7fd5bc02bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 -- 172.21.15.164:0/1199491538 shutdown_connections 2024-03-27T08:32:50.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1199491538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d4107840 0x7fd5d4109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1199491538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4104f10 0x7fd5d4107300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1199491538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d41025e0 0x7fd5d41049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 -- 172.21.15.164:0/1199491538 >> 172.21.15.164:0/1199491538 conn(0x7fd5d40fbff0 msgr2=0x7fd5d40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 -- 172.21.15.164:0/1199491538 shutdown_connections 2024-03-27T08:32:50.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.417+0000 7fd5dae00640 1 -- 172.21.15.164:0/1199491538 wait complete. 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 Processor -- start 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 -- start start 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d41025e0 0x7fd5d419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 0x7fd5d419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:50.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410d7f0 con 0x7fd5d4107840 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410d670 con 0x7fd5d41025e0 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.418+0000 7fd5dae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd5d410d970 con 0x7fd5d4104f10 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45382/0 (socket says 172.21.15.164:45382) 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 -- 172.21.15.164:0/1803360729 learned_addr learned my addr 172.21.15.164:0/1803360729 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d3e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d41025e0 0x7fd5d419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d3400640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 0x7fd5d419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 -- 172.21.15.164:0/1803360729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 msgr2=0x7fd5d419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 0x7fd5d419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 -- 172.21.15.164:0/1803360729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d41025e0 msgr2=0x7fd5d419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d41025e0 0x7fd5d419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:50.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 -- 172.21.15.164:0/1803360729 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5d41a1d10 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d3400640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 0x7fd5d419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.419+0000 7fd5d8e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d750 tx=0x7fd5cc00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.420+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc017070 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.420+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5cc0054f0 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.420+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5cc004cf0 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.420+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5d41a1fa0 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.420+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5d41a2470 con 0x7fd5d4107840 2024-03-27T08:32:50.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.421+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5d4109330 con 0x7fd5d4107840 2024-03-27T08:32:50.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.425+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7fd5cc004e90 con 0x7fd5d4107840 2024-03-27T08:32:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.425+0000 7fd5d0c00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 0x7fd5b80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.425+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fd5cc0cfac0 con 0x7fd5d4107840 2024-03-27T08:32:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.425+0000 7fd5d3e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 0x7fd5b80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.426+0000 7fd5d3e00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 0x7fd5b80a5ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4005c40 tx=0x7fd5c400a780 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.427+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd5cc09c740 con 0x7fd5d4107840 2024-03-27T08:32:50.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:50.671+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fd5d402d370 con 0x7fd5d4107840 2024-03-27T08:32:51.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.189+0000 7fd5d0c00640 1 -- 172.21.15.164:0/1803360729 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v20) ==== 121+0+0 (secure 0 0 0) 0x7fd5cc09c040 con 0x7fd5d4107840 2024-03-27T08:32:51.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 msgr2=0x7fd5b80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:51.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 0x7fd5b80a5ad0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd5c4005c40 tx=0x7fd5c400a780 comp rx=0 tx=0).stop 2024-03-27T08:32:51.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 msgr2=0x7fd5d41a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:51.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fd5cc00d750 tx=0x7fd5cc00dc10 comp rx=0 tx=0).stop 2024-03-27T08:32:51.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 shutdown_connections 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd5b80a3610 0x7fd5b80a5ad0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd5d4107840 0x7fd5d41a16a0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd5d4104f10 0x7fd5d419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 --2- 172.21.15.164:0/1803360729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5d41025e0 0x7fd5d419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 >> 172.21.15.164:0/1803360729 conn(0x7fd5d40fbff0 msgr2=0x7fd5d4101e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 shutdown_connections 2024-03-27T08:32:51.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.193+0000 7fd5dae00640 1 -- 172.21.15.164:0/1803360729 wait complete. 2024-03-27T08:32:51.214 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-27T08:32:51.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T08:32:51.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T08:32:51.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T08:32:51.318 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T08:32:51.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:51.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-27T08:32:51.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-27T08:32:51.319 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T08:32:51.324 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3952983738' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-03-27T08:32:51.325 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-03-27T08:32:51.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 -- 172.21.15.164:0/3732214542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 msgr2=0x7f95d41080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:51.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 --2- 172.21.15.164:0/3732214542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d41080a0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f95cc009ca0 tx=0x7f95cc02c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 -- 172.21.15.164:0/3732214542 shutdown_connections 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 --2- 172.21.15.164:0/3732214542 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d41080a0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 --2- 172.21.15.164:0/3732214542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 0x7f95d41012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 --2- 172.21.15.164:0/3732214542 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 0x7f95d4100080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 -- 172.21.15.164:0/3732214542 >> 172.21.15.164:0/3732214542 conn(0x7f95d40fb1d0 msgr2=0x7f95d40fd610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 -- 172.21.15.164:0/3732214542 shutdown_connections 2024-03-27T08:32:51.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.416+0000 7f95da400640 1 -- 172.21.15.164:0/3732214542 wait complete. 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 Processor -- start 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 -- start start 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 0x7f95d4197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 0x7f95d4198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410b470 con 0x7f95d4101810 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410b2f0 con 0x7f95d4100e50 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.417+0000 7f95da400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f95d410b5f0 con 0x7f95d40ffc60 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45408/0 (socket says 172.21.15.164:45408) 2024-03-27T08:32:51.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 -- 172.21.15.164:0/4145553679 learned_addr learned my addr 172.21.15.164:0/4145553679 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d3e00640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 0x7f95d4198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9000640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 0x7f95d4197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 -- 172.21.15.164:0/4145553679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 msgr2=0x7f95d4197d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 0x7f95d4197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 -- 172.21.15.164:0/4145553679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 msgr2=0x7f95d4198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 0x7f95d4198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 -- 172.21.15.164:0/4145553679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d419f920 con 0x7f95d4101810 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.418+0000 7f95d9a00640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95cc02c630 tx=0x7f95cc032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.419+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc039050 con 0x7f95d4101810 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.419+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95cc03a040 con 0x7f95d4101810 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.419+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d419fbb0 con 0x7f95d4101810 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.419+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc040450 con 0x7f95d4101810 2024-03-27T08:32:51.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.419+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d41a00a0 con 0x7f95d4101810 2024-03-27T08:32:51.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.420+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d41a0270 con 0x7f95d4101810 2024-03-27T08:32:51.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.422+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f95cc003b70 con 0x7f95d4101810 2024-03-27T08:32:51.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.423+0000 7f95d1600640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 0x7f95b80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:51.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.423+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f95cc0f33d0 con 0x7f95d4101810 2024-03-27T08:32:51.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.424+0000 7f95d9000640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 0x7f95b80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:51.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.424+0000 7f95d9000640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 0x7f95b80a5ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:51.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.427+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f95cc0c0050 con 0x7f95d4101810 2024-03-27T08:32:51.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:51.672+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f95d41a0560 con 0x7f95d4101810 2024-03-27T08:32:51.818 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b[65196]: 2024-03-27T08:32:51.567+0000 7f2452c00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-27T08:32:51.818 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:32:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b[65196]: 2024-03-27T08:32:51.567+0000 7f2452c00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-03-27T08:32:52.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: Cluster is now healthy 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: pgmap v365: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:active 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:52.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:52 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T08:32:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T08:32:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:32:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T08:32:52.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: Cluster is now healthy 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: pgmap v365: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:active 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:52.569 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:52 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T08:32:52.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1803360729' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: Cluster is now healthy 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: pgmap v365: 97 pgs: 93 active+clean, 4 creating+peering; 577 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s wr, 8 op/s 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] up:active 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:52.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:52 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-03-27T08:32:52.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.668+0000 7f95d1600640 1 -- 172.21.15.164:0/4145553679 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f95cc0bf950 con 0x7f95d4101810 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 msgr2=0x7f95b80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 0x7f95b80a5ad0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f95c4005fd0 tx=0x7f95c4005850 comp rx=0 tx=0).stop 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 msgr2=0x7f95d419f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f95cc02c630 tx=0x7f95cc032900 comp rx=0 tx=0).stop 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 shutdown_connections 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f95b80a3610 0x7f95b80a5ad0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f95d4101810 0x7f95d419f280 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.665 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95d4100e50 0x7f95d4198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 --2- 172.21.15.164:0/4145553679 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f95d40ffc60 0x7f95d4197d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 >> 172.21.15.164:0/4145553679 conn(0x7f95d40fb1d0 msgr2=0x7f95d4106300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:52.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 shutdown_connections 2024-03-27T08:32:52.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.673+0000 7f95da400640 1 -- 172.21.15.164:0/4145553679 wait complete. 2024-03-27T08:32:52.688 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated --size 25000000000'} subvols for filesystem 'cephfs' 2024-03-27T08:32:52.688 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs qa 2024-03-27T08:32:52.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 -- 172.21.15.164:0/633808385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28105920 msgr2=0x7f3d2810c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 --2- 172.21.15.164:0/633808385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28105920 0x7f3d2810c1b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3d24009ca0 tx=0x7f3d2402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 -- 172.21.15.164:0/633808385 shutdown_connections 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 --2- 172.21.15.164:0/633808385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28105920 0x7f3d2810c1b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 --2- 172.21.15.164:0/633808385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 0x7f3d281053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 --2- 172.21.15.164:0/633808385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28103d70 0x7f3d28104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 -- 172.21.15.164:0/633808385 >> 172.21.15.164:0/633808385 conn(0x7f3d280ff300 msgr2=0x7f3d28101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 -- 172.21.15.164:0/633808385 shutdown_connections 2024-03-27T08:32:52.954 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.961+0000 7f3d30800640 1 -- 172.21.15.164:0/633808385 wait complete. 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.962+0000 7f3d30800640 1 Processor -- start 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 -- start start 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 0x7f3d2819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 0x7f3d281a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810f9d0 con 0x7f3d28103d70 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810f850 con 0x7f3d28105920 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d30800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d2810fb50 con 0x7f3d28104f60 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d2de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:52.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d2de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45434/0 (socket says 172.21.15.164:45434) 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.963+0000 7f3d2de00640 1 -- 172.21.15.164:0/3145374083 learned_addr learned my addr 172.21.15.164:0/3145374083 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2e800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 0x7f3d281a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2d400640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 0x7f3d2819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 -- 172.21.15.164:0/3145374083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 msgr2=0x7f3d2819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 0x7f3d2819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 -- 172.21.15.164:0/3145374083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 msgr2=0x7f3d281a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 0x7f3d281a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 -- 172.21.15.164:0/3145374083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d281a1c10 con 0x7f3d28103d70 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2e800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 0x7f3d281a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d2de00640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00e9c0 tx=0x7f3d1c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c00cd80 con 0x7f3d28103d70 2024-03-27T08:32:52.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d1c0035f0 con 0x7f3d28103d70 2024-03-27T08:32:52.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c010690 con 0x7f3d28103d70 2024-03-27T08:32:52.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.964+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d281a1f00 con 0x7f3d28103d70 2024-03-27T08:32:52.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.965+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d281a23c0 con 0x7f3d28103d70 2024-03-27T08:32:52.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.966+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d2810b090 con 0x7f3d28103d70 2024-03-27T08:32:52.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.968+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f3d1c0037a0 con 0x7f3d28103d70 2024-03-27T08:32:52.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.971+0000 7f3d22a00640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 0x7f3d100a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:52.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.971+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f3d1c0d0140 con 0x7f3d28103d70 2024-03-27T08:32:52.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.971+0000 7f3d2d400640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 0x7f3d100a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:52.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.972+0000 7f3d2d400640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 0x7f3d100a5b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005fd0 tx=0x7f3d18005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:52.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:52.975+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3d1c09cdc0 con 0x7f3d28103d70 2024-03-27T08:32:53.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.202+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3d28061f90 con 0x7f3d100a3690 2024-03-27T08:32:53.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.246+0000 7f3d22a00640 1 -- 172.21.15.164:0/3145374083 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3d28061f90 con 0x7f3d100a3690 2024-03-27T08:32:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 msgr2=0x7f3d100a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 0x7f3d100a5b50 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f3d18005fd0 tx=0x7f3d18005850 comp rx=0 tx=0).stop 2024-03-27T08:32:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 msgr2=0x7f3d28199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00e9c0 tx=0x7f3d1c00ee80 comp rx=0 tx=0).stop 2024-03-27T08:32:53.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 shutdown_connections 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d100a3690 0x7f3d100a5b50 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d28105920 0x7f3d281a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d28104f60 0x7f3d2819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 --2- 172.21.15.164:0/3145374083 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d28103d70 0x7f3d28199ff0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 >> 172.21.15.164:0/3145374083 conn(0x7f3d280ff300 msgr2=0x7f3d28108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 shutdown_connections 2024-03-27T08:32:53.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.249+0000 7f3d30800640 1 -- 172.21.15.164:0/3145374083 wait complete. 2024-03-27T08:32:53.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_0 --group_name qa 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 -- 172.21.15.164:0/2751691693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06780780f0 msgr2=0x7f0678078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 --2- 172.21.15.164:0/2751691693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06780780f0 0x7f0678078990 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0670009900 tx=0x7f067002bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 -- 172.21.15.164:0/2751691693 shutdown_connections 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 --2- 172.21.15.164:0/2751691693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f06780780f0 0x7f0678078990 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 --2- 172.21.15.164:0/2751691693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678077750 0x7f0678077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 --2- 172.21.15.164:0/2751691693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0678076510 0x7f0678076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.478+0000 7f0677e00640 1 -- 172.21.15.164:0/2751691693 >> 172.21.15.164:0/2751691693 conn(0x7f06780ff1c0 msgr2=0x7f0678101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.479+0000 7f0677e00640 1 -- 172.21.15.164:0/2751691693 shutdown_connections 2024-03-27T08:32:53.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.479+0000 7f0677e00640 1 -- 172.21.15.164:0/2751691693 wait complete. 2024-03-27T08:32:53.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.479+0000 7f0677e00640 1 Processor -- start 2024-03-27T08:32:53.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 -- start start 2024-03-27T08:32:53.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 0x7f067819e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06780780f0 0x7f06781a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0678113cf0 con 0x7f0678077750 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0678113b70 con 0x7f06780780f0 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0677e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0678113e70 con 0x7f0678076510 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0676000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0676000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45468/0 (socket says 172.21.15.164:45468) 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0676000640 1 -- 172.21.15.164:0/1582758857 learned_addr learned my addr 172.21.15.164:0/1582758857 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.480+0000 7f0676a00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 0x7f067819e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0677400640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06780780f0 0x7f06781a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 -- 172.21.15.164:0/1582758857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 msgr2=0x7f067819e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 0x7f067819e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 -- 172.21.15.164:0/1582758857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06780780f0 msgr2=0x7f06781a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06780780f0 0x7f06781a5860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 -- 172.21.15.164:0/1582758857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06781a5ed0 con 0x7f0678077750 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676a00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 0x7f067819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0676000640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f066000ea80 tx=0x7f066000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066000ce40 con 0x7f0678077750 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06781a61c0 con 0x7f0678077750 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0660005020 con 0x7f0678077750 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06600116d0 con 0x7f0678077750 2024-03-27T08:32:53.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.481+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06781a6710 con 0x7f0678077750 2024-03-27T08:32:53.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.482+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06781106d0 con 0x7f0678077750 2024-03-27T08:32:53.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.485+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 16) ==== 138371+0+0 (secure 0 0 0) 0x7f06600051d0 con 0x7f0678077750 2024-03-27T08:32:53.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.486+0000 7f066f400640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 0x7f06580a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:53.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.487+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f06600d0060 con 0x7f0678077750 2024-03-27T08:32:53.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.487+0000 7f0676a00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 0x7f06580a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:53.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.487+0000 7f0676a00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 0x7f06580a5ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0668009b50 tx=0x7f0668005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:53.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.491+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0660016030 con 0x7f0678077750 2024-03-27T08:32:53.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:32:53.211+0000 7fc4f7e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T08:32:53.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:32:53.211+0000 7fc4f7e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T08:32:53.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:32:53.211+0000 7fc4f7e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T08:32:53.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:32:53.211+0000 7fc4f7e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T08:32:53.504 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:32:53.211+0000 7fc4f7e00700 -1 client.0 error registering admin socket command: (17) File exists 2024-03-27T08:32:53.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.709+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f0660098c50 con 0x7f0678077750 2024-03-27T08:32:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.733+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f0678061f90 con 0x7f06580a3610 2024-03-27T08:32:53.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.790+0000 7f066f400640 1 -- 172.21.15.164:0/1582758857 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0678061f90 con 0x7f06580a3610 2024-03-27T08:32:53.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 msgr2=0x7f06580a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 0x7f06580a5ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0668009b50 tx=0x7f0668005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 msgr2=0x7f067819e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f066000ea80 tx=0x7f066000ef40 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 shutdown_connections 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f06580a3610 0x7f06580a5ad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f06780780f0 0x7f06781a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0678077750 0x7f067819e7f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 --2- 172.21.15.164:0/1582758857 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0678076510 0x7f067819e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 >> 172.21.15.164:0/1582758857 conn(0x7f06780ff1c0 msgr2=0x7f0678100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.793+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 shutdown_connections 2024-03-27T08:32:53.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:53.794+0000 7f0677e00640 1 -- 172.21.15.164:0/1582758857 wait complete. 2024-03-27T08:32:53.806 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-03-27T08:32:54.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T08:32:54.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:54.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-mon[31788]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:54.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:53 smithi164 ceph-mon[31788]: pgmap v366: 97 pgs: 97 active+clean; 580 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 4.0 KiB/s wr, 12 op/s 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 -- 172.21.15.164:0/247736803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244103710 msgr2=0x7f0244109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 --2- 172.21.15.164:0/247736803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244103710 0x7f0244109fa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f023c009900 tx=0x7f023c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 -- 172.21.15.164:0/247736803 shutdown_connections 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 --2- 172.21.15.164:0/247736803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244103710 0x7f0244109fa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 --2- 172.21.15.164:0/247736803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244102d50 0x7f02441031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 --2- 172.21.15.164:0/247736803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 0x7f0244101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 -- 172.21.15.164:0/247736803 >> 172.21.15.164:0/247736803 conn(0x7f02440fd0f0 msgr2=0x7f02440ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:54.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 -- 172.21.15.164:0/247736803 shutdown_connections 2024-03-27T08:32:54.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.032+0000 7f0249000640 1 -- 172.21.15.164:0/247736803 wait complete. 2024-03-27T08:32:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.033+0000 7f0249000640 1 Processor -- start 2024-03-27T08:32:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.033+0000 7f0249000640 1 -- start start 2024-03-27T08:32:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 0x7f0244197e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 0x7f024419f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f024410d810 con 0x7f0244102d50 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f024410d690 con 0x7f0244103710 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0249000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f024410d990 con 0x7f0244101b60 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45488/0 (socket says 172.21.15.164:45488) 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 -- 172.21.15.164:0/3400683183 learned_addr learned my addr 172.21.15.164:0/3400683183 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0242800640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 0x7f024419f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 -- 172.21.15.164:0/3400683183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 msgr2=0x7f0244197e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241e00640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 0x7f0244197e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 0x7f0244197e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 -- 172.21.15.164:0/3400683183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 msgr2=0x7f024419f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 0x7f024419f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0241400640 1 -- 172.21.15.164:0/3400683183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024419fa40 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.034+0000 7f0242800640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 0x7f024419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f0241400640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f023000e9f0 tx=0x7f023000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023000cd80 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0230010900 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02300189e0 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024419fd30 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.035+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02441a01d0 con 0x7f0244102d50 2024-03-27T08:32:54.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.036+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0244108e80 con 0x7f0244102d50 2024-03-27T08:32:54.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.039+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f0230010ab0 con 0x7f0244102d50 2024-03-27T08:32:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.040+0000 7f023aa00640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 0x7f02280a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.040+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f02300d0250 con 0x7f0244102d50 2024-03-27T08:32:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.040+0000 7f0241e00640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 0x7f02280a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.041+0000 7f0241e00640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 0x7f02280a5b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0234005c40 tx=0x7f0234005bd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:54.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.045+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f023009cd70 con 0x7f0244102d50 2024-03-27T08:32:54.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:53 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T08:32:54.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:53 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:54.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:53 smithi167 ceph-mon[34903]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:54.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:53 smithi167 ceph-mon[34903]: pgmap v366: 97 pgs: 97 active+clean; 580 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 4.0 KiB/s wr, 12 op/s 2024-03-27T08:32:54.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:53 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4145553679' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-03-27T08:32:54.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:53 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:32:54.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:53 smithi173 ceph-mon[35397]: from='client.14748 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:54.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:53 smithi173 ceph-mon[35397]: pgmap v366: 97 pgs: 97 active+clean; 580 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 924 B/s rd, 4.0 KiB/s wr, 12 op/s 2024-03-27T08:32:54.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.279+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f0244062020 con 0x7f02280a36a0 2024-03-27T08:32:54.277 INFO:teuthology.orchestra.run.smithi164.stdout:/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253 2024-03-27T08:32:54.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.286+0000 7f023aa00640 1 -- 172.21.15.164:0/3400683183 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f0244062020 con 0x7f02280a36a0 2024-03-27T08:32:54.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.288+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 msgr2=0x7f02280a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.288+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 0x7f02280a5b60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f0234005c40 tx=0x7f0234005bd0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.288+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 msgr2=0x7f0244198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.288+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f023000e9f0 tx=0x7f023000eeb0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 shutdown_connections 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02280a36a0 0x7f02280a5b60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0244103710 0x7f024419f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0244102d50 0x7f0244198360 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 --2- 172.21.15.164:0/3400683183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0244101b60 0x7f0244197e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 >> 172.21.15.164:0/3400683183 conn(0x7f02440fd0f0 msgr2=0x7f0244106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 shutdown_connections 2024-03-27T08:32:54.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.289+0000 7f0249000640 1 -- 172.21.15.164:0/3400683183 wait complete. 2024-03-27T08:32:54.300 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs sv_1 --group_name qa 2024-03-27T08:32:54.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 -- 172.21.15.164:0/2501638310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 msgr2=0x7f4c8410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 --2- 172.21.15.164:0/2501638310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c8410c1d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009ca0 tx=0x7f4c7c02c100 comp rx=0 tx=0).stop 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 -- 172.21.15.164:0/2501638310 shutdown_connections 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 --2- 172.21.15.164:0/2501638310 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c8410c1d0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 --2- 172.21.15.164:0/2501638310 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84104f80 0x7f4c84105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 --2- 172.21.15.164:0/2501638310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84103d90 0x7f4c841041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 -- 172.21.15.164:0/2501638310 >> 172.21.15.164:0/2501638310 conn(0x7f4c840ff300 msgr2=0x7f4c84101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 -- 172.21.15.164:0/2501638310 shutdown_connections 2024-03-27T08:32:54.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.516+0000 7f4c8c000640 1 -- 172.21.15.164:0/2501638310 wait complete. 2024-03-27T08:32:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.517+0000 7f4c8c000640 1 Processor -- start 2024-03-27T08:32:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 -- start start 2024-03-27T08:32:54.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84103d90 0x7f4c8419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 0x7f4c8419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410f9f0 con 0x7f4c84105940 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410f870 con 0x7f4c84104f80 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8c000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4c8410fb70 con 0x7f4c84103d90 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45504/0 (socket says 172.21.15.164:45504) 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c8a000640 1 -- 172.21.15.164:0/1427032747 learned_addr learned my addr 172.21.15.164:0/1427032747 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c88c00640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 0x7f4c8419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.518+0000 7f4c89600640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84103d90 0x7f4c8419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 -- 172.21.15.164:0/1427032747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84103d90 msgr2=0x7f4c8419a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84103d90 0x7f4c8419a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 -- 172.21.15.164:0/1427032747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 msgr2=0x7f4c8419a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 0x7f4c8419a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 -- 172.21.15.164:0/1427032747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c841a1c60 con 0x7f4c84105940 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c88c00640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 0x7f4c8419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8a000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009bf0 tx=0x7f4c7c034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c039050 con 0x7f4c84105940 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c7c03a040 con 0x7f4c84105940 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c841a1ef0 con 0x7f4c84105940 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c7c0046a0 con 0x7f4c84105940 2024-03-27T08:32:54.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.519+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c841a23b0 con 0x7f4c84105940 2024-03-27T08:32:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.521+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c8410b0b0 con 0x7f4c84105940 2024-03-27T08:32:54.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.522+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f4c7c003970 con 0x7f4c84105940 2024-03-27T08:32:54.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.524+0000 7f4c82000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 0x7f4c6c0a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.524+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f4c7c0f2530 con 0x7f4c84105940 2024-03-27T08:32:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.524+0000 7f4c89600640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 0x7f4c6c0a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:54.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.525+0000 7f4c89600640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 0x7f4c6c0a5be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c84104de0 tx=0x7f4c70005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:54.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.528+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4c7c0bf260 con 0x7f4c84105940 2024-03-27T08:32:54.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.765+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f4c84062020 con 0x7f4c6c0a3720 2024-03-27T08:32:54.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.818+0000 7f4c82000640 1 -- 172.21.15.164:0/1427032747 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4c84062020 con 0x7f4c6c0a3720 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.821+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 msgr2=0x7f4c6c0a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.821+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 0x7f4c6c0a5be0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4c84104de0 tx=0x7f4c70005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.821+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 msgr2=0x7f4c841a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.821+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4c7c009bf0 tx=0x7f4c7c034cd0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 shutdown_connections 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4c6c0a3720 0x7f4c6c0a5be0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4c84105940 0x7f4c841a15f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c84104f80 0x7f4c8419a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 --2- 172.21.15.164:0/1427032747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4c84103d90 0x7f4c8419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 >> 172.21.15.164:0/1427032747 conn(0x7f4c840ff300 msgr2=0x7f4c84108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 shutdown_connections 2024-03-27T08:32:54.814 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:54.822+0000 7f4c8c000640 1 -- 172.21.15.164:0/1427032747 wait complete. 2024-03-27T08:32:54.834 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-03-27T08:32:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:54 smithi164 ceph-mon[31788]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-27T08:32:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:54 smithi164 ceph-mon[31788]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:54 smithi164 ceph-mon[31788]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 -- 172.21.15.164:0/2839596065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 msgr2=0x7f353010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 --2- 172.21.15.164:0/2839596065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f353010c1d0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f3528009ca0 tx=0x7f352802c100 comp rx=0 tx=0).stop 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 -- 172.21.15.164:0/2839596065 shutdown_connections 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 --2- 172.21.15.164:0/2839596065 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f353010c1d0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 --2- 172.21.15.164:0/2839596065 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 0x7f3530105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 --2- 172.21.15.164:0/2839596065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 0x7f35301041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.055+0000 7f3538000640 1 -- 172.21.15.164:0/2839596065 >> 172.21.15.164:0/2839596065 conn(0x7f35300ff300 msgr2=0x7f3530101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.056+0000 7f3538000640 1 -- 172.21.15.164:0/2839596065 shutdown_connections 2024-03-27T08:32:55.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.056+0000 7f3538000640 1 -- 172.21.15.164:0/2839596065 wait complete. 2024-03-27T08:32:55.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.056+0000 7f3538000640 1 Processor -- start 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 -- start start 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 0x7f353019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 0x7f353019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f353010f9f0 con 0x7f3530105940 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f353010f870 con 0x7f3530103d90 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3538000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f353010fb70 con 0x7f3530104f80 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3536000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3535600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 0x7f353019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3536000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45526/0 (socket says 172.21.15.164:45526) 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3536000640 1 -- 172.21.15.164:0/138387252 learned_addr learned my addr 172.21.15.164:0/138387252 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:55.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.057+0000 7f3534c00640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 0x7f353019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 -- 172.21.15.164:0/138387252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 msgr2=0x7f353019a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 0x7f353019a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 -- 172.21.15.164:0/138387252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 msgr2=0x7f353019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 0x7f353019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 -- 172.21.15.164:0/138387252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35301a1c50 con 0x7f3530105940 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.058+0000 7f3536000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3528009bf0 tx=0x7f3528034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.059+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3528039050 con 0x7f3530105940 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.059+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f352803a040 con 0x7f3530105940 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.059+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35301a1ee0 con 0x7f3530105940 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.059+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280046a0 con 0x7f3530105940 2024-03-27T08:32:55.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.059+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35301a2340 con 0x7f3530105940 2024-03-27T08:32:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.060+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f353010b180 con 0x7f3530105940 2024-03-27T08:32:55.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.062+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f3528003970 con 0x7f3530105940 2024-03-27T08:32:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.063+0000 7f352e000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 0x7f35180a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.063+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f35280f25c0 con 0x7f3530105940 2024-03-27T08:32:55.055 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.064+0000 7f3535600640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 0x7f35180a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.056 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.064+0000 7f3535600640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 0x7f35180a5b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3530104de0 tx=0x7f3524005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:55.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.067+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f35280bf1f0 con 0x7f3530105940 2024-03-27T08:32:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:54 smithi167 ceph-mon[34903]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-27T08:32:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:54 smithi167 ceph-mon[34903]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:54 smithi167 ceph-mon[34903]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:54 smithi173 ceph-mon[35397]: mgrmap e17: x(active, since 9m), standbys: z, y 2024-03-27T08:32:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:54 smithi173 ceph-mon[35397]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:54 smithi173 ceph-mon[35397]: from='client.14766 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:55.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.300+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f3530062020 con 0x7f35180a36a0 2024-03-27T08:32:55.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.313+0000 7f352e000640 1 -- 172.21.15.164:0/138387252 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f3530062020 con 0x7f35180a36a0 2024-03-27T08:32:55.305 INFO:teuthology.orchestra.run.smithi164.stdout:/volumes/qa/sv_1/a8624a3d-ce16-43e6-915b-8a0a930aead2 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.316+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 msgr2=0x7f35180a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.316+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 0x7f35180a5b60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f3530104de0 tx=0x7f3524005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.316+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 msgr2=0x7f35301a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.316+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f3528009bf0 tx=0x7f3528034cd0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 shutdown_connections 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35180a36a0 0x7f35180a5b60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3530105940 0x7f35301a15e0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3530104f80 0x7f353019a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 --2- 172.21.15.164:0/138387252 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3530103d90 0x7f353019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 >> 172.21.15.164:0/138387252 conn(0x7f35300ff300 msgr2=0x7f3530108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 shutdown_connections 2024-03-27T08:32:55.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.317+0000 7f3538000640 1 -- 172.21.15.164:0/138387252 wait complete. 2024-03-27T08:32:55.328 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:32:55.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 -- 172.21.15.164:0/523725934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 msgr2=0x7fc8e0109c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 --2- 172.21.15.164:0/523725934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0109c70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8009900 tx=0x7fc8d802bc30 comp rx=0 tx=0).stop 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 -- 172.21.15.164:0/523725934 shutdown_connections 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 --2- 172.21.15.164:0/523725934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0109c70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 --2- 172.21.15.164:0/523725934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e0104ef0 0x7fc8e01072e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 --2- 172.21.15.164:0/523725934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e01025c0 0x7fc8e01049b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 -- 172.21.15.164:0/523725934 >> 172.21.15.164:0/523725934 conn(0x7fc8e00fbfb0 msgr2=0x7fc8e00fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 -- 172.21.15.164:0/523725934 shutdown_connections 2024-03-27T08:32:55.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.548+0000 7fc8e7800640 1 -- 172.21.15.164:0/523725934 wait complete. 2024-03-27T08:32:55.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.549+0000 7fc8e7800640 1 Processor -- start 2024-03-27T08:32:55.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.549+0000 7fc8e7800640 1 -- start start 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 0x7fc8e0101f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0104ef0 0x7fc8e0100570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e010d7f0 con 0x7fc8e0107820 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e010d670 con 0x7fc8e01025c0 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e7800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8e010d970 con 0x7fc8e0104ef0 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33298/0 (socket says 172.21.15.164:33298) 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 -- 172.21.15.164:0/3367969000 learned_addr learned my addr 172.21.15.164:0/3367969000 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e4e00640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 0x7fc8e0101f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8dfe00640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0104ef0 0x7fc8e0100570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 -- 172.21.15.164:0/3367969000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0104ef0 msgr2=0x7fc8e0100570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0104ef0 0x7fc8e0100570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 -- 172.21.15.164:0/3367969000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 msgr2=0x7fc8e0101f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 0x7fc8e0101f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e5800640 1 -- 172.21.15.164:0/3367969000 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8e0101340 con 0x7fc8e0107820 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.550+0000 7fc8e4e00640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 0x7fc8e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8e5800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8036040 tx=0x7fc8d8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8043020 con 0x7fc8e0107820 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc8d8005460 con 0x7fc8e0107820 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8d8003d30 con 0x7fc8e0107820 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8e01a1f20 con 0x7fc8e0107820 2024-03-27T08:32:55.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.551+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8e01a22d0 con 0x7fc8e0107820 2024-03-27T08:32:55.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.552+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8e00fdaa0 con 0x7fc8e0107820 2024-03-27T08:32:55.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.554+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fc8d8046020 con 0x7fc8e0107820 2024-03-27T08:32:55.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.556+0000 7fc8dd600640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 0x7fc8c00a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:55.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.556+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fc8d80f1ff0 con 0x7fc8e0107820 2024-03-27T08:32:55.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.556+0000 7fc8e4e00640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 0x7fc8c00a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:55.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.557+0000 7fc8e4e00640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 0x7fc8c00a5b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005d00 tx=0x7fc8d0005c70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:55.552 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.560+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc8d804d020 con 0x7fc8e0107820 2024-03-27T08:32:55.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.803+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc8e002d370 con 0x7fc8e0107820 2024-03-27T08:32:55.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.805+0000 7fc8dd600640 1 -- 172.21.15.164:0/3367969000 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7fc8d80bec60 con 0x7fc8e0107820 2024-03-27T08:32:55.798 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:55.798 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:32:55.798 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:32:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 msgr2=0x7fc8c00a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 0x7fc8c00a5b60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0005d00 tx=0x7fc8d0005c70 comp rx=0 tx=0).stop 2024-03-27T08:32:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 msgr2=0x7fc8e0100ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:55.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc8d8036040 tx=0x7fc8d8004e20 comp rx=0 tx=0).stop 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 shutdown_connections 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc8c00a36a0 0x7fc8c00a5b60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc8e0107820 0x7fc8e0100ab0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc8e0104ef0 0x7fc8e0100570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 --2- 172.21.15.164:0/3367969000 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc8e01025c0 0x7fc8e0101f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 >> 172.21.15.164:0/3367969000 conn(0x7fc8e00fbfb0 msgr2=0x7fc8e0102f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.808+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 shutdown_connections 2024-03-27T08:32:55.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:55.809+0000 7fc8e7800640 1 -- 172.21.15.164:0/3367969000 wait complete. 2024-03-27T08:32:55.818 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:32:56.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:55 smithi164 ceph-mon[31788]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:55 smithi164 ceph-mon[31788]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:55 smithi164 ceph-mon[31788]: pgmap v367: 97 pgs: 97 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.025+0000 7fd2a4400640 1 -- 172.21.15.164:0/3219227336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c0780f0 msgr2=0x7fd29c078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.025+0000 7fd2a4400640 1 --2- 172.21.15.164:0/3219227336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c0780f0 0x7fd29c078990 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fd294009ca0 tx=0x7fd29402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 -- 172.21.15.164:0/3219227336 shutdown_connections 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 --2- 172.21.15.164:0/3219227336 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c0780f0 0x7fd29c078990 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 --2- 172.21.15.164:0/3219227336 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c077750 0x7fd29c077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 --2- 172.21.15.164:0/3219227336 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c076510 0x7fd29c076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 -- 172.21.15.164:0/3219227336 >> 172.21.15.164:0/3219227336 conn(0x7fd29c0ff300 msgr2=0x7fd29c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 -- 172.21.15.164:0/3219227336 shutdown_connections 2024-03-27T08:32:56.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.026+0000 7fd2a4400640 1 -- 172.21.15.164:0/3219227336 wait complete. 2024-03-27T08:32:56.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 Processor -- start 2024-03-27T08:32:56.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 -- start start 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c076510 0x7fd29c19e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c0780f0 0x7fd29c1a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113df0 con 0x7fd29c077750 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113c70 con 0x7fd29c0780f0 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a4400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd29c113f70 con 0x7fd29c076510 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33322/0 (socket says 172.21.15.164:33322) 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a1000640 1 -- 172.21.15.164:0/2465528626 learned_addr learned my addr 172.21.15.164:0/2465528626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a2400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c0780f0 0x7fd29c1a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.027+0000 7fd2a1a00640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c076510 0x7fd29c19e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 -- 172.21.15.164:0/2465528626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c076510 msgr2=0x7fd29c19e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c076510 0x7fd29c19e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 -- 172.21.15.164:0/2465528626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c0780f0 msgr2=0x7fd29c1a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c0780f0 0x7fd29c1a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 -- 172.21.15.164:0/2465528626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd29c1a6020 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a1000640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9f0 tx=0x7fd28800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28800cd80 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2880054f0 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd288010690 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd29c1a6310 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.028+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd29c1a6810 con 0x7fd29c077750 2024-03-27T08:32:56.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.029+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd29c110850 con 0x7fd29c077750 2024-03-27T08:32:56.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.032+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fd288004f20 con 0x7fd29c077750 2024-03-27T08:32:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.034+0000 7fd29a000640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 0x7fd2840a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.034+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fd2880d0360 con 0x7fd29c077750 2024-03-27T08:32:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.034+0000 7fd2a1a00640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 0x7fd2840a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.035+0000 7fd2a1a00640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 0x7fd2840a5b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2900095f0 tx=0x7fd290005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.038+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd28809ce80 con 0x7fd29c077750 2024-03-27T08:32:56.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:55 smithi167 ceph-mon[34903]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:55 smithi167 ceph-mon[34903]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:55 smithi167 ceph-mon[34903]: pgmap v367: 97 pgs: 97 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-03-27T08:32:56.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:55 smithi173 ceph-mon[35397]: from='client.14772 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:55 smithi173 ceph-mon[35397]: from='client.14778 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:32:56.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:55 smithi173 ceph-mon[35397]: pgmap v367: 97 pgs: 97 active+clean; 581 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-03-27T08:32:56.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.223+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd29c02d5e0 con 0x7fd29c077750 2024-03-27T08:32:56.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.227+0000 7fd29a000640 1 -- 172.21.15.164:0/2465528626 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22289 (secure 0 0 0) 0x7fd28809c780 con 0x7fd29c077750 2024-03-27T08:32:56.220 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:56.220 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":88,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:32:47.569637+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:32:56.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 msgr2=0x7fd2840a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 0x7fd2840a5b60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd2900095f0 tx=0x7fd290005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:56.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 msgr2=0x7fd29c19e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fd28800e9f0 tx=0x7fd28800edf0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 shutdown_connections 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2840a36a0 0x7fd2840a5b60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd29c0780f0 0x7fd29c1a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd29c077750 0x7fd29c19e940 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 --2- 172.21.15.164:0/2465528626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd29c076510 0x7fd29c19e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 >> 172.21.15.164:0/2465528626 conn(0x7fd29c0ff300 msgr2=0x7fd29c100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 shutdown_connections 2024-03-27T08:32:56.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.230+0000 7fd2a4400640 1 -- 172.21.15.164:0/2465528626 wait complete. 2024-03-27T08:32:56.240 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-27T08:32:56.240 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T08:32:56.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 -- 172.21.15.164:0/1216682409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109d20 msgr2=0x7fcbf01105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 --2- 172.21.15.164:0/1216682409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109d20 0x7fcbf01105b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fcbe8009ca0 tx=0x7fcbe802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 -- 172.21.15.164:0/1216682409 shutdown_connections 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 --2- 172.21.15.164:0/1216682409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109d20 0x7fcbf01105b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 --2- 172.21.15.164:0/1216682409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf0109360 0x7fcbf01097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 --2- 172.21.15.164:0/1216682409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 0x7fcbf0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 -- 172.21.15.164:0/1216682409 >> 172.21.15.164:0/1216682409 conn(0x7fcbf0077130 msgr2=0x7fcbf0079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 -- 172.21.15.164:0/1216682409 shutdown_connections 2024-03-27T08:32:56.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.453+0000 7fcbf7800640 1 -- 172.21.15.164:0/1216682409 wait complete. 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 Processor -- start 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 -- start start 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 0x7fcbf019e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf0109d20 0x7fcbf01a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0113dd0 con 0x7fcbf0109360 2024-03-27T08:32:56.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0113c50 con 0x7fcbf0108170 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.454+0000 7fcbf7800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcbf0113f50 con 0x7fcbf0109d20 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33346/0 (socket says 172.21.15.164:33346) 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 -- 172.21.15.164:0/322688527 learned_addr learned my addr 172.21.15.164:0/322688527 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbf4e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 0x7fcbf019e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 -- 172.21.15.164:0/322688527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf0109d20 msgr2=0x7fcbf01a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf0109d20 0x7fcbf01a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 -- 172.21.15.164:0/322688527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 msgr2=0x7fcbf019e480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 0x7fcbf019e480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 -- 172.21.15.164:0/322688527 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf01a60a0 con 0x7fcbf0109360 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.455+0000 7fcbe7e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d770 tx=0x7fcbd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.456+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8017070 con 0x7fcbf0109360 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.456+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcbd80054f0 con 0x7fcbf0109360 2024-03-27T08:32:56.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.456+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf01a6390 con 0x7fcbf0109360 2024-03-27T08:32:56.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.456+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbd8004d60 con 0x7fcbf0109360 2024-03-27T08:32:56.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.456+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbf01a68e0 con 0x7fcbf0109360 2024-03-27T08:32:56.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.457+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbf010f430 con 0x7fcbf0109360 2024-03-27T08:32:56.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.459+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fcbd8004f00 con 0x7fcbf0109360 2024-03-27T08:32:56.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.460+0000 7fcbee000640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 0x7fcbd40a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.460+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fcbd80cf8a0 con 0x7fcbf0109360 2024-03-27T08:32:56.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.460+0000 7fcbf4e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 0x7fcbd40a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.461+0000 7fcbf4e00640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 0x7fcbd40a5be0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbf01091c0 tx=0x7fcbe0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.465+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcbd809c3c0 con 0x7fcbf0109360 2024-03-27T08:32:56.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.647+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fcbf0061f90 con 0x7fcbd40a3720 2024-03-27T08:32:56.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.657+0000 7fcbee000640 1 -- 172.21.15.164:0/322688527 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258795 (secure 0 0 0) 0x7fcbf0061f90 con 0x7fcbd40a3720 2024-03-27T08:32:56.653 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:56.655 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 msgr2=0x7fcbd40a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 0x7fcbd40a5be0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fcbf01091c0 tx=0x7fcbe0005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 msgr2=0x7fcbf019e9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fcbd800d770 tx=0x7fcbd800dc30 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 shutdown_connections 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcbd40a3720 0x7fcbd40a5be0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcbf0109d20 0x7fcbf01a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcbf0109360 0x7fcbf019e9c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 --2- 172.21.15.164:0/322688527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcbf0108170 0x7fcbf019e480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 >> 172.21.15.164:0/322688527 conn(0x7fcbf0077130 msgr2=0x7fcbf010c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:56.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 shutdown_connections 2024-03-27T08:32:56.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.662+0000 7fcbf7800640 1 -- 172.21.15.164:0/322688527 wait complete. 2024-03-27T08:32:56.672 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-03-27T08:32:55.304066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595359,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":301,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362208,"kb_used_data":13040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579616,"statfs":{"total":1151940427776,"available":1151569526784,"internally_reserved":0,"allocated":13352960,"data_stored":7228356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4991,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.733649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.579073+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:32:47.579073+0000","last_peered":"2024-03-27T08:32:47.579073+0000","last_clean":"2024-03-27T08:32:47.579073+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:32:47.579073+0000","last_undegraded":"2024-03-27T08:32:47.579073+0000","last_fullsized":"2024-03-27T08:32:47.579073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121536+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:32:48.121536+0000","last_peered":"2024-03-27T08:32:48.121536+0000","last_clean":"2024-03-27T08:32:48.121536+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:32:48.121536+0000","last_undegraded":"2024-03-27T08:32:48.121536+0000","last_fullsized":"2024-03-27T08:32:48.121536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121383+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:32:48.121383+0000","last_peered":"2024-03-27T08:32:48.121383+0000","last_clean":"2024-03-27T08:32:48.121383+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:32:48.121383+0000","last_undegraded":"2024-03-27T08:32:48.121383+0000","last_fullsized":"2024-03-27T08:32:48.121383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121021+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:32:48.121021+0000","last_peered":"2024-03-27T08:32:48.121021+0000","last_clean":"2024-03-27T08:32:48.121021+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:32:48.121021+0000","last_undegraded":"2024-03-27T08:32:48.121021+0000","last_fullsized":"2024-03-27T08:32:48.121021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619646+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:32:47.619646+0000","last_peered":"2024-03-27T08:32:47.619646+0000","last_clean":"2024-03-27T08:32:47.619646+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:32:47.619646+0000","last_undegraded":"2024-03-27T08:32:47.619646+0000","last_fullsized":"2024-03-27T08:32:47.619646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122312+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:32:48.122312+0000","last_peered":"2024-03-27T08:32:48.122312+0000","last_clean":"2024-03-27T08:32:48.122312+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:32:48.122312+0000","last_undegraded":"2024-03-27T08:32:48.122312+0000","last_fullsized":"2024-03-27T08:32:48.122312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578115+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:32:47.578115+0000","last_peered":"2024-03-27T08:32:47.578115+0000","last_clean":"2024-03-27T08:32:47.578115+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:32:47.578115+0000","last_undegraded":"2024-03-27T08:32:47.578115+0000","last_fullsized":"2024-03-27T08:32:47.578115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120689+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:32:48.120689+0000","last_peered":"2024-03-27T08:32:48.120689+0000","last_clean":"2024-03-27T08:32:48.120689+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:32:48.120689+0000","last_undegraded":"2024-03-27T08:32:48.120689+0000","last_fullsized":"2024-03-27T08:32:48.120689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.124599+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:32:48.124599+0000","last_peered":"2024-03-27T08:32:48.124599+0000","last_clean":"2024-03-27T08:32:48.124599+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:32:48.124599+0000","last_undegraded":"2024-03-27T08:32:48.124599+0000","last_fullsized":"2024-03-27T08:32:48.124599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123289+0000","last_change":"2024-03-27T08:32:46.602846+0000","last_active":"2024-03-27T08:32:48.123289+0000","last_peered":"2024-03-27T08:32:48.123289+0000","last_clean":"2024-03-27T08:32:48.123289+0000","last_became_active":"2024-03-27T08:32:46.602524+0000","last_became_peered":"2024-03-27T08:32:46.602524+0000","last_unstale":"2024-03-27T08:32:48.123289+0000","last_undegraded":"2024-03-27T08:32:48.123289+0000","last_fullsized":"2024-03-27T08:32:48.123289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:48.601661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578948+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:32:47.578948+0000","last_peered":"2024-03-27T08:32:47.578948+0000","last_clean":"2024-03-27T08:32:47.578948+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:32:47.578948+0000","last_undegraded":"2024-03-27T08:32:47.578948+0000","last_fullsized":"2024-03-27T08:32:47.578948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121015+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:32:48.121015+0000","last_peered":"2024-03-27T08:32:48.121015+0000","last_clean":"2024-03-27T08:32:48.121015+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:32:48.121015+0000","last_undegraded":"2024-03-27T08:32:48.121015+0000","last_fullsized":"2024-03-27T08:32:48.121015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122670+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:32:48.122670+0000","last_peered":"2024-03-27T08:32:48.122670+0000","last_clean":"2024-03-27T08:32:48.122670+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:32:48.122670+0000","last_undegraded":"2024-03-27T08:32:48.122670+0000","last_fullsized":"2024-03-27T08:32:48.122670+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120285+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:32:48.120285+0000","last_peered":"2024-03-27T08:32:48.120285+0000","last_clean":"2024-03-27T08:32:48.120285+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:32:48.120285+0000","last_undegraded":"2024-03-27T08:32:48.120285+0000","last_fullsized":"2024-03-27T08:32:48.120285+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120133+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:32:48.120133+0000","last_peered":"2024-03-27T08:32:48.120133+0000","last_clean":"2024-03-27T08:32:48.120133+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:32:48.120133+0000","last_undegraded":"2024-03-27T08:32:48.120133+0000","last_fullsized":"2024-03-27T08:32:48.120133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121447+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:32:48.121447+0000","last_peered":"2024-03-27T08:32:48.121447+0000","last_clean":"2024-03-27T08:32:48.121447+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:32:48.121447+0000","last_undegraded":"2024-03-27T08:32:48.121447+0000","last_fullsized":"2024-03-27T08:32:48.121447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.579239+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:32:47.579239+0000","last_peered":"2024-03-27T08:32:47.579239+0000","last_clean":"2024-03-27T08:32:47.579239+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:32:47.579239+0000","last_undegraded":"2024-03-27T08:32:47.579239+0000","last_fullsized":"2024-03-27T08:32:47.579239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578542+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:32:47.578542+0000","last_peered":"2024-03-27T08:32:47.578542+0000","last_clean":"2024-03-27T08:32:47.578542+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:32:47.578542+0000","last_undegraded":"2024-03-27T08:32:47.578542+0000","last_fullsized":"2024-03-27T08:32:47.578542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.976186+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:32:47.976186+0000","last_peered":"2024-03-27T08:32:47.976186+0000","last_clean":"2024-03-27T08:32:47.976186+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:32:47.976186+0000","last_undegraded":"2024-03-27T08:32:47.976186+0000","last_fullsized":"2024-03-27T08:32:47.976186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.227207+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:32:51.227207+0000","last_peered":"2024-03-27T08:32:51.227207+0000","last_clean":"2024-03-27T08:32:51.227207+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:32:51.227207+0000","last_undegraded":"2024-03-27T08:32:51.227207+0000","last_fullsized":"2024-03-27T08:32:51.227207+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122904+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:32:48.122904+0000","last_peered":"2024-03-27T08:32:48.122904+0000","last_clean":"2024-03-27T08:32:48.122904+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:32:48.122904+0000","last_undegraded":"2024-03-27T08:32:48.122904+0000","last_fullsized":"2024-03-27T08:32:48.122904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.443567+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:32:48.443567+0000","last_peered":"2024-03-27T08:32:48.443567+0000","last_clean":"2024-03-27T08:32:48.443567+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:32:48.443567+0000","last_undegraded":"2024-03-27T08:32:48.443567+0000","last_fullsized":"2024-03-27T08:32:48.443567+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122152+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:32:48.122152+0000","last_peered":"2024-03-27T08:32:48.122152+0000","last_clean":"2024-03-27T08:32:48.122152+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:32:48.122152+0000","last_undegraded":"2024-03-27T08:32:48.122152+0000","last_fullsized":"2024-03-27T08:32:48.122152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.223425+0000","last_change":"2024-03-27T08:32:45.588190+0000","last_active":"2024-03-27T08:32:51.223425+0000","last_peered":"2024-03-27T08:32:51.223425+0000","last_clean":"2024-03-27T08:32:51.223425+0000","last_became_active":"2024-03-27T08:32:45.587462+0000","last_became_peered":"2024-03-27T08:32:45.587462+0000","last_unstale":"2024-03-27T08:32:51.223425+0000","last_undegraded":"2024-03-27T08:32:51.223425+0000","last_fullsized":"2024-03-27T08:32:51.223425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:05:49.965930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123603+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:32:48.123603+0000","last_peered":"2024-03-27T08:32:48.123603+0000","last_clean":"2024-03-27T08:32:48.123603+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:32:48.123603+0000","last_undegraded":"2024-03-27T08:32:48.123603+0000","last_fullsized":"2024-03-27T08:32:48.123603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619950+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:32:47.619950+0000","last_peered":"2024-03-27T08:32:47.619950+0000","last_clean":"2024-03-27T08:32:47.619950+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:32:47.619950+0000","last_undegraded":"2024-03-27T08:32:47.619950+0000","last_fullsized":"2024-03-27T08:32:47.619950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121702+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:32:48.121702+0000","last_peered":"2024-03-27T08:32:48.121702+0000","last_clean":"2024-03-27T08:32:48.121702+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:32:48.121702+0000","last_undegraded":"2024-03-27T08:32:48.121702+0000","last_fullsized":"2024-03-27T08:32:48.121702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:53.688665+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:32:53.688665+0000","last_peered":"2024-03-27T08:32:53.688665+0000","last_clean":"2024-03-27T08:32:53.688665+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:32:53.688665+0000","last_undegraded":"2024-03-27T08:32:53.688665+0000","last_fullsized":"2024-03-27T08:32:53.688665+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619588+0000","last_change":"2024-03-27T08:32:46.599365+0000","last_active":"2024-03-27T08:32:47.619588+0000","last_peered":"2024-03-27T08:32:47.619588+0000","last_clean":"2024-03-27T08:32:47.619588+0000","last_became_active":"2024-03-27T08:32:46.599043+0000","last_became_peered":"2024-03-27T08:32:46.599043+0000","last_unstale":"2024-03-27T08:32:47.619588+0000","last_undegraded":"2024-03-27T08:32:47.619588+0000","last_fullsized":"2024-03-27T08:32:47.619588+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:30:48.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.221638+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:32:51.221638+0000","last_peered":"2024-03-27T08:32:51.221638+0000","last_clean":"2024-03-27T08:32:51.221638+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:32:51.221638+0000","last_undegraded":"2024-03-27T08:32:51.221638+0000","last_fullsized":"2024-03-27T08:32:51.221638+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121221+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:32:48.121221+0000","last_peered":"2024-03-27T08:32:48.121221+0000","last_clean":"2024-03-27T08:32:48.121221+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:32:48.121221+0000","last_undegraded":"2024-03-27T08:32:48.121221+0000","last_fullsized":"2024-03-27T08:32:48.121221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.221560+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:32:51.221560+0000","last_peered":"2024-03-27T08:32:51.221560+0000","last_clean":"2024-03-27T08:32:51.221560+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:32:51.221560+0000","last_undegraded":"2024-03-27T08:32:51.221560+0000","last_fullsized":"2024-03-27T08:32:51.221560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121660+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:32:48.121660+0000","last_peered":"2024-03-27T08:32:48.121660+0000","last_clean":"2024-03-27T08:32:48.121660+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:32:48.121660+0000","last_undegraded":"2024-03-27T08:32:48.121660+0000","last_fullsized":"2024-03-27T08:32:48.121660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.903488+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:32:48.903488+0000","last_peered":"2024-03-27T08:32:48.903488+0000","last_clean":"2024-03-27T08:32:48.903488+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:32:48.903488+0000","last_undegraded":"2024-03-27T08:32:48.903488+0000","last_fullsized":"2024-03-27T08:32:48.903488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578540+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:32:47.578540+0000","last_peered":"2024-03-27T08:32:47.578540+0000","last_clean":"2024-03-27T08:32:47.578540+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:32:47.578540+0000","last_undegraded":"2024-03-27T08:32:47.578540+0000","last_fullsized":"2024-03-27T08:32:47.578540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216055+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:32:50.216055+0000","last_peered":"2024-03-27T08:32:50.216055+0000","last_clean":"2024-03-27T08:32:50.216055+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:32:50.216055+0000","last_undegraded":"2024-03-27T08:32:50.216055+0000","last_fullsized":"2024-03-27T08:32:50.216055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.124197+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:32:48.124197+0000","last_peered":"2024-03-27T08:32:48.124197+0000","last_clean":"2024-03-27T08:32:48.124197+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:32:48.124197+0000","last_undegraded":"2024-03-27T08:32:48.124197+0000","last_fullsized":"2024-03-27T08:32:48.124197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215702+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:32:50.215702+0000","last_peered":"2024-03-27T08:32:50.215702+0000","last_clean":"2024-03-27T08:32:50.215702+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:32:50.215702+0000","last_undegraded":"2024-03-27T08:32:50.215702+0000","last_fullsized":"2024-03-27T08:32:50.215702+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121996+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:32:48.121996+0000","last_peered":"2024-03-27T08:32:48.121996+0000","last_clean":"2024-03-27T08:32:48.121996+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:32:48.121996+0000","last_undegraded":"2024-03-27T08:32:48.121996+0000","last_fullsized":"2024-03-27T08:32:48.121996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215064+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:32:50.215064+0000","last_peered":"2024-03-27T08:32:50.215064+0000","last_clean":"2024-03-27T08:32:50.215064+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:32:50.215064+0000","last_undegraded":"2024-03-27T08:32:50.215064+0000","last_fullsized":"2024-03-27T08:32:50.215064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123792+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:32:48.123792+0000","last_peered":"2024-03-27T08:32:48.123792+0000","last_clean":"2024-03-27T08:32:48.123792+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:32:48.123792+0000","last_undegraded":"2024-03-27T08:32:48.123792+0000","last_fullsized":"2024-03-27T08:32:48.123792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'8","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216347+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:32:50.216347+0000","last_peered":"2024-03-27T08:32:50.216347+0000","last_clean":"2024-03-27T08:32:50.216347+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:32:50.216347+0000","last_undegraded":"2024-03-27T08:32:50.216347+0000","last_fullsized":"2024-03-27T08:32:50.216347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619925+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:32:47.619925+0000","last_peered":"2024-03-27T08:32:47.619925+0000","last_clean":"2024-03-27T08:32:47.619925+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:32:47.619925+0000","last_undegraded":"2024-03-27T08:32:47.619925+0000","last_fullsized":"2024-03-27T08:32:47.619925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.222371+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:32:51.222371+0000","last_peered":"2024-03-27T08:32:51.222371+0000","last_clean":"2024-03-27T08:32:51.222371+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:32:51.222371+0000","last_undegraded":"2024-03-27T08:32:51.222371+0000","last_fullsized":"2024-03-27T08:32:51.222371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121095+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:32:48.121095+0000","last_peered":"2024-03-27T08:32:48.121095+0000","last_clean":"2024-03-27T08:32:48.121095+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:32:48.121095+0000","last_undegraded":"2024-03-27T08:32:48.121095+0000","last_fullsized":"2024-03-27T08:32:48.121095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215242+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:32:50.215242+0000","last_peered":"2024-03-27T08:32:50.215242+0000","last_clean":"2024-03-27T08:32:50.215242+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:32:50.215242+0000","last_undegraded":"2024-03-27T08:32:50.215242+0000","last_fullsized":"2024-03-27T08:32:50.215242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578142+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:32:47.578142+0000","last_peered":"2024-03-27T08:32:47.578142+0000","last_clean":"2024-03-27T08:32:47.578142+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:32:47.578142+0000","last_undegraded":"2024-03-27T08:32:47.578142+0000","last_fullsized":"2024-03-27T08:32:47.578142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121703+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:32:48.121703+0000","last_peered":"2024-03-27T08:32:48.121703+0000","last_clean":"2024-03-27T08:32:48.121703+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:32:48.121703+0000","last_undegraded":"2024-03-27T08:32:48.121703+0000","last_fullsized":"2024-03-27T08:32:48.121703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577657+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:32:47.577657+0000","last_peered":"2024-03-27T08:32:47.577657+0000","last_clean":"2024-03-27T08:32:47.577657+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:32:47.577657+0000","last_undegraded":"2024-03-27T08:32:47.577657+0000","last_fullsized":"2024-03-27T08:32:47.577657+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.228675+0000","last_change":"2024-03-27T08:32:45.578408+0000","last_active":"2024-03-27T08:32:51.228675+0000","last_peered":"2024-03-27T08:32:51.228675+0000","last_clean":"2024-03-27T08:32:51.228675+0000","last_became_active":"2024-03-27T08:32:45.574888+0000","last_became_peered":"2024-03-27T08:32:45.574888+0000","last_unstale":"2024-03-27T08:32:51.228675+0000","last_undegraded":"2024-03-27T08:32:51.228675+0000","last_fullsized":"2024-03-27T08:32:51.228675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:24.101352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120958+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:32:48.120958+0000","last_peered":"2024-03-27T08:32:48.120958+0000","last_clean":"2024-03-27T08:32:48.120958+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:32:48.120958+0000","last_undegraded":"2024-03-27T08:32:48.120958+0000","last_fullsized":"2024-03-27T08:32:48.120958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.675807+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:32:51.675807+0000","last_peered":"2024-03-27T08:32:51.675807+0000","last_clean":"2024-03-27T08:32:51.675807+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:32:51.675807+0000","last_undegraded":"2024-03-27T08:32:51.675807+0000","last_fullsized":"2024-03-27T08:32:51.675807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578798+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:32:47.578798+0000","last_peered":"2024-03-27T08:32:47.578798+0000","last_clean":"2024-03-27T08:32:47.578798+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:32:47.578798+0000","last_undegraded":"2024-03-27T08:32:47.578798+0000","last_fullsized":"2024-03-27T08:32:47.578798+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578030+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:32:47.578030+0000","last_peered":"2024-03-27T08:32:47.578030+0000","last_clean":"2024-03-27T08:32:47.578030+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:32:47.578030+0000","last_undegraded":"2024-03-27T08:32:47.578030+0000","last_fullsized":"2024-03-27T08:32:47.578030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122981+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:32:48.122981+0000","last_peered":"2024-03-27T08:32:48.122981+0000","last_clean":"2024-03-27T08:32:48.122981+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:32:48.122981+0000","last_undegraded":"2024-03-27T08:32:48.122981+0000","last_fullsized":"2024-03-27T08:32:48.122981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577896+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:32:47.577896+0000","last_peered":"2024-03-27T08:32:47.577896+0000","last_clean":"2024-03-27T08:32:47.577896+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:32:47.577896+0000","last_undegraded":"2024-03-27T08:32:47.577896+0000","last_fullsized":"2024-03-27T08:32:47.577896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122276+0000","last_change":"2024-03-27T08:32:46.598137+0000","last_active":"2024-03-27T08:32:48.122276+0000","last_peered":"2024-03-27T08:32:48.122276+0000","last_clean":"2024-03-27T08:32:48.122276+0000","last_became_active":"2024-03-27T08:32:46.597741+0000","last_became_peered":"2024-03-27T08:32:46.597741+0000","last_unstale":"2024-03-27T08:32:48.122276+0000","last_undegraded":"2024-03-27T08:32:48.122276+0000","last_fullsized":"2024-03-27T08:32:48.122276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:46:02.022020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121362+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:32:48.121362+0000","last_peered":"2024-03-27T08:32:48.121362+0000","last_clean":"2024-03-27T08:32:48.121362+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:32:48.121362+0000","last_undegraded":"2024-03-27T08:32:48.121362+0000","last_fullsized":"2024-03-27T08:32:48.121362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:52.687199+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:32:52.687199+0000","last_peered":"2024-03-27T08:32:52.687199+0000","last_clean":"2024-03-27T08:32:52.687199+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:32:52.687199+0000","last_undegraded":"2024-03-27T08:32:52.687199+0000","last_fullsized":"2024-03-27T08:32:52.687199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122136+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:32:48.122136+0000","last_peered":"2024-03-27T08:32:48.122136+0000","last_clean":"2024-03-27T08:32:48.122136+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:32:48.122136+0000","last_undegraded":"2024-03-27T08:32:48.122136+0000","last_fullsized":"2024-03-27T08:32:48.122136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.209988+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:32:50.209988+0000","last_peered":"2024-03-27T08:32:50.209988+0000","last_clean":"2024-03-27T08:32:50.209988+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:32:50.209988+0000","last_undegraded":"2024-03-27T08:32:50.209988+0000","last_fullsized":"2024-03-27T08:32:50.209988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":342,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577463+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:32:47.577463+0000","last_peered":"2024-03-27T08:32:47.577463+0000","last_clean":"2024-03-27T08:32:47.577463+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:32:47.577463+0000","last_undegraded":"2024-03-27T08:32:47.577463+0000","last_fullsized":"2024-03-27T08:32:47.577463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120253+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:32:48.120253+0000","last_peered":"2024-03-27T08:32:48.120253+0000","last_clean":"2024-03-27T08:32:48.120253+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:32:48.120253+0000","last_undegraded":"2024-03-27T08:32:48.120253+0000","last_fullsized":"2024-03-27T08:32:48.120253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577902+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:32:47.577902+0000","last_peered":"2024-03-27T08:32:47.577902+0000","last_clean":"2024-03-27T08:32:47.577902+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:32:47.577902+0000","last_undegraded":"2024-03-27T08:32:47.577902+0000","last_fullsized":"2024-03-27T08:32:47.577902+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.213646+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:32:50.213646+0000","last_peered":"2024-03-27T08:32:50.213646+0000","last_clean":"2024-03-27T08:32:50.213646+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:32:50.213646+0000","last_undegraded":"2024-03-27T08:32:50.213646+0000","last_fullsized":"2024-03-27T08:32:50.213646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121443+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:32:48.121443+0000","last_peered":"2024-03-27T08:32:48.121443+0000","last_clean":"2024-03-27T08:32:48.121443+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:32:48.121443+0000","last_undegraded":"2024-03-27T08:32:48.121443+0000","last_fullsized":"2024-03-27T08:32:48.121443+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.224424+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:32:51.224424+0000","last_peered":"2024-03-27T08:32:51.224424+0000","last_clean":"2024-03-27T08:32:51.224424+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:32:51.224424+0000","last_undegraded":"2024-03-27T08:32:51.224424+0000","last_fullsized":"2024-03-27T08:32:51.224424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123366+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:32:48.123366+0000","last_peered":"2024-03-27T08:32:48.123366+0000","last_clean":"2024-03-27T08:32:48.123366+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:32:48.123366+0000","last_undegraded":"2024-03-27T08:32:48.123366+0000","last_fullsized":"2024-03-27T08:32:48.123366+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.214556+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:32:50.214556+0000","last_peered":"2024-03-27T08:32:50.214556+0000","last_clean":"2024-03-27T08:32:50.214556+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:32:50.214556+0000","last_undegraded":"2024-03-27T08:32:50.214556+0000","last_fullsized":"2024-03-27T08:32:50.214556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121695+0000","last_change":"2024-03-27T08:32:46.595674+0000","last_active":"2024-03-27T08:32:48.121695+0000","last_peered":"2024-03-27T08:32:48.121695+0000","last_clean":"2024-03-27T08:32:48.121695+0000","last_became_active":"2024-03-27T08:32:46.595281+0000","last_became_peered":"2024-03-27T08:32:46.595281+0000","last_unstale":"2024-03-27T08:32:48.121695+0000","last_undegraded":"2024-03-27T08:32:48.121695+0000","last_fullsized":"2024-03-27T08:32:48.121695+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:52:24.218811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.213501+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:32:50.213501+0000","last_peered":"2024-03-27T08:32:50.213501+0000","last_clean":"2024-03-27T08:32:50.213501+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:32:50.213501+0000","last_undegraded":"2024-03-27T08:32:50.213501+0000","last_fullsized":"2024-03-27T08:32:50.213501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619353+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:32:47.619353+0000","last_peered":"2024-03-27T08:32:47.619353+0000","last_clean":"2024-03-27T08:32:47.619353+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:32:47.619353+0000","last_undegraded":"2024-03-27T08:32:47.619353+0000","last_fullsized":"2024-03-27T08:32:47.619353+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.211501+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:32:50.211501+0000","last_peered":"2024-03-27T08:32:50.211501+0000","last_clean":"2024-03-27T08:32:50.211501+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:32:50.211501+0000","last_undegraded":"2024-03-27T08:32:50.211501+0000","last_fullsized":"2024-03-27T08:32:50.211501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578382+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:32:47.578382+0000","last_peered":"2024-03-27T08:32:47.578382+0000","last_clean":"2024-03-27T08:32:47.578382+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:32:47.578382+0000","last_undegraded":"2024-03-27T08:32:47.578382+0000","last_fullsized":"2024-03-27T08:32:47.578382+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975398+0000","last_change":"2024-03-27T08:32:45.582156+0000","last_active":"2024-03-27T08:32:47.975398+0000","last_peered":"2024-03-27T08:32:47.975398+0000","last_clean":"2024-03-27T08:32:47.975398+0000","last_became_active":"2024-03-27T08:32:45.581790+0000","last_became_peered":"2024-03-27T08:32:45.581790+0000","last_unstale":"2024-03-27T08:32:47.975398+0000","last_undegraded":"2024-03-27T08:32:47.975398+0000","last_fullsized":"2024-03-27T08:32:47.975398+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:26:48.776634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122273+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:32:48.122273+0000","last_peered":"2024-03-27T08:32:48.122273+0000","last_clean":"2024-03-27T08:32:48.122273+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:32:48.122273+0000","last_undegraded":"2024-03-27T08:32:48.122273+0000","last_fullsized":"2024-03-27T08:32:48.122273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216862+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:32:50.216862+0000","last_peered":"2024-03-27T08:32:50.216862+0000","last_clean":"2024-03-27T08:32:50.216862+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:32:50.216862+0000","last_undegraded":"2024-03-27T08:32:50.216862+0000","last_fullsized":"2024-03-27T08:32:50.216862+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578126+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:32:47.578126+0000","last_peered":"2024-03-27T08:32:47.578126+0000","last_clean":"2024-03-27T08:32:47.578126+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:32:47.578126+0000","last_undegraded":"2024-03-27T08:32:47.578126+0000","last_fullsized":"2024-03-27T08:32:47.578126+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.227125+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:32:51.227125+0000","last_peered":"2024-03-27T08:32:51.227125+0000","last_clean":"2024-03-27T08:32:51.227125+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:32:51.227125+0000","last_undegraded":"2024-03-27T08:32:51.227125+0000","last_fullsized":"2024-03-27T08:32:51.227125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578704+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:32:47.578704+0000","last_peered":"2024-03-27T08:32:47.578704+0000","last_clean":"2024-03-27T08:32:47.578704+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:32:47.578704+0000","last_undegraded":"2024-03-27T08:32:47.578704+0000","last_fullsized":"2024-03-27T08:32:47.578704+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.903593+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:32:48.903593+0000","last_peered":"2024-03-27T08:32:48.903593+0000","last_clean":"2024-03-27T08:32:48.903593+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:32:48.903593+0000","last_undegraded":"2024-03-27T08:32:48.903593+0000","last_fullsized":"2024-03-27T08:32:48.903593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578213+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:32:47.578213+0000","last_peered":"2024-03-27T08:32:47.578213+0000","last_clean":"2024-03-27T08:32:47.578213+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:32:47.578213+0000","last_undegraded":"2024-03-27T08:32:47.578213+0000","last_fullsized":"2024-03-27T08:32:47.578213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122125+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:32:48.122125+0000","last_peered":"2024-03-27T08:32:48.122125+0000","last_clean":"2024-03-27T08:32:48.122125+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:32:48.122125+0000","last_undegraded":"2024-03-27T08:32:48.122125+0000","last_fullsized":"2024-03-27T08:32:48.122125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578849+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:32:47.578849+0000","last_peered":"2024-03-27T08:32:47.578849+0000","last_clean":"2024-03-27T08:32:47.578849+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:32:47.578849+0000","last_undegraded":"2024-03-27T08:32:47.578849+0000","last_fullsized":"2024-03-27T08:32:47.578849+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578489+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:32:47.578489+0000","last_peered":"2024-03-27T08:32:47.578489+0000","last_clean":"2024-03-27T08:32:47.578489+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:32:47.578489+0000","last_undegraded":"2024-03-27T08:32:47.578489+0000","last_fullsized":"2024-03-27T08:32:47.578489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975496+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:32:47.975496+0000","last_peered":"2024-03-27T08:32:47.975496+0000","last_clean":"2024-03-27T08:32:47.975496+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:32:47.975496+0000","last_undegraded":"2024-03-27T08:32:47.975496+0000","last_fullsized":"2024-03-27T08:32:47.975496+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975373+0000","last_change":"2024-03-27T08:32:46.602630+0000","last_active":"2024-03-27T08:32:47.975373+0000","last_peered":"2024-03-27T08:32:47.975373+0000","last_clean":"2024-03-27T08:32:47.975373+0000","last_became_active":"2024-03-27T08:32:46.601734+0000","last_became_peered":"2024-03-27T08:32:46.601734+0000","last_unstale":"2024-03-27T08:32:47.975373+0000","last_undegraded":"2024-03-27T08:32:47.975373+0000","last_fullsized":"2024-03-27T08:32:47.975373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:19.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120700+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:32:48.120700+0000","last_peered":"2024-03-27T08:32:48.120700+0000","last_clean":"2024-03-27T08:32:48.120700+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:32:48.120700+0000","last_undegraded":"2024-03-27T08:32:48.120700+0000","last_fullsized":"2024-03-27T08:32:48.120700+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121654+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:32:48.121654+0000","last_peered":"2024-03-27T08:32:48.121654+0000","last_clean":"2024-03-27T08:32:48.121654+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:32:48.121654+0000","last_undegraded":"2024-03-27T08:32:48.121654+0000","last_fullsized":"2024-03-27T08:32:48.121654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578785+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:32:47.578785+0000","last_peered":"2024-03-27T08:32:47.578785+0000","last_clean":"2024-03-27T08:32:47.578785+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:32:47.578785+0000","last_undegraded":"2024-03-27T08:32:47.578785+0000","last_fullsized":"2024-03-27T08:32:47.578785+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.977073+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:32:47.977073+0000","last_peered":"2024-03-27T08:32:47.977073+0000","last_clean":"2024-03-27T08:32:47.977073+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:32:47.977073+0000","last_undegraded":"2024-03-27T08:32:47.977073+0000","last_fullsized":"2024-03-27T08:32:47.977073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123203+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:32:48.123203+0000","last_peered":"2024-03-27T08:32:48.123203+0000","last_clean":"2024-03-27T08:32:48.123203+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:32:48.123203+0000","last_undegraded":"2024-03-27T08:32:48.123203+0000","last_fullsized":"2024-03-27T08:32:48.123203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121136+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:32:48.121136+0000","last_peered":"2024-03-27T08:32:48.121136+0000","last_clean":"2024-03-27T08:32:48.121136+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:32:48.121136+0000","last_undegraded":"2024-03-27T08:32:48.121136+0000","last_fullsized":"2024-03-27T08:32:48.121136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121249+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:32:48.121249+0000","last_peered":"2024-03-27T08:32:48.121249+0000","last_clean":"2024-03-27T08:32:48.121249+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:32:48.121249+0000","last_undegraded":"2024-03-27T08:32:48.121249+0000","last_fullsized":"2024-03-27T08:32:48.121249+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123558+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:32:48.123558+0000","last_peered":"2024-03-27T08:32:48.123558+0000","last_clean":"2024-03-27T08:32:48.123558+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:32:48.123558+0000","last_undegraded":"2024-03-27T08:32:48.123558+0000","last_fullsized":"2024-03-27T08:32:48.123558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122473+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:32:48.122473+0000","last_peered":"2024-03-27T08:32:48.122473+0000","last_clean":"2024-03-27T08:32:48.122473+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:32:48.122473+0000","last_undegraded":"2024-03-27T08:32:48.122473+0000","last_fullsized":"2024-03-27T08:32:48.122473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578148+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:32:47.578148+0000","last_peered":"2024-03-27T08:32:47.578148+0000","last_clean":"2024-03-27T08:32:47.578148+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:32:47.578148+0000","last_undegraded":"2024-03-27T08:32:47.578148+0000","last_fullsized":"2024-03-27T08:32:47.578148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4991,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":51428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285584,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":451142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1044118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710749,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972388,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1540096,"data_stored":1041510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430259,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":450767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":488753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":452038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":453522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117064,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":450844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855425,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":450582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1042404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:32:56.677 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T08:32:56.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 -- 172.21.15.164:0/2360209255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 msgr2=0x7f86c010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 --2- 172.21.15.164:0/2360209255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c010c1d0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009ca0 tx=0x7f86b802c100 comp rx=0 tx=0).stop 2024-03-27T08:32:56.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 -- 172.21.15.164:0/2360209255 shutdown_connections 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 --2- 172.21.15.164:0/2360209255 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c010c1d0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 --2- 172.21.15.164:0/2360209255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 0x7f86c0105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 --2- 172.21.15.164:0/2360209255 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 0x7f86c01041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.933+0000 7f86c7000640 1 -- 172.21.15.164:0/2360209255 >> 172.21.15.164:0/2360209255 conn(0x7f86c00ff300 msgr2=0x7f86c0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.934+0000 7f86c7000640 1 -- 172.21.15.164:0/2360209255 shutdown_connections 2024-03-27T08:32:56.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.934+0000 7f86c7000640 1 -- 172.21.15.164:0/2360209255 wait complete. 2024-03-27T08:32:56.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 Processor -- start 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 -- start start 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 0x7f86c019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 0x7f86c019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010f9f0 con 0x7f86c0105940 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010f870 con 0x7f86c0104f80 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.935+0000 7f86c7000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f86c010fb70 con 0x7f86c0103d90 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33372/0 (socket says 172.21.15.164:33372) 2024-03-27T08:32:56.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 -- 172.21.15.164:0/559023917 learned_addr learned my addr 172.21.15.164:0/559023917 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86b7e00640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 0x7f86c019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86bfe00640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 0x7f86c019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 -- 172.21.15.164:0/559023917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 msgr2=0x7f86c019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 0x7f86c019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 -- 172.21.15.164:0/559023917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 msgr2=0x7f86c019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 0x7f86c019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.936+0000 7f86c5000640 1 -- 172.21.15.164:0/559023917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c01a1c20 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86c5000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009bf0 tx=0x7f86b8034cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b8039050 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f86b803a040 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86c01a1eb0 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b80045e0 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.937+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86c01a2310 con 0x7f86c0105940 2024-03-27T08:32:56.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.938+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c010b0b0 con 0x7f86c0105940 2024-03-27T08:32:56.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.940+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f86b8003970 con 0x7f86c0105940 2024-03-27T08:32:56.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.941+0000 7f86bd600640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 0x7f86a40a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:56.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.941+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f86b80f23a0 con 0x7f86c0105940 2024-03-27T08:32:56.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.942+0000 7f86bfe00640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 0x7f86a40a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:56.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.942+0000 7f86bfe00640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 0x7f86a40a5b60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f86c0104de0 tx=0x7f86b0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:56.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:56.946+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f86b80bf0d0 con 0x7f86c0105940 2024-03-27T08:32:57.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3367969000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2465528626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3367969000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2465528626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3367969000' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2465528626' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:32:57.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.146+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f86c0061f90 con 0x7f86a40a36a0 2024-03-27T08:32:57.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.160+0000 7f86bd600640 1 -- 172.21.15.164:0/559023917 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258795 (secure 0 0 0) 0x7f86c0061f90 con 0x7f86a40a36a0 2024-03-27T08:32:57.156 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:32:57.157 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 msgr2=0x7f86a40a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 0x7f86a40a5b60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f86c0104de0 tx=0x7f86b0005f90 comp rx=0 tx=0).stop 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 msgr2=0x7f86c01a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f86b8009bf0 tx=0x7f86b8034cf0 comp rx=0 tx=0).stop 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 shutdown_connections 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86a40a36a0 0x7f86a40a5b60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f86c0105940 0x7f86c01a15b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f86c0104f80 0x7f86c019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:57.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 --2- 172.21.15.164:0/559023917 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f86c0103d90 0x7f86c019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:57.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.165+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 >> 172.21.15.164:0/559023917 conn(0x7f86c00ff300 msgr2=0x7f86c0108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:57.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.166+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 shutdown_connections 2024-03-27T08:32:57.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:57.166+0000 7f86c7000640 1 -- 172.21.15.164:0/559023917 wait complete. 2024-03-27T08:32:57.177 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2024-03-27T08:32:55.304066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595359,"num_objects":58,"num_object_clones":0,"num_object_copies":174,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":58,"num_whiteouts":0,"num_read":145,"num_read_kb":125,"num_write":301,"num_write_kb":2975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362208,"kb_used_data":13040,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579616,"statfs":{"total":1151940427776,"available":1151569526784,"internally_reserved":0,"allocated":13352960,"data_stored":7228356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":4991,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.733649"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.579073+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:32:47.579073+0000","last_peered":"2024-03-27T08:32:47.579073+0000","last_clean":"2024-03-27T08:32:47.579073+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:32:47.579073+0000","last_undegraded":"2024-03-27T08:32:47.579073+0000","last_fullsized":"2024-03-27T08:32:47.579073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121536+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:32:48.121536+0000","last_peered":"2024-03-27T08:32:48.121536+0000","last_clean":"2024-03-27T08:32:48.121536+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:32:48.121536+0000","last_undegraded":"2024-03-27T08:32:48.121536+0000","last_fullsized":"2024-03-27T08:32:48.121536+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121383+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:32:48.121383+0000","last_peered":"2024-03-27T08:32:48.121383+0000","last_clean":"2024-03-27T08:32:48.121383+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:32:48.121383+0000","last_undegraded":"2024-03-27T08:32:48.121383+0000","last_fullsized":"2024-03-27T08:32:48.121383+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121021+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:32:48.121021+0000","last_peered":"2024-03-27T08:32:48.121021+0000","last_clean":"2024-03-27T08:32:48.121021+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:32:48.121021+0000","last_undegraded":"2024-03-27T08:32:48.121021+0000","last_fullsized":"2024-03-27T08:32:48.121021+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619646+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:32:47.619646+0000","last_peered":"2024-03-27T08:32:47.619646+0000","last_clean":"2024-03-27T08:32:47.619646+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:32:47.619646+0000","last_undegraded":"2024-03-27T08:32:47.619646+0000","last_fullsized":"2024-03-27T08:32:47.619646+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122312+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:32:48.122312+0000","last_peered":"2024-03-27T08:32:48.122312+0000","last_clean":"2024-03-27T08:32:48.122312+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:32:48.122312+0000","last_undegraded":"2024-03-27T08:32:48.122312+0000","last_fullsized":"2024-03-27T08:32:48.122312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578115+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:32:47.578115+0000","last_peered":"2024-03-27T08:32:47.578115+0000","last_clean":"2024-03-27T08:32:47.578115+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:32:47.578115+0000","last_undegraded":"2024-03-27T08:32:47.578115+0000","last_fullsized":"2024-03-27T08:32:47.578115+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120689+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:32:48.120689+0000","last_peered":"2024-03-27T08:32:48.120689+0000","last_clean":"2024-03-27T08:32:48.120689+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:32:48.120689+0000","last_undegraded":"2024-03-27T08:32:48.120689+0000","last_fullsized":"2024-03-27T08:32:48.120689+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.124599+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:32:48.124599+0000","last_peered":"2024-03-27T08:32:48.124599+0000","last_clean":"2024-03-27T08:32:48.124599+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:32:48.124599+0000","last_undegraded":"2024-03-27T08:32:48.124599+0000","last_fullsized":"2024-03-27T08:32:48.124599+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123289+0000","last_change":"2024-03-27T08:32:46.602846+0000","last_active":"2024-03-27T08:32:48.123289+0000","last_peered":"2024-03-27T08:32:48.123289+0000","last_clean":"2024-03-27T08:32:48.123289+0000","last_became_active":"2024-03-27T08:32:46.602524+0000","last_became_peered":"2024-03-27T08:32:46.602524+0000","last_unstale":"2024-03-27T08:32:48.123289+0000","last_undegraded":"2024-03-27T08:32:48.123289+0000","last_fullsized":"2024-03-27T08:32:48.123289+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:48.601661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578948+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:32:47.578948+0000","last_peered":"2024-03-27T08:32:47.578948+0000","last_clean":"2024-03-27T08:32:47.578948+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:32:47.578948+0000","last_undegraded":"2024-03-27T08:32:47.578948+0000","last_fullsized":"2024-03-27T08:32:47.578948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121015+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:32:48.121015+0000","last_peered":"2024-03-27T08:32:48.121015+0000","last_clean":"2024-03-27T08:32:48.121015+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:32:48.121015+0000","last_undegraded":"2024-03-27T08:32:48.121015+0000","last_fullsized":"2024-03-27T08:32:48.121015+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122670+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:32:48.122670+0000","last_peered":"2024-03-27T08:32:48.122670+0000","last_clean":"2024-03-27T08:32:48.122670+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:32:48.122670+0000","last_undegraded":"2024-03-27T08:32:48.122670+0000","last_fullsized":"2024-03-27T08:32:48.122670+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120285+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:32:48.120285+0000","last_peered":"2024-03-27T08:32:48.120285+0000","last_clean":"2024-03-27T08:32:48.120285+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:32:48.120285+0000","last_undegraded":"2024-03-27T08:32:48.120285+0000","last_fullsized":"2024-03-27T08:32:48.120285+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120133+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:32:48.120133+0000","last_peered":"2024-03-27T08:32:48.120133+0000","last_clean":"2024-03-27T08:32:48.120133+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:32:48.120133+0000","last_undegraded":"2024-03-27T08:32:48.120133+0000","last_fullsized":"2024-03-27T08:32:48.120133+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121447+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:32:48.121447+0000","last_peered":"2024-03-27T08:32:48.121447+0000","last_clean":"2024-03-27T08:32:48.121447+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:32:48.121447+0000","last_undegraded":"2024-03-27T08:32:48.121447+0000","last_fullsized":"2024-03-27T08:32:48.121447+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.579239+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:32:47.579239+0000","last_peered":"2024-03-27T08:32:47.579239+0000","last_clean":"2024-03-27T08:32:47.579239+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:32:47.579239+0000","last_undegraded":"2024-03-27T08:32:47.579239+0000","last_fullsized":"2024-03-27T08:32:47.579239+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578542+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:32:47.578542+0000","last_peered":"2024-03-27T08:32:47.578542+0000","last_clean":"2024-03-27T08:32:47.578542+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:32:47.578542+0000","last_undegraded":"2024-03-27T08:32:47.578542+0000","last_fullsized":"2024-03-27T08:32:47.578542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.976186+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:32:47.976186+0000","last_peered":"2024-03-27T08:32:47.976186+0000","last_clean":"2024-03-27T08:32:47.976186+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:32:47.976186+0000","last_undegraded":"2024-03-27T08:32:47.976186+0000","last_fullsized":"2024-03-27T08:32:47.976186+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":25,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.227207+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:32:51.227207+0000","last_peered":"2024-03-27T08:32:51.227207+0000","last_clean":"2024-03-27T08:32:51.227207+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:32:51.227207+0000","last_undegraded":"2024-03-27T08:32:51.227207+0000","last_fullsized":"2024-03-27T08:32:51.227207+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122904+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:32:48.122904+0000","last_peered":"2024-03-27T08:32:48.122904+0000","last_clean":"2024-03-27T08:32:48.122904+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:32:48.122904+0000","last_undegraded":"2024-03-27T08:32:48.122904+0000","last_fullsized":"2024-03-27T08:32:48.122904+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.443567+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:32:48.443567+0000","last_peered":"2024-03-27T08:32:48.443567+0000","last_clean":"2024-03-27T08:32:48.443567+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:32:48.443567+0000","last_undegraded":"2024-03-27T08:32:48.443567+0000","last_fullsized":"2024-03-27T08:32:48.443567+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122152+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:32:48.122152+0000","last_peered":"2024-03-27T08:32:48.122152+0000","last_clean":"2024-03-27T08:32:48.122152+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:32:48.122152+0000","last_undegraded":"2024-03-27T08:32:48.122152+0000","last_fullsized":"2024-03-27T08:32:48.122152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.223425+0000","last_change":"2024-03-27T08:32:45.588190+0000","last_active":"2024-03-27T08:32:51.223425+0000","last_peered":"2024-03-27T08:32:51.223425+0000","last_clean":"2024-03-27T08:32:51.223425+0000","last_became_active":"2024-03-27T08:32:45.587462+0000","last_became_peered":"2024-03-27T08:32:45.587462+0000","last_unstale":"2024-03-27T08:32:51.223425+0000","last_undegraded":"2024-03-27T08:32:51.223425+0000","last_fullsized":"2024-03-27T08:32:51.223425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:05:49.965930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123603+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:32:48.123603+0000","last_peered":"2024-03-27T08:32:48.123603+0000","last_clean":"2024-03-27T08:32:48.123603+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:32:48.123603+0000","last_undegraded":"2024-03-27T08:32:48.123603+0000","last_fullsized":"2024-03-27T08:32:48.123603+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619950+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:32:47.619950+0000","last_peered":"2024-03-27T08:32:47.619950+0000","last_clean":"2024-03-27T08:32:47.619950+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:32:47.619950+0000","last_undegraded":"2024-03-27T08:32:47.619950+0000","last_fullsized":"2024-03-27T08:32:47.619950+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121702+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:32:48.121702+0000","last_peered":"2024-03-27T08:32:48.121702+0000","last_clean":"2024-03-27T08:32:48.121702+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:32:48.121702+0000","last_undegraded":"2024-03-27T08:32:48.121702+0000","last_fullsized":"2024-03-27T08:32:48.121702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":27,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:53.688665+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:32:53.688665+0000","last_peered":"2024-03-27T08:32:53.688665+0000","last_clean":"2024-03-27T08:32:53.688665+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:32:53.688665+0000","last_undegraded":"2024-03-27T08:32:53.688665+0000","last_fullsized":"2024-03-27T08:32:53.688665+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619588+0000","last_change":"2024-03-27T08:32:46.599365+0000","last_active":"2024-03-27T08:32:47.619588+0000","last_peered":"2024-03-27T08:32:47.619588+0000","last_clean":"2024-03-27T08:32:47.619588+0000","last_became_active":"2024-03-27T08:32:46.599043+0000","last_became_peered":"2024-03-27T08:32:46.599043+0000","last_unstale":"2024-03-27T08:32:47.619588+0000","last_undegraded":"2024-03-27T08:32:47.619588+0000","last_fullsized":"2024-03-27T08:32:47.619588+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:30:48.800769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.221638+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:32:51.221638+0000","last_peered":"2024-03-27T08:32:51.221638+0000","last_clean":"2024-03-27T08:32:51.221638+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:32:51.221638+0000","last_undegraded":"2024-03-27T08:32:51.221638+0000","last_fullsized":"2024-03-27T08:32:51.221638+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121221+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:32:48.121221+0000","last_peered":"2024-03-27T08:32:48.121221+0000","last_clean":"2024-03-27T08:32:48.121221+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:32:48.121221+0000","last_undegraded":"2024-03-27T08:32:48.121221+0000","last_fullsized":"2024-03-27T08:32:48.121221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.221560+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:32:51.221560+0000","last_peered":"2024-03-27T08:32:51.221560+0000","last_clean":"2024-03-27T08:32:51.221560+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:32:51.221560+0000","last_undegraded":"2024-03-27T08:32:51.221560+0000","last_fullsized":"2024-03-27T08:32:51.221560+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121660+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:32:48.121660+0000","last_peered":"2024-03-27T08:32:48.121660+0000","last_clean":"2024-03-27T08:32:48.121660+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:32:48.121660+0000","last_undegraded":"2024-03-27T08:32:48.121660+0000","last_fullsized":"2024-03-27T08:32:48.121660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.903488+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:32:48.903488+0000","last_peered":"2024-03-27T08:32:48.903488+0000","last_clean":"2024-03-27T08:32:48.903488+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:32:48.903488+0000","last_undegraded":"2024-03-27T08:32:48.903488+0000","last_fullsized":"2024-03-27T08:32:48.903488+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578540+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:32:47.578540+0000","last_peered":"2024-03-27T08:32:47.578540+0000","last_clean":"2024-03-27T08:32:47.578540+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:32:47.578540+0000","last_undegraded":"2024-03-27T08:32:47.578540+0000","last_fullsized":"2024-03-27T08:32:47.578540+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216055+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:32:50.216055+0000","last_peered":"2024-03-27T08:32:50.216055+0000","last_clean":"2024-03-27T08:32:50.216055+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:32:50.216055+0000","last_undegraded":"2024-03-27T08:32:50.216055+0000","last_fullsized":"2024-03-27T08:32:50.216055+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.124197+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:32:48.124197+0000","last_peered":"2024-03-27T08:32:48.124197+0000","last_clean":"2024-03-27T08:32:48.124197+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:32:48.124197+0000","last_undegraded":"2024-03-27T08:32:48.124197+0000","last_fullsized":"2024-03-27T08:32:48.124197+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215702+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:32:50.215702+0000","last_peered":"2024-03-27T08:32:50.215702+0000","last_clean":"2024-03-27T08:32:50.215702+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:32:50.215702+0000","last_undegraded":"2024-03-27T08:32:50.215702+0000","last_fullsized":"2024-03-27T08:32:50.215702+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121996+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:32:48.121996+0000","last_peered":"2024-03-27T08:32:48.121996+0000","last_clean":"2024-03-27T08:32:48.121996+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:32:48.121996+0000","last_undegraded":"2024-03-27T08:32:48.121996+0000","last_fullsized":"2024-03-27T08:32:48.121996+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215064+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:32:50.215064+0000","last_peered":"2024-03-27T08:32:50.215064+0000","last_clean":"2024-03-27T08:32:50.215064+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:32:50.215064+0000","last_undegraded":"2024-03-27T08:32:50.215064+0000","last_fullsized":"2024-03-27T08:32:50.215064+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123792+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:32:48.123792+0000","last_peered":"2024-03-27T08:32:48.123792+0000","last_clean":"2024-03-27T08:32:48.123792+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:32:48.123792+0000","last_undegraded":"2024-03-27T08:32:48.123792+0000","last_fullsized":"2024-03-27T08:32:48.123792+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"88'8","reported_seq":23,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216347+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:32:50.216347+0000","last_peered":"2024-03-27T08:32:50.216347+0000","last_clean":"2024-03-27T08:32:50.216347+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:32:50.216347+0000","last_undegraded":"2024-03-27T08:32:50.216347+0000","last_fullsized":"2024-03-27T08:32:50.216347+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619925+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:32:47.619925+0000","last_peered":"2024-03-27T08:32:47.619925+0000","last_clean":"2024-03-27T08:32:47.619925+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:32:47.619925+0000","last_undegraded":"2024-03-27T08:32:47.619925+0000","last_fullsized":"2024-03-27T08:32:47.619925+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.222371+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:32:51.222371+0000","last_peered":"2024-03-27T08:32:51.222371+0000","last_clean":"2024-03-27T08:32:51.222371+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:32:51.222371+0000","last_undegraded":"2024-03-27T08:32:51.222371+0000","last_fullsized":"2024-03-27T08:32:51.222371+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121095+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:32:48.121095+0000","last_peered":"2024-03-27T08:32:48.121095+0000","last_clean":"2024-03-27T08:32:48.121095+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:32:48.121095+0000","last_undegraded":"2024-03-27T08:32:48.121095+0000","last_fullsized":"2024-03-27T08:32:48.121095+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.215242+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:32:50.215242+0000","last_peered":"2024-03-27T08:32:50.215242+0000","last_clean":"2024-03-27T08:32:50.215242+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:32:50.215242+0000","last_undegraded":"2024-03-27T08:32:50.215242+0000","last_fullsized":"2024-03-27T08:32:50.215242+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578142+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:32:47.578142+0000","last_peered":"2024-03-27T08:32:47.578142+0000","last_clean":"2024-03-27T08:32:47.578142+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:32:47.578142+0000","last_undegraded":"2024-03-27T08:32:47.578142+0000","last_fullsized":"2024-03-27T08:32:47.578142+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121703+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:32:48.121703+0000","last_peered":"2024-03-27T08:32:48.121703+0000","last_clean":"2024-03-27T08:32:48.121703+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:32:48.121703+0000","last_undegraded":"2024-03-27T08:32:48.121703+0000","last_fullsized":"2024-03-27T08:32:48.121703+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577657+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:32:47.577657+0000","last_peered":"2024-03-27T08:32:47.577657+0000","last_clean":"2024-03-27T08:32:47.577657+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:32:47.577657+0000","last_undegraded":"2024-03-27T08:32:47.577657+0000","last_fullsized":"2024-03-27T08:32:47.577657+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":31,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.228675+0000","last_change":"2024-03-27T08:32:45.578408+0000","last_active":"2024-03-27T08:32:51.228675+0000","last_peered":"2024-03-27T08:32:51.228675+0000","last_clean":"2024-03-27T08:32:51.228675+0000","last_became_active":"2024-03-27T08:32:45.574888+0000","last_became_peered":"2024-03-27T08:32:45.574888+0000","last_unstale":"2024-03-27T08:32:51.228675+0000","last_undegraded":"2024-03-27T08:32:51.228675+0000","last_fullsized":"2024-03-27T08:32:51.228675+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:44:24.101352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120958+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:32:48.120958+0000","last_peered":"2024-03-27T08:32:48.120958+0000","last_clean":"2024-03-27T08:32:48.120958+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:32:48.120958+0000","last_undegraded":"2024-03-27T08:32:48.120958+0000","last_fullsized":"2024-03-27T08:32:48.120958+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.675807+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:32:51.675807+0000","last_peered":"2024-03-27T08:32:51.675807+0000","last_clean":"2024-03-27T08:32:51.675807+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:32:51.675807+0000","last_undegraded":"2024-03-27T08:32:51.675807+0000","last_fullsized":"2024-03-27T08:32:51.675807+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578798+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:32:47.578798+0000","last_peered":"2024-03-27T08:32:47.578798+0000","last_clean":"2024-03-27T08:32:47.578798+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:32:47.578798+0000","last_undegraded":"2024-03-27T08:32:47.578798+0000","last_fullsized":"2024-03-27T08:32:47.578798+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578030+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:32:47.578030+0000","last_peered":"2024-03-27T08:32:47.578030+0000","last_clean":"2024-03-27T08:32:47.578030+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:32:47.578030+0000","last_undegraded":"2024-03-27T08:32:47.578030+0000","last_fullsized":"2024-03-27T08:32:47.578030+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122981+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:32:48.122981+0000","last_peered":"2024-03-27T08:32:48.122981+0000","last_clean":"2024-03-27T08:32:48.122981+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:32:48.122981+0000","last_undegraded":"2024-03-27T08:32:48.122981+0000","last_fullsized":"2024-03-27T08:32:48.122981+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577896+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:32:47.577896+0000","last_peered":"2024-03-27T08:32:47.577896+0000","last_clean":"2024-03-27T08:32:47.577896+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:32:47.577896+0000","last_undegraded":"2024-03-27T08:32:47.577896+0000","last_fullsized":"2024-03-27T08:32:47.577896+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122276+0000","last_change":"2024-03-27T08:32:46.598137+0000","last_active":"2024-03-27T08:32:48.122276+0000","last_peered":"2024-03-27T08:32:48.122276+0000","last_clean":"2024-03-27T08:32:48.122276+0000","last_became_active":"2024-03-27T08:32:46.597741+0000","last_became_peered":"2024-03-27T08:32:46.597741+0000","last_unstale":"2024-03-27T08:32:48.122276+0000","last_undegraded":"2024-03-27T08:32:48.122276+0000","last_fullsized":"2024-03-27T08:32:48.122276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:46:02.022020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121362+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:32:48.121362+0000","last_peered":"2024-03-27T08:32:48.121362+0000","last_clean":"2024-03-27T08:32:48.121362+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:32:48.121362+0000","last_undegraded":"2024-03-27T08:32:48.121362+0000","last_fullsized":"2024-03-27T08:32:48.121362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":22,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:52.687199+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:32:52.687199+0000","last_peered":"2024-03-27T08:32:52.687199+0000","last_clean":"2024-03-27T08:32:52.687199+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:32:52.687199+0000","last_undegraded":"2024-03-27T08:32:52.687199+0000","last_fullsized":"2024-03-27T08:32:52.687199+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122136+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:32:48.122136+0000","last_peered":"2024-03-27T08:32:48.122136+0000","last_clean":"2024-03-27T08:32:48.122136+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:32:48.122136+0000","last_undegraded":"2024-03-27T08:32:48.122136+0000","last_fullsized":"2024-03-27T08:32:48.122136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.209988+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:32:50.209988+0000","last_peered":"2024-03-27T08:32:50.209988+0000","last_clean":"2024-03-27T08:32:50.209988+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:32:50.209988+0000","last_undegraded":"2024-03-27T08:32:50.209988+0000","last_fullsized":"2024-03-27T08:32:50.209988+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":342,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577463+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:32:47.577463+0000","last_peered":"2024-03-27T08:32:47.577463+0000","last_clean":"2024-03-27T08:32:47.577463+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:32:47.577463+0000","last_undegraded":"2024-03-27T08:32:47.577463+0000","last_fullsized":"2024-03-27T08:32:47.577463+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120253+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:32:48.120253+0000","last_peered":"2024-03-27T08:32:48.120253+0000","last_clean":"2024-03-27T08:32:48.120253+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:32:48.120253+0000","last_undegraded":"2024-03-27T08:32:48.120253+0000","last_fullsized":"2024-03-27T08:32:48.120253+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.577902+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:32:47.577902+0000","last_peered":"2024-03-27T08:32:47.577902+0000","last_clean":"2024-03-27T08:32:47.577902+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:32:47.577902+0000","last_undegraded":"2024-03-27T08:32:47.577902+0000","last_fullsized":"2024-03-27T08:32:47.577902+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.213646+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:32:50.213646+0000","last_peered":"2024-03-27T08:32:50.213646+0000","last_clean":"2024-03-27T08:32:50.213646+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:32:50.213646+0000","last_undegraded":"2024-03-27T08:32:50.213646+0000","last_fullsized":"2024-03-27T08:32:50.213646+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121443+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:32:48.121443+0000","last_peered":"2024-03-27T08:32:48.121443+0000","last_clean":"2024-03-27T08:32:48.121443+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:32:48.121443+0000","last_undegraded":"2024-03-27T08:32:48.121443+0000","last_fullsized":"2024-03-27T08:32:48.121443+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.224424+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:32:51.224424+0000","last_peered":"2024-03-27T08:32:51.224424+0000","last_clean":"2024-03-27T08:32:51.224424+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:32:51.224424+0000","last_undegraded":"2024-03-27T08:32:51.224424+0000","last_fullsized":"2024-03-27T08:32:51.224424+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123366+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:32:48.123366+0000","last_peered":"2024-03-27T08:32:48.123366+0000","last_clean":"2024-03-27T08:32:48.123366+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:32:48.123366+0000","last_undegraded":"2024-03-27T08:32:48.123366+0000","last_fullsized":"2024-03-27T08:32:48.123366+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.214556+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:32:50.214556+0000","last_peered":"2024-03-27T08:32:50.214556+0000","last_clean":"2024-03-27T08:32:50.214556+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:32:50.214556+0000","last_undegraded":"2024-03-27T08:32:50.214556+0000","last_fullsized":"2024-03-27T08:32:50.214556+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121695+0000","last_change":"2024-03-27T08:32:46.595674+0000","last_active":"2024-03-27T08:32:48.121695+0000","last_peered":"2024-03-27T08:32:48.121695+0000","last_clean":"2024-03-27T08:32:48.121695+0000","last_became_active":"2024-03-27T08:32:46.595281+0000","last_became_peered":"2024-03-27T08:32:46.595281+0000","last_unstale":"2024-03-27T08:32:48.121695+0000","last_undegraded":"2024-03-27T08:32:48.121695+0000","last_fullsized":"2024-03-27T08:32:48.121695+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:52:24.218811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.213501+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:32:50.213501+0000","last_peered":"2024-03-27T08:32:50.213501+0000","last_clean":"2024-03-27T08:32:50.213501+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:32:50.213501+0000","last_undegraded":"2024-03-27T08:32:50.213501+0000","last_fullsized":"2024-03-27T08:32:50.213501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.619353+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:32:47.619353+0000","last_peered":"2024-03-27T08:32:47.619353+0000","last_clean":"2024-03-27T08:32:47.619353+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:32:47.619353+0000","last_undegraded":"2024-03-27T08:32:47.619353+0000","last_fullsized":"2024-03-27T08:32:47.619353+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":18,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.211501+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:32:50.211501+0000","last_peered":"2024-03-27T08:32:50.211501+0000","last_clean":"2024-03-27T08:32:50.211501+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:32:50.211501+0000","last_undegraded":"2024-03-27T08:32:50.211501+0000","last_fullsized":"2024-03-27T08:32:50.211501+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578382+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:32:47.578382+0000","last_peered":"2024-03-27T08:32:47.578382+0000","last_clean":"2024-03-27T08:32:47.578382+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:32:47.578382+0000","last_undegraded":"2024-03-27T08:32:47.578382+0000","last_fullsized":"2024-03-27T08:32:47.578382+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":16,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975398+0000","last_change":"2024-03-27T08:32:45.582156+0000","last_active":"2024-03-27T08:32:47.975398+0000","last_peered":"2024-03-27T08:32:47.975398+0000","last_clean":"2024-03-27T08:32:47.975398+0000","last_became_active":"2024-03-27T08:32:45.581790+0000","last_became_peered":"2024-03-27T08:32:45.581790+0000","last_unstale":"2024-03-27T08:32:47.975398+0000","last_undegraded":"2024-03-27T08:32:47.975398+0000","last_fullsized":"2024-03-27T08:32:47.975398+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:26:48.776634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122273+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:32:48.122273+0000","last_peered":"2024-03-27T08:32:48.122273+0000","last_clean":"2024-03-27T08:32:48.122273+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:32:48.122273+0000","last_undegraded":"2024-03-27T08:32:48.122273+0000","last_fullsized":"2024-03-27T08:32:48.122273+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":20,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:50.216862+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:32:50.216862+0000","last_peered":"2024-03-27T08:32:50.216862+0000","last_clean":"2024-03-27T08:32:50.216862+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:32:50.216862+0000","last_undegraded":"2024-03-27T08:32:50.216862+0000","last_fullsized":"2024-03-27T08:32:50.216862+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578126+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:32:47.578126+0000","last_peered":"2024-03-27T08:32:47.578126+0000","last_clean":"2024-03-27T08:32:47.578126+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:32:47.578126+0000","last_undegraded":"2024-03-27T08:32:47.578126+0000","last_fullsized":"2024-03-27T08:32:47.578126+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":19,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:51.227125+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:32:51.227125+0000","last_peered":"2024-03-27T08:32:51.227125+0000","last_clean":"2024-03-27T08:32:51.227125+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:32:51.227125+0000","last_undegraded":"2024-03-27T08:32:51.227125+0000","last_fullsized":"2024-03-27T08:32:51.227125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578704+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:32:47.578704+0000","last_peered":"2024-03-27T08:32:47.578704+0000","last_clean":"2024-03-27T08:32:47.578704+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:32:47.578704+0000","last_undegraded":"2024-03-27T08:32:47.578704+0000","last_fullsized":"2024-03-27T08:32:47.578704+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.903593+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:32:48.903593+0000","last_peered":"2024-03-27T08:32:48.903593+0000","last_clean":"2024-03-27T08:32:48.903593+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:32:48.903593+0000","last_undegraded":"2024-03-27T08:32:48.903593+0000","last_fullsized":"2024-03-27T08:32:48.903593+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578213+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:32:47.578213+0000","last_peered":"2024-03-27T08:32:47.578213+0000","last_clean":"2024-03-27T08:32:47.578213+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:32:47.578213+0000","last_undegraded":"2024-03-27T08:32:47.578213+0000","last_fullsized":"2024-03-27T08:32:47.578213+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122125+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:32:48.122125+0000","last_peered":"2024-03-27T08:32:48.122125+0000","last_clean":"2024-03-27T08:32:48.122125+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:32:48.122125+0000","last_undegraded":"2024-03-27T08:32:48.122125+0000","last_fullsized":"2024-03-27T08:32:48.122125+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578849+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:32:47.578849+0000","last_peered":"2024-03-27T08:32:47.578849+0000","last_clean":"2024-03-27T08:32:47.578849+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:32:47.578849+0000","last_undegraded":"2024-03-27T08:32:47.578849+0000","last_fullsized":"2024-03-27T08:32:47.578849+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578489+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:32:47.578489+0000","last_peered":"2024-03-27T08:32:47.578489+0000","last_clean":"2024-03-27T08:32:47.578489+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:32:47.578489+0000","last_undegraded":"2024-03-27T08:32:47.578489+0000","last_fullsized":"2024-03-27T08:32:47.578489+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975496+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:32:47.975496+0000","last_peered":"2024-03-27T08:32:47.975496+0000","last_clean":"2024-03-27T08:32:47.975496+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:32:47.975496+0000","last_undegraded":"2024-03-27T08:32:47.975496+0000","last_fullsized":"2024-03-27T08:32:47.975496+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.975373+0000","last_change":"2024-03-27T08:32:46.602630+0000","last_active":"2024-03-27T08:32:47.975373+0000","last_peered":"2024-03-27T08:32:47.975373+0000","last_clean":"2024-03-27T08:32:47.975373+0000","last_became_active":"2024-03-27T08:32:46.601734+0000","last_became_peered":"2024-03-27T08:32:46.601734+0000","last_unstale":"2024-03-27T08:32:47.975373+0000","last_undegraded":"2024-03-27T08:32:47.975373+0000","last_fullsized":"2024-03-27T08:32:47.975373+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:37:19.612907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.120700+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:32:48.120700+0000","last_peered":"2024-03-27T08:32:48.120700+0000","last_clean":"2024-03-27T08:32:48.120700+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:32:48.120700+0000","last_undegraded":"2024-03-27T08:32:48.120700+0000","last_fullsized":"2024-03-27T08:32:48.120700+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121654+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:32:48.121654+0000","last_peered":"2024-03-27T08:32:48.121654+0000","last_clean":"2024-03-27T08:32:48.121654+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:32:48.121654+0000","last_undegraded":"2024-03-27T08:32:48.121654+0000","last_fullsized":"2024-03-27T08:32:48.121654+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578785+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:32:47.578785+0000","last_peered":"2024-03-27T08:32:47.578785+0000","last_clean":"2024-03-27T08:32:47.578785+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:32:47.578785+0000","last_undegraded":"2024-03-27T08:32:47.578785+0000","last_fullsized":"2024-03-27T08:32:47.578785+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.977073+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:32:47.977073+0000","last_peered":"2024-03-27T08:32:47.977073+0000","last_clean":"2024-03-27T08:32:47.977073+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:32:47.977073+0000","last_undegraded":"2024-03-27T08:32:47.977073+0000","last_fullsized":"2024-03-27T08:32:47.977073+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123203+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:32:48.123203+0000","last_peered":"2024-03-27T08:32:48.123203+0000","last_clean":"2024-03-27T08:32:48.123203+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:32:48.123203+0000","last_undegraded":"2024-03-27T08:32:48.123203+0000","last_fullsized":"2024-03-27T08:32:48.123203+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121136+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:32:48.121136+0000","last_peered":"2024-03-27T08:32:48.121136+0000","last_clean":"2024-03-27T08:32:48.121136+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:32:48.121136+0000","last_undegraded":"2024-03-27T08:32:48.121136+0000","last_fullsized":"2024-03-27T08:32:48.121136+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.121249+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:32:48.121249+0000","last_peered":"2024-03-27T08:32:48.121249+0000","last_clean":"2024-03-27T08:32:48.121249+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:32:48.121249+0000","last_undegraded":"2024-03-27T08:32:48.121249+0000","last_fullsized":"2024-03-27T08:32:48.121249+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.123558+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:32:48.123558+0000","last_peered":"2024-03-27T08:32:48.123558+0000","last_clean":"2024-03-27T08:32:48.123558+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:32:48.123558+0000","last_undegraded":"2024-03-27T08:32:48.123558+0000","last_fullsized":"2024-03-27T08:32:48.123558+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:48.122473+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:32:48.122473+0000","last_peered":"2024-03-27T08:32:48.122473+0000","last_clean":"2024-03-27T08:32:48.122473+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:32:48.122473+0000","last_undegraded":"2024-03-27T08:32:48.122473+0000","last_fullsized":"2024-03-27T08:32:48.122473+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2024-03-27T08:32:47.578148+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:32:47.578148+0000","last_peered":"2024-03-27T08:32:47.578148+0000","last_clean":"2024-03-27T08:32:47.578148+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:32:47.578148+0000","last_undegraded":"2024-03-27T08:32:47.578148+0000","last_fullsized":"2024-03-27T08:32:47.578148+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4991,"num_objects":56,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":120,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":38,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":270336,"data_stored":51428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":103,"ondisk_log_size":103,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285584,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":946176,"data_stored":451142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547223,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28560,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716592,"statfs":{"total":95995035648,"available":95965790208,"internally_reserved":0,"allocated":1581056,"data_stored":1044118,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710749,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972388,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27956,"kb_used_data":940,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717196,"statfs":{"total":95995035648,"available":95966408704,"internally_reserved":0,"allocated":962560,"data_stored":451298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234029,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32692,"kb_used_data":1504,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712460,"statfs":{"total":95995035648,"available":95961559040,"internally_reserved":0,"allocated":1540096,"data_stored":1041510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430259,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":928,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":950272,"data_stored":450767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36304,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708848,"statfs":{"total":95995035648,"available":95957860352,"internally_reserved":0,"allocated":991232,"data_stored":488753,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36284,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708868,"statfs":{"total":95995035648,"available":95957880832,"internally_reserved":0,"allocated":970752,"data_stored":452038,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":453522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117064,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32112,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713040,"statfs":{"total":95995035648,"available":95962152960,"internally_reserved":0,"allocated":958464,"data_stored":450844,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855425,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27944,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717208,"statfs":{"total":95995035648,"available":95966420992,"internally_reserved":0,"allocated":946176,"data_stored":450582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691897,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1042404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":38193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:32:57.182 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-27T08:32:57.182 INFO:tasks.cephadm:Setting up client nodes... 2024-03-27T08:32:57.183 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-27T08:32:57.662 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:32:57.952 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:57 smithi164 ceph-mon[31788]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:57.952 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:57 smithi164 ceph-mon[31788]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:57.952 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:32:57 smithi164 ceph-mon[31788]: pgmap v368: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-03-27T08:32:58.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:57 smithi167 ceph-mon[34903]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:58.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:57 smithi167 ceph-mon[34903]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:58.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:32:57 smithi167 ceph-mon[34903]: pgmap v368: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-03-27T08:32:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:57 smithi173 ceph-mon[35397]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:57 smithi173 ceph-mon[35397]: from='client.14802 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:32:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:32:57 smithi173 ceph-mon[35397]: pgmap v368: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 8.5 KiB/s wr, 18 op/s 2024-03-27T08:32:59.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 -- 172.21.15.164:0/190649059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608103890 msgr2=0x7f8608103cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:59.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 --2- 172.21.15.164:0/190649059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608103890 0x7f8608103cf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f85f40099c0 tx=0x7f85f4009cd0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.888 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 -- 172.21.15.164:0/190649059 shutdown_connections 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 --2- 172.21.15.164:0/190649059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608104230 0x7f860810aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 --2- 172.21.15.164:0/190649059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608102690 0x7f8608102ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 --2- 172.21.15.164:0/190649059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608103890 0x7f8608103cf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 -- 172.21.15.164:0/190649059 >> 172.21.15.164:0/190649059 conn(0x7f86080fdc50 msgr2=0x7f8608100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 -- 172.21.15.164:0/190649059 shutdown_connections 2024-03-27T08:32:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.895+0000 7f8610400700 1 -- 172.21.15.164:0/190649059 wait complete. 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.897+0000 7f8610400700 1 Processor -- start 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.897+0000 7f8610400700 1 -- start start 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.897+0000 7f8610400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608102690 0x7f860819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.897+0000 7f8610400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608103890 0x7f860819aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.897+0000 7f8610400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f8610400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f860810e1f0 con 0x7f8608104230 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f8610400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f860810e070 con 0x7f8608102690 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f8610400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f860810e370 con 0x7f8608103890 2024-03-27T08:32:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33388/0 (socket says 172.21.15.164:33388) 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 -- 172.21.15.164:0/2477516012 learned_addr learned my addr 172.21.15.164:0/2477516012 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860da00700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608102690 0x7f860819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860d000700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608103890 0x7f860819aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 -- 172.21.15.164:0/2477516012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608103890 msgr2=0x7f860819aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608103890 0x7f860819aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 -- 172.21.15.164:0/2477516012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608102690 msgr2=0x7f860819a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608102690 0x7f860819a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.898+0000 7f860e400700 1 -- 172.21.15.164:0/2477516012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86081a25e0 con 0x7f8608104230 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f860e400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8600007f10 tx=0x7f860000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f860000ddd0 con 0x7f8608104230 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8600004020 con 0x7f8608104230 2024-03-27T08:32:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86081a28d0 con 0x7f8608104230 2024-03-27T08:32:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8600015660 con 0x7f8608104230 2024-03-27T08:32:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.899+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86081a2dc0 con 0x7f8608104230 2024-03-27T08:32:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.900+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8608050b50 con 0x7f8608104230 2024-03-27T08:32:59.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.902+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f86000041d0 con 0x7f8608104230 2024-03-27T08:32:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.903+0000 7f8606000700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 0x7f85f00a5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:32:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.904+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f86000cf9b0 con 0x7f8608104230 2024-03-27T08:32:59.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.904+0000 7f860da00700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 0x7f85f00a5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:32:59.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.904+0000 7f860da00700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 0x7f85f00a5ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc005fd0 tx=0x7f85fc005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:32:59.900 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:32:59.908+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8600010070 con 0x7f8608104230 2024-03-27T08:33:00.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.215+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f86081a31e0 con 0x7f8608104230 2024-03-27T08:33:00.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.219+0000 7f8606000700 1 -- 172.21.15.164:0/2477516012 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v33) ==== 170+0+59 (secure 0 0 0) 0x7f860009c4d0 con 0x7f8608104230 2024-03-27T08:33:00.211 INFO:teuthology.orchestra.run.smithi164.stdout:[client.0] 2024-03-27T08:33:00.212 INFO:teuthology.orchestra.run.smithi164.stdout: key = AQC82QNmpWDwDBAAIoWntIt3DovLNZbRoFmQPw== 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.222+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 msgr2=0x7f85f00a5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.222+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 0x7f85f00a5ca0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f85fc005fd0 tx=0x7f85fc005e50 comp rx=0 tx=0).stop 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.222+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 msgr2=0x7f86081a1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.222+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f8600007f10 tx=0x7f860000d3b0 comp rx=0 tx=0).stop 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 shutdown_connections 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85f00a37e0 0x7f85f00a5ca0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8608104230 0x7f86081a1f40 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8608102690 0x7f860819a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 --2- 172.21.15.164:0/2477516012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8608103890 0x7f860819aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 >> 172.21.15.164:0/2477516012 conn(0x7f86080fdc50 msgr2=0x7f8608074870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 shutdown_connections 2024-03-27T08:33:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:00.223+0000 7f8610400700 1 -- 172.21.15.164:0/2477516012 wait complete. 2024-03-27T08:33:00.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:00 smithi164 ceph-mon[31788]: pgmap v369: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-03-27T08:33:00.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T08:33:00.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T08:33:00.779 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:00 smithi173 ceph-mon[35397]: pgmap v369: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-03-27T08:33:00.779 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T08:33:00.779 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T08:33:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:00 smithi167 ceph-mon[34903]: pgmap v369: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 6.8 KiB/s wr, 15 op/s 2024-03-27T08:33:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-27T08:33:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2477516012' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-27T08:33:00.943 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:33:00.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-27T08:33:00.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-27T08:33:01.081 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-27T08:33:01.081 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-27T08:33:01.082 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph mgr dump --format=json 2024-03-27T08:33:01.556 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:02.716 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:02 smithi164 ceph-mon[31788]: pgmap v370: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T08:33:02.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:02 smithi167 ceph-mon[34903]: pgmap v370: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T08:33:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:02 smithi173 ceph-mon[35397]: pgmap v370: 97 pgs: 97 active+clean; 623 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 6.4 KiB/s wr, 14 op/s 2024-03-27T08:33:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.856+0000 7fad1b600700 1 -- 172.21.15.164:0/2737768419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14102690 msgr2=0x7fad14102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:03.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 --2- 172.21.15.164:0/2737768419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14102690 0x7fad14102b10 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facfc0099c0 tx=0x7facfc009cd0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 -- 172.21.15.164:0/2737768419 shutdown_connections 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 --2- 172.21.15.164:0/2737768419 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad1410f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 --2- 172.21.15.164:0/2737768419 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14108670 0x7fad14108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 --2- 172.21.15.164:0/2737768419 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14102690 0x7fad14102b10 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 -- 172.21.15.164:0/2737768419 >> 172.21.15.164:0/2737768419 conn(0x7fad14079770 msgr2=0x7fad14079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 -- 172.21.15.164:0/2737768419 shutdown_connections 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.857+0000 7fad1b600700 1 -- 172.21.15.164:0/2737768419 wait complete. 2024-03-27T08:33:03.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 Processor -- start 2024-03-27T08:33:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 -- start start 2024-03-27T08:33:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14102690 0x7fad14074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:03.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 0x7fad140753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112940 con 0x7fad14108670 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fad141127c0 con 0x7fad14103050 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.858+0000 7fad1b600700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fad14112ac0 con 0x7fad14102690 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad19600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 0x7fad140753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:44212/0 (socket says 172.21.15.164:44212) 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad19600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 0x7fad140753c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33406/0 (socket says 172.21.15.164:33406) 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 -- 172.21.15.164:0/1622224656 learned_addr learned my addr 172.21.15.164:0/1622224656 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad18c00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14102690 0x7fad14074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 -- 172.21.15.164:0/1622224656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14102690 msgr2=0x7fad14074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14102690 0x7fad14074940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 -- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 msgr2=0x7fad140753c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 0x7fad140753c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.859+0000 7fad0be00700 1 -- 172.21.15.164:0/1622224656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad141a7340 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad0be00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc003af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc009e60 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad141a75d0 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7facfc005590 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facfc0173f0 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.860+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad141a7a80 con 0x7fad14103050 2024-03-27T08:33:03.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.861+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad14069300 con 0x7fad14103050 2024-03-27T08:33:03.855 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.863+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7facfc00f680 con 0x7fad14103050 2024-03-27T08:33:03.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.865+0000 7fad12000700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 0x7facf80a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:03.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.865+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7facfc0d0c00 con 0x7fad14103050 2024-03-27T08:33:03.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.865+0000 7fad18c00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 0x7facf80a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:03.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.866+0000 7fad18c00700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 0x7facf80a5bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad040076e0 tx=0x7fad04007670 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:03.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:03.877+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7facfc013070 con 0x7fad14103050 2024-03-27T08:33:04.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.166+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fad1402dd30 con 0x7fad14103050 2024-03-27T08:33:04.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.183+0000 7fad12000700 1 -- 172.21.15.164:0/1622224656 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264404 (secure 0 0 0) 0x7facfc09d7b0 con 0x7fad14103050 2024-03-27T08:33:04.179 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:33:04.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.190+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 msgr2=0x7facf80a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:04.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.190+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 0x7facf80a5bf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fad040076e0 tx=0x7fad04007670 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.190+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 msgr2=0x7fad14074e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.190+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7facfc006010 tx=0x7facfc003af0 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 shutdown_connections 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7facf80a3730 0x7facf80a5bf0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fad14108670 0x7fad140753c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fad14102690 0x7fad14074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 --2- 172.21.15.164:0/1622224656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fad14103050 0x7fad14074e80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 >> 172.21.15.164:0/1622224656 conn(0x7fad14079770 msgr2=0x7fad14101340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 shutdown_connections 2024-03-27T08:33:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:04.191+0000 7fad1b600700 1 -- 172.21.15.164:0/1622224656 wait complete. 2024-03-27T08:33:04.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:04 smithi164 ceph-mon[31788]: pgmap v371: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-27T08:33:04.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1622224656' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T08:33:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:04 smithi167 ceph-mon[34903]: pgmap v371: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-27T08:33:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1622224656' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T08:33:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:04 smithi173 ceph-mon[35397]: pgmap v371: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.7 KiB/s rd, 7.2 KiB/s wr, 15 op/s 2024-03-27T08:33:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1622224656' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-27T08:33:04.982 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6800","nonce":2033158356},{"type":"v1","addr":"172.21.15.164:6801","nonce":2033158356}]},"active_addr":"172.21.15.164:6801/2033158356","active_change":"2024-03-27T08:23:17.136750+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24112,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":34106,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.164:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3102073747}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2130653247}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2568457324}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":2885242958}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.164:0","nonce":3850537435}]}]} 2024-03-27T08:33:04.987 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-27T08:33:04.988 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-27T08:33:04.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T08:33:05.433 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:06.590 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:06 smithi164 ceph-mon[31788]: pgmap v372: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-27T08:33:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:06 smithi167 ceph-mon[34903]: pgmap v372: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-27T08:33:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:06 smithi173 ceph-mon[35397]: pgmap v372: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 6.0 KiB/s wr, 12 op/s 2024-03-27T08:33:07.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 -- 172.21.15.164:0/2320734697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe244104830 msgr2=0x7fe244104cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:07.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 --2- 172.21.15.164:0/2320734697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe244104830 0x7fe244104cb0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fe230009990 tx=0x7fe230009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 -- 172.21.15.164:0/2320734697 shutdown_connections 2024-03-27T08:33:07.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 --2- 172.21.15.164:0/2320734697 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2441051f0 0x7fe244111700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 --2- 172.21.15.164:0/2320734697 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 0x7fe24410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 --2- 172.21.15.164:0/2320734697 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe244104830 0x7fe244104cb0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 -- 172.21.15.164:0/2320734697 >> 172.21.15.164:0/2320734697 conn(0x7fe244100320 msgr2=0x7fe244102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 -- 172.21.15.164:0/2320734697 shutdown_connections 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.525+0000 7fe24be00700 1 -- 172.21.15.164:0/2320734697 wait complete. 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.526+0000 7fe24be00700 1 Processor -- start 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 -- start start 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 0x7fe24419afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 0x7fe24419f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114bb0 con 0x7fe2441051f0 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114a30 con 0x7fe24410a830 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe24be00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe244114d30 con 0x7fe244104830 2024-03-27T08:33:07.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe248a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:07.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe248a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46174/0 (socket says 172.21.15.164:46174) 2024-03-27T08:33:07.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe248a00700 1 -- 172.21.15.164:0/194678369 learned_addr learned my addr 172.21.15.164:0/194678369 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:07.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe249e00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 0x7fe24419f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:07.521 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.527+0000 7fe249400700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 0x7fe24419afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 -- 172.21.15.164:0/194678369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 msgr2=0x7fe24419afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 0x7fe24419afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 -- 172.21.15.164:0/194678369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 msgr2=0x7fe24419f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 0x7fe24419f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 -- 172.21.15.164:0/194678369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24419fff0 con 0x7fe2441051f0 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe249400700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 0x7fe24419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe248a00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe230000c00 tx=0x7fe2300038b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230027070 con 0x7fe2441051f0 2024-03-27T08:33:07.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.528+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2441a0280 con 0x7fe2441051f0 2024-03-27T08:33:07.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.529+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe230005690 con 0x7fe2441051f0 2024-03-27T08:33:07.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.529+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe230022c90 con 0x7fe2441051f0 2024-03-27T08:33:07.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.529+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2441a7b60 con 0x7fe2441051f0 2024-03-27T08:33:07.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.530+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe244069300 con 0x7fe2441051f0 2024-03-27T08:33:07.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.532+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fe23002a070 con 0x7fe2441051f0 2024-03-27T08:33:07.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.533+0000 7fe242000700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 0x7fe22c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:07.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.533+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7fe2300d0a20 con 0x7fe2441051f0 2024-03-27T08:33:07.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.533+0000 7fe249400700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 0x7fe22c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:07.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.534+0000 7fe249400700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 0x7fe22c0a5bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe238005e10 tx=0x7fe238005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:07.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.538+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe230013070 con 0x7fe2441051f0 2024-03-27T08:33:07.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.766+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe24402dd30 con 0x7fe2441051f0 2024-03-27T08:33:07.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.768+0000 7fe242000700 1 -- 172.21.15.164:0/194678369 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22289 (secure 0 0 0) 0x7fe23009d5d0 con 0x7fe2441051f0 2024-03-27T08:33:07.761 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:33:07.761 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":88,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:32:47.569637+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:33:07.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.771+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 msgr2=0x7fe22c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:07.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.771+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 0x7fe22c0a5bf0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe238005e10 tx=0x7fe238005d60 comp rx=0 tx=0).stop 2024-03-27T08:33:07.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.771+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 msgr2=0x7fe24419b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:07.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.771+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe230000c00 tx=0x7fe2300038b0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 shutdown_connections 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe22c0a3730 0x7fe22c0a5bf0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe24410a830 0x7fe24419f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe244104830 0x7fe24419afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 --2- 172.21.15.164:0/194678369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2441051f0 0x7fe24419b520 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 >> 172.21.15.164:0/194678369 conn(0x7fe244100320 msgr2=0x7fe244100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 shutdown_connections 2024-03-27T08:33:07.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:07.772+0000 7fe24be00700 1 -- 172.21.15.164:0/194678369 wait complete. 2024-03-27T08:33:08.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:08 smithi164 ceph-mon[31788]: pgmap v373: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-03-27T08:33:08.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:08 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/194678369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:08.638 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-27T08:33:08.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd dump --format=json 2024-03-27T08:33:08.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:08 smithi167 ceph-mon[34903]: pgmap v373: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-03-27T08:33:08.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:08 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/194678369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:08 smithi173 ceph-mon[35397]: pgmap v373: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 5.5 KiB/s wr, 10 op/s 2024-03-27T08:33:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:08 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/194678369' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:09.105 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:10.486 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:10 smithi164 ceph-mon[31788]: pgmap v374: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-27T08:33:10.548 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:10 smithi167 ceph-mon[34903]: pgmap v374: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-27T08:33:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:10 smithi173 ceph-mon[35397]: pgmap v374: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.5 KiB/s wr, 6 op/s 2024-03-27T08:33:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 -- 172.21.15.164:0/126918666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 msgr2=0x7f31d0111700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 --2- 172.21.15.164:0/126918666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d0111700 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f31c8009f90 tx=0x7f31c800b330 comp rx=0 tx=0).stop 2024-03-27T08:33:11.263 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 -- 172.21.15.164:0/126918666 shutdown_connections 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 --2- 172.21.15.164:0/126918666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d0111700 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 --2- 172.21.15.164:0/126918666 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d010a830 0x7f31d010ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 --2- 172.21.15.164:0/126918666 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d0104830 0x7f31d0104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 -- 172.21.15.164:0/126918666 >> 172.21.15.164:0/126918666 conn(0x7f31d0100320 msgr2=0x7f31d0102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 -- 172.21.15.164:0/126918666 shutdown_connections 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.271+0000 7f31d7000700 1 -- 172.21.15.164:0/126918666 wait complete. 2024-03-27T08:33:11.264 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.272+0000 7f31d7000700 1 Processor -- start 2024-03-27T08:33:11.265 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 -- start start 2024-03-27T08:33:11.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:11.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:11.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d010a830 0x7f31d019f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:11.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0114bb0 con 0x7f31d0104830 2024-03-27T08:33:11.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0114a30 con 0x7f31d01051f0 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.273+0000 7f31d7000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f31d0114d30 con 0x7f31d010a830 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cfe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cfe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:46190/0 (socket says 172.21.15.164:46190) 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cfe00700 1 -- 172.21.15.164:0/3900955934 learned_addr learned my addr 172.21.15.164:0/3900955934 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31d5000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d010a830 0x7f31d019f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 -- 172.21.15.164:0/3900955934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d010a830 msgr2=0x7f31d019f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d010a830 0x7f31d019f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 -- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 msgr2=0x7f31d019b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cf400700 1 -- 172.21.15.164:0/3900955934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d01a0010 con 0x7f31d01051f0 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.274+0000 7f31cfe00700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:33:11.267 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31cf400700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d019b540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d750 tx=0x7f31bc00da60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc017070 con 0x7f31d01051f0 2024-03-27T08:33:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d01a0300 con 0x7f31d01051f0 2024-03-27T08:33:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f31bc005020 con 0x7f31d01051f0 2024-03-27T08:33:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31bc00fa80 con 0x7f31d01051f0 2024-03-27T08:33:11.268 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.275+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d01a7b80 con 0x7f31d01051f0 2024-03-27T08:33:11.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.276+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d0069300 con 0x7f31d01051f0 2024-03-27T08:33:11.270 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.279+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f31bc0051d0 con 0x7f31d01051f0 2024-03-27T08:33:11.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.280+0000 7f31ccc00700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 0x7f31b40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:11.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.280+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 7979+0+0 (secure 0 0 0) 0x7f31bc0cf950 con 0x7f31d01051f0 2024-03-27T08:33:11.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.280+0000 7f31cfe00700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 0x7f31b40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:11.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.281+0000 7f31cfe00700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 0x7f31b40a5bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009750 tx=0x7f31c0009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:11.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.293+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f31bc09c470 con 0x7f31d01051f0 2024-03-27T08:33:11.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.520+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f31d019c390 con 0x7f31d01051f0 2024-03-27T08:33:11.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.522+0000 7f31ccc00700 1 -- 172.21.15.164:0/3900955934 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+22289 (secure 0 0 0) 0x7f31d019c390 con 0x7f31d01051f0 2024-03-27T08:33:11.515 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:33:11.515 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":88,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:32:47.569637+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:33:11.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 msgr2=0x7f31b40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:11.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 0x7f31b40a5bf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009750 tx=0x7f31c0009310 comp rx=0 tx=0).stop 2024-03-27T08:33:11.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 msgr2=0x7f31d019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:11.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d019b540 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f31bc00d750 tx=0x7f31bc00da60 comp rx=0 tx=0).stop 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 shutdown_connections 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31b40a3730 0x7f31b40a5bf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f31d010a830 0x7f31d019f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f31d0104830 0x7f31d019b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 --2- 172.21.15.164:0/3900955934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f31d01051f0 0x7f31d019b540 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 >> 172.21.15.164:0/3900955934 conn(0x7f31d0100320 msgr2=0x7f31d0100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 shutdown_connections 2024-03-27T08:33:11.518 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:11.525+0000 7f31d7000700 1 -- 172.21.15.164:0/3900955934 wait complete. 2024-03-27T08:33:12.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-27T08:33:12.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-27T08:33:12.294 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-27T08:33:12.294 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-27T08:33:12.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-27T08:33:12.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-27T08:33:12.295 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.6 flush_pg_stats 2024-03-27T08:33:12.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.7 flush_pg_stats 2024-03-27T08:33:12.296 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.8 flush_pg_stats 2024-03-27T08:33:12.297 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.9 flush_pg_stats 2024-03-27T08:33:12.297 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.10 flush_pg_stats 2024-03-27T08:33:12.298 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph tell osd.11 flush_pg_stats 2024-03-27T08:33:12.480 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:12 smithi164 ceph-mon[31788]: pgmap v375: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:33:12.480 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:12 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3900955934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:12 smithi167 ceph-mon[34903]: pgmap v375: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:33:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:12 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3900955934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:12 smithi173 ceph-mon[35397]: pgmap v375: 97 pgs: 97 active+clean; 635 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:33:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:12 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3900955934' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:33:13.312 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:13.323 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:13.352 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:13.391 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:14.159 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:14.162 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:14.163 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:14.171 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:14.744 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:14 smithi164 ceph-mon[31788]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T08:33:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:14 smithi167 ceph-mon[34903]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T08:33:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:14 smithi173 ceph-mon[35397]: pgmap v376: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-03-27T08:33:15.314 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:16.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:16 smithi164 ceph-mon[31788]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:33:16.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:16 smithi167 ceph-mon[34903]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:33:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:16 smithi173 ceph-mon[35397]: pgmap v377: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:33:17.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-03-27T08:33:17.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-03-27T08:33:17.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-03-27T08:33:17.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-03-27T08:33:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]: dispatch 2024-03-27T08:33:17.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]: dispatch 2024-03-27T08:33:18.176 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:18.314 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:18.321 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-03-27T08:33:18.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:18 smithi164 ceph-mon[31788]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T08:33:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:33:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T08:33:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-27T08:33:18.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-03-27T08:33:18.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:18 smithi167 ceph-mon[34903]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T08:33:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: pgmap v378: 97 pgs: 97 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.a", "id": [2, 11]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.10", "id": [8, 11]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [2, 4]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3", "id": [4, 9]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1a", "id": [5, 7]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.22", "id": [3, 9]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.36", "id": [4, 9]}]': finished 2024-03-27T08:33:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:18 smithi173 ceph-mon[35397]: osdmap e89: 12 total, 12 up, 12 in 2024-03-27T08:33:19.723 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:19 smithi164 ceph-mon[31788]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T08:33:19.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:19 smithi167 ceph-mon[34903]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T08:33:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:19 smithi173 ceph-mon[35397]: osdmap e90: 12 total, 12 up, 12 in 2024-03-27T08:33:20.733 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:20 smithi164 ceph-mon[31788]: pgmap v381: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T08:33:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:20 smithi167 ceph-mon[34903]: pgmap v381: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T08:33:20.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:20 smithi173 ceph-mon[35397]: pgmap v381: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 639 B/s wr, 6 op/s 2024-03-27T08:33:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:22 smithi164 ceph-mon[31788]: pgmap v382: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T08:33:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:22 smithi167 ceph-mon[34903]: pgmap v382: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T08:33:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:22 smithi173 ceph-mon[35397]: pgmap v382: 97 pgs: 4 peering, 93 active+clean; 639 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-03-27T08:33:22.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 -- 172.21.15.164:0/4044746696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14108680 msgr2=0x7f9e14108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 --2- 172.21.15.164:0/4044746696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14108680 0x7f9e14108a60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9e04009990 tx=0x7f9e04009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 -- 172.21.15.164:0/4044746696 shutdown_connections 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 --2- 172.21.15.164:0/4044746696 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e14103050 0x7f9e1410f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 --2- 172.21.15.164:0/4044746696 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14108680 0x7f9e14108a60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 --2- 172.21.15.164:0/4044746696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e14102690 0x7f9e14102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 -- 172.21.15.164:0/4044746696 >> 172.21.15.164:0/4044746696 conn(0x7f9e140797a0 msgr2=0x7f9e14079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 -- 172.21.15.164:0/4044746696 shutdown_connections 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.864+0000 7f9e19e00700 1 -- 172.21.15.164:0/4044746696 wait complete. 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.865+0000 7f9e19e00700 1 Processor -- start 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.865+0000 7f9e19e00700 1 -- start start 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e14102690 0x7f9e1419b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 0x7f9e1419b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e14108680 0x7f9e1419f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:22.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9e141129d0 con 0x7f9e14103050 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14112850 con 0x7f9e14102690 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e19e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9e14112b50 con 0x7f9e14108680 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e12000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 0x7f9e1419b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e12a00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e14102690 0x7f9e1419b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e12000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 0x7f9e1419b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51850/0 (socket says 172.21.15.164:51850) 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.866+0000 7f9e12000700 1 -- 172.21.15.164:0/2494431434 learned_addr learned my addr 172.21.15.164:0/2494431434 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e13400700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e14108680 0x7f9e1419f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 -- 172.21.15.164:0/2494431434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e14108680 msgr2=0x7f9e1419f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9e14108680 0x7f9e1419f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 -- 172.21.15.164:0/2494431434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e14102690 msgr2=0x7f9e1419b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e14102690 0x7f9e1419b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e141a00b0 con 0x7f9e14103050 2024-03-27T08:33:22.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e12000700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 0x7f9e1419b5e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000d980 tx=0x7f9e0000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00016070 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9e00004d00 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e141a03a0 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.867+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00005550 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.868+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e141a7c20 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.869+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e14100ee0 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.871+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f9e00004750 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.873+0000 7f9e18a00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9df80a37b0 0x7f9df80a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.873+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9e000cfc90 con 0x7f9e14103050 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.873+0000 7f9e12a00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9df80a37b0 0x7f9df80a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e18a00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] conn(0x7f9df80ad2f0 0x7f9df80af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:22.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9df80afe60 con 0x7f9df80ad2f0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f9e000d52a0 con 0x7f9e14103050 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e13400700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] conn(0x7f9df80ad2f0 0x7f9df80af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e12a00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9df80a37b0 0x7f9df80a5c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006010 tx=0x7f9e0400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.874+0000 7f9e13400700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] conn(0x7f9df80ad2f0 0x7f9df80af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.876+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== osd.6 v2:172.21.15.164:6818/1951126247 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9df80afe60 con 0x7f9df80ad2f0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.895+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 --> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e14103dc0 con 0x7f9df80ad2f0 2024-03-27T08:33:22.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.895+0000 7f9e18a00700 1 -- 172.21.15.164:0/2494431434 <== osd.6 v2:172.21.15.164:6818/1951126247 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9e14103dc0 con 0x7f9df80ad2f0 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.895+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] conn(0x7f9df80ad2f0 msgr2=0x7f9df80af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.895+0000 7f9e19e00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] conn(0x7f9df80ad2f0 0x7f9df80af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9df80a37b0 msgr2=0x7f9df80a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9df80a37b0 0x7f9df80a5c70 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f9e04006010 tx=0x7f9e0400b540 comp rx=0 tx=0).stop 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 msgr2=0x7f9e1419b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 --2- 172.21.15.164:0/2494431434 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9e14103050 0x7f9e1419b5e0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000d980 tx=0x7f9e0000dc90 comp rx=0 tx=0).stop 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e13400700 1 -- 172.21.15.164:0/2494431434 reap_dead start 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 shutdown_connections 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 >> 172.21.15.164:0/2494431434 conn(0x7f9e140797a0 msgr2=0x7f9e14100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 shutdown_connections 2024-03-27T08:33:22.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:21.896+0000 7f9e19e00700 1 -- 172.21.15.164:0/2494431434 wait complete. 2024-03-27T08:33:24.718 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:24 smithi164 ceph-mon[31788]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:24 smithi167 ceph-mon[34903]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:24 smithi173 ceph-mon[35397]: pgmap v383: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 255 B/s wr, 6 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 -- 172.21.15.164:0/2168830301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b810df90 msgr2=0x7f30b8115b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 --2- 172.21.15.164:0/2168830301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b810df90 0x7f30b8115b60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f30b000b0d0 tx=0x7f30b000b3e0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 -- 172.21.15.164:0/2168830301 shutdown_connections 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 --2- 172.21.15.164:0/2168830301 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b810df90 0x7f30b8115b60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 --2- 172.21.15.164:0/2168830301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b8108eb0 0x7f30b8109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 --2- 172.21.15.164:0/2168830301 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8109860 0x7f30b810d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 -- 172.21.15.164:0/2168830301 >> 172.21.15.164:0/2168830301 conn(0x7f30b8075e10 msgr2=0x7f30b8078230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 -- 172.21.15.164:0/2168830301 shutdown_connections 2024-03-27T08:33:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.285+0000 7f30bdc00700 1 -- 172.21.15.164:0/2168830301 wait complete. 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.286+0000 7f30bdc00700 1 Processor -- start 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 -- start start 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8108eb0 0x7f30b819f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 0x7f30b819f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b810df90 0x7f30b81a3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8118fe0 con 0x7f30b8109860 2024-03-27T08:33:25.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8118e60 con 0x7f30b810df90 2024-03-27T08:33:25.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.287+0000 7f30bdc00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30b8119160 con 0x7f30b8108eb0 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 0x7f30b819f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30b6a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8108eb0 0x7f30b819f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 0x7f30b819f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51864/0 (socket says 172.21.15.164:51864) 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 -- 172.21.15.164:0/4054588441 learned_addr learned my addr 172.21.15.164:0/4054588441 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30b7400700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b810df90 0x7f30b81a3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:25.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 -- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8108eb0 msgr2=0x7f30b819f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b8108eb0 0x7f30b819f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 -- 172.21.15.164:0/4054588441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b810df90 msgr2=0x7f30b81a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b810df90 0x7f30b81a3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.288+0000 7f30afe00700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b81a43e0 con 0x7f30b8109860 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30afe00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 0x7f30b819f910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f30a000d950 tx=0x7f30a000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0017070 con 0x7f30b8109860 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30a0005020 con 0x7f30b8109860 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b81a46d0 con 0x7f30b8109860 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a000fa80 con 0x7f30b8109860 2024-03-27T08:33:25.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.289+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b81abf50 con 0x7f30b8109860 2024-03-27T08:33:25.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.290+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f30b8077250 con 0x7f30b8109860 2024-03-27T08:33:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.292+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f30a00051d0 con 0x7f30b8109860 2024-03-27T08:33:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30af400700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a37b0 0x7f309c0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f30a00cf960 con 0x7f30b8109860 2024-03-27T08:33:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30b6a00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a37b0 0x7f309c0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30af400700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] conn(0x7f309c0ad2f0 0x7f309c0af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f30a0014ec0 con 0x7f309c0ad2f0 2024-03-27T08:33:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f30a00cfd10 con 0x7f30b8109860 2024-03-27T08:33:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.294+0000 7f30b6a00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a37b0 0x7f309c0a5c70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30a8005950 tx=0x7f30a800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.295+0000 7f30b7400700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] conn(0x7f309c0ad2f0 0x7f309c0af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.296+0000 7f30b7400700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] conn(0x7f309c0ad2f0 0x7f309c0af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.297+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== osd.5 v2:172.21.15.173:6808/1658864715 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f30a0014ec0 con 0x7f309c0ad2f0 2024-03-27T08:33:25.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.318+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 --> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f30b810a390 con 0x7f309c0ad2f0 2024-03-27T08:33:25.311 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.319+0000 7f30af400700 1 -- 172.21.15.164:0/4054588441 <== osd.5 v2:172.21.15.173:6808/1658864715 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f30b810a390 con 0x7f309c0ad2f0 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.319+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] conn(0x7f309c0ad2f0 msgr2=0x7f309c0af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.319+0000 7f30bdc00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] conn(0x7f309c0ad2f0 0x7f309c0af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a37b0 msgr2=0x7f309c0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a37b0 0x7f309c0a5c70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f30a8005950 tx=0x7f30a800b410 comp rx=0 tx=0).stop 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 msgr2=0x7f30b819f910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 --2- 172.21.15.164:0/4054588441 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b8109860 0x7f30b819f910 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f30a000d950 tx=0x7f30a000dc60 comp rx=0 tx=0).stop 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30b7400700 1 -- 172.21.15.164:0/4054588441 reap_dead start 2024-03-27T08:33:25.312 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 shutdown_connections 2024-03-27T08:33:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 >> 172.21.15.164:0/4054588441 conn(0x7f30b8075e10 msgr2=0x7f30b8076870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 shutdown_connections 2024-03-27T08:33:25.313 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.320+0000 7f30bdc00700 1 -- 172.21.15.164:0/4054588441 wait complete. 2024-03-27T08:33:26.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:26 smithi164 ceph-mon[31788]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:26 smithi167 ceph-mon[34903]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:26.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:26 smithi173 ceph-mon[35397]: pgmap v384: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 255 B/s wr, 4 op/s; 13 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:27.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 -- 172.21.15.164:0/3600004427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 msgr2=0x7f0bfc10ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 --2- 172.21.15.164:0/3600004427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc10ac10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0009990 tx=0x7f0bf0009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 -- 172.21.15.164:0/3600004427 shutdown_connections 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 --2- 172.21.15.164:0/3600004427 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc1051f0 0x7f0bfc111700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 --2- 172.21.15.164:0/3600004427 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc10ac10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 --2- 172.21.15.164:0/3600004427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 0x7f0bfc104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.834+0000 7f0c04800700 1 -- 172.21.15.164:0/3600004427 >> 172.21.15.164:0/3600004427 conn(0x7f0bfc100320 msgr2=0x7f0bfc102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.835+0000 7f0c04800700 1 -- 172.21.15.164:0/3600004427 shutdown_connections 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.835+0000 7f0c04800700 1 -- 172.21.15.164:0/3600004427 wait complete. 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 Processor -- start 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 -- start start 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 0x7f0bfc19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc1051f0 0x7f0bfc19b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc19f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:27.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc114b60 con 0x7f0bfc10a830 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc1149e0 con 0x7f0bfc104830 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c04800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0bfc114ce0 con 0x7f0bfc1051f0 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c02800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc19f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c02800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc19f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51918/0 (socket says 172.21.15.164:51918) 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.836+0000 7f0c02800700 1 -- 172.21.15.164:0/2028211747 learned_addr learned my addr 172.21.15.164:0/2028211747 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c01e00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 0x7f0bfc19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c01400700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc1051f0 0x7f0bfc19b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 -- 172.21.15.164:0/2028211747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc1051f0 msgr2=0x7f0bfc19b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0bfc1051f0 0x7f0bfc19b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 -- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 msgr2=0x7f0bfc19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 0x7f0bfc19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bfc19ff80 con 0x7f0bfc10a830 2024-03-27T08:33:27.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c01e00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bfc104830 0x7f0bfc19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c02800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc19f840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8007ee0 tx=0x7f0bf800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf800dbd0 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0bf800dd70 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bf80133f0 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.837+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bfc1a0270 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.838+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bfc1a7af0 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.838+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0bfc062d90 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.841+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f0bf801a020 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.842+0000 7f0bf6a00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0be40a37b0 0x7f0be40a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.842+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0bf80cfcb0 con 0x7f0bfc10a830 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.842+0000 7f0c01e00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0be40a37b0 0x7f0be40a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.843+0000 7f0bf6a00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] conn(0x7f0be40ad2f0 0x7f0be40af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:27.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.843+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bf800ae50 con 0x7f0be40ad2f0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.843+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f0bf80d0060 con 0x7f0bfc10a830 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.843+0000 7f0c01400700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] conn(0x7f0be40ad2f0 0x7f0be40af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.843+0000 7f0c01e00700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0be40a37b0 0x7f0be40a5c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006010 tx=0x7f0bf001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.844+0000 7f0c01400700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] conn(0x7f0be40ad2f0 0x7f0be40af790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.847+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== osd.1 v2:172.21.15.167:6800/357892090 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0bf800ae50 con 0x7f0be40ad2f0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.864+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 --> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0bfc063260 con 0x7f0be40ad2f0 2024-03-27T08:33:27.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.865+0000 7f0bf6a00700 1 -- 172.21.15.164:0/2028211747 <== osd.1 v2:172.21.15.167:6800/357892090 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0bfc063260 con 0x7f0be40ad2f0 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.865+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] conn(0x7f0be40ad2f0 msgr2=0x7f0be40af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.865+0000 7f0c04800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] conn(0x7f0be40ad2f0 0x7f0be40af790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0be40a37b0 msgr2=0x7f0be40a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0be40a37b0 0x7f0be40a5c70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f0bf0006010 tx=0x7f0bf001a040 comp rx=0 tx=0).stop 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 msgr2=0x7f0bfc19f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 --2- 172.21.15.164:0/2028211747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0bfc10a830 0x7f0bfc19f840 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8007ee0 tx=0x7f0bf800d3b0 comp rx=0 tx=0).stop 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c02800700 1 -- 172.21.15.164:0/2028211747 reap_dead start 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 shutdown_connections 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 >> 172.21.15.164:0/2028211747 conn(0x7f0bfc100320 msgr2=0x7f0bfc100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 shutdown_connections 2024-03-27T08:33:27.310 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:25.866+0000 7f0c04800700 1 -- 172.21.15.164:0/2028211747 wait complete. 2024-03-27T08:33:28.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:28 smithi164 ceph-mon[31788]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:28 smithi167 ceph-mon[34903]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:28 smithi173 ceph-mon[35397]: pgmap v385: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 207 B/s wr, 6 op/s; 11 B/s, 1 keys/s, 1 objects/s recovering 2024-03-27T08:33:29.130 INFO:teuthology.orchestra.run.smithi164.stdout:171798691904 2024-03-27T08:33:29.130 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 -- 172.21.15.164:0/3915642340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 msgr2=0x7fc26010f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 --2- 172.21.15.164:0/3915642340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26010f4d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc25400b0d0 tx=0x7fc25400b3e0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 -- 172.21.15.164:0/3915642340 shutdown_connections 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 --2- 172.21.15.164:0/3915642340 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26010f4d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 --2- 172.21.15.164:0/3915642340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc260108670 0x7fc260108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.902 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 --2- 172.21.15.164:0/3915642340 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc26006a2f0 0x7fc26006a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.146+0000 7fc267e00700 1 -- 172.21.15.164:0/3915642340 >> 172.21.15.164:0/3915642340 conn(0x7fc260078470 msgr2=0x7fc260078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.147+0000 7fc267e00700 1 -- 172.21.15.164:0/3915642340 shutdown_connections 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.147+0000 7fc267e00700 1 -- 172.21.15.164:0/3915642340 wait complete. 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 Processor -- start 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 -- start start 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc26006a2f0 0x7fc26019aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26019b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc260108670 0x7fc26019f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc260112940 con 0x7fc26006acb0 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2601127c0 con 0x7fc260108670 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.148+0000 7fc267e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc260112ac0 con 0x7fc26006a2f0 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26019b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:29.903 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26019b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51926/0 (socket says 172.21.15.164:51926) 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 -- 172.21.15.164:0/4066888554 learned_addr learned my addr 172.21.15.164:0/4066888554 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc265400700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc26006a2f0 0x7fc26019aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc265e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc260108670 0x7fc26019f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 -- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc26006a2f0 msgr2=0x7fc26019aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc26006a2f0 0x7fc26019aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.904 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 -- 172.21.15.164:0/4066888554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc260108670 msgr2=0x7fc26019f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc260108670 0x7fc26019f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc26019fe70 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.149+0000 7fc264a00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26019b3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c9b0 tx=0x7fc24c00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.150+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c007b00 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.150+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc24c007ca0 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.150+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc24c018780 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.150+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2601a0160 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.150+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2601a79e0 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.151+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc260100830 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.153+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fc24c00f450 con 0x7fc26006acb0 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.154+0000 7fc25e000700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2480a3730 0x7fc2480a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:29.905 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc24c0d0440 con 0x7fc26006acb0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc265400700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2480a3730 0x7fc2480a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc25e000700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] conn(0x7fc2480ad2d0 0x7fc2480af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc24c004500 con 0x7fc2480ad2d0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc24c0d07f0 con 0x7fc26006acb0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.155+0000 7fc265400700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2480a3730 0x7fc2480a5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc258005950 tx=0x7fc2580058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.156+0000 7fc265e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] conn(0x7fc2480ad2d0 0x7fc2480af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.157+0000 7fc265e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] conn(0x7fc2480ad2d0 0x7fc2480af770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.159+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== osd.2 v2:172.21.15.173:6800/765640001 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc24c004500 con 0x7fc2480ad2d0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.178+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 --> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc260103d40 con 0x7fc2480ad2d0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.179+0000 7fc25e000700 1 -- 172.21.15.164:0/4066888554 <== osd.2 v2:172.21.15.173:6800/765640001 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc260103d40 con 0x7fc2480ad2d0 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] conn(0x7fc2480ad2d0 msgr2=0x7fc2480af770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] conn(0x7fc2480ad2d0 0x7fc2480af770 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.906 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2480a3730 msgr2=0x7fc2480a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2480a3730 0x7fc2480a5bf0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fc258005950 tx=0x7fc2580058e0 comp rx=0 tx=0).stop 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 msgr2=0x7fc26019b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 --2- 172.21.15.164:0/4066888554 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc26006acb0 0x7fc26019b3f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc24c00c9b0 tx=0x7fc24c00cd70 comp rx=0 tx=0).stop 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc265e00700 1 -- 172.21.15.164:0/4066888554 reap_dead start 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 shutdown_connections 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 >> 172.21.15.164:0/4066888554 conn(0x7fc260078470 msgr2=0x7fc2600ffdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 shutdown_connections 2024-03-27T08:33:29.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.180+0000 7fc267e00700 1 -- 172.21.15.164:0/4066888554 wait complete. 2024-03-27T08:33:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:30 smithi164 ceph-mon[31788]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 6 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-03-27T08:33:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:30 smithi167 ceph-mon[34903]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 6 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-03-27T08:33:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:30 smithi173 ceph-mon[35397]: pgmap v386: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 188 B/s wr, 6 op/s; 10 B/s, 0 keys/s, 1 objects/s recovering 2024-03-27T08:33:31.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 -- 172.21.15.164:0/2292806809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc102690 msgr2=0x7fa5bc102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/2292806809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc102690 0x7fa5bc102b10 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fa5a8009990 tx=0x7fa5a8009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 -- 172.21.15.164:0/2292806809 shutdown_connections 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/2292806809 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5bc103050 0x7fa5bc10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/2292806809 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc108680 0x7fa5bc108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/2292806809 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc102690 0x7fa5bc102b10 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 -- 172.21.15.164:0/2292806809 >> 172.21.15.164:0/2292806809 conn(0x7fa5bc0797a0 msgr2=0x7fa5bc079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 -- 172.21.15.164:0/2292806809 shutdown_connections 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.027+0000 7fa5c3e00700 1 -- 172.21.15.164:0/2292806809 wait complete. 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.029+0000 7fa5c3e00700 1 Processor -- start 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.029+0000 7fa5c3e00700 1 -- start start 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc102690 0x7fa5bc198e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5bc103050 0x7fa5bc1993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:31.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 0x7fa5bc19d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc1129f0 con 0x7fa5bc108680 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc112870 con 0x7fa5bc102690 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c3e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa5bc112b70 con 0x7fa5bc103050 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 0x7fa5bc19d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c1e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 0x7fa5bc19d750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51946/0 (socket says 172.21.15.164:51946) 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c1e00700 1 -- 172.21.15.164:0/716727962 learned_addr learned my addr 172.21.15.164:0/716727962 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c1400700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc102690 0x7fa5bc198e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.030+0000 7fa5c0a00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5bc103050 0x7fa5bc1993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 -- 172.21.15.164:0/716727962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5bc103050 msgr2=0x7fa5bc1993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa5bc103050 0x7fa5bc1993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 -- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc102690 msgr2=0x7fa5bc198e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa5bc102690 0x7fa5bc198e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5bc19de90 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c1e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 0x7fa5bc19d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4007f10 tx=0x7fa5b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4009e20 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5b4004bb0 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4005970 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.031+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5bc19e180 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.032+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5bc1a5a00 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.032+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa5bc062d50 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.035+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fa5b401a020 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.036+0000 7fa5ba000700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5a40a37b0 0x7fa5a40a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.036+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa5b40cfbe0 con 0x7fa5bc108680 2024-03-27T08:33:31.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.036+0000 7fa5c1400700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5a40a37b0 0x7fa5a40a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.037+0000 7fa5ba000700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] conn(0x7fa5a40ad2f0 0x7fa5a40af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.037+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa5a40afe60 con 0x7fa5a40ad2f0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.037+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fa5b40cff90 con 0x7fa5bc108680 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.037+0000 7fa5c1400700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5a40a37b0 0x7fa5a40a5c70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005950 tx=0x7fa5b000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.037+0000 7fa5c0a00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] conn(0x7fa5a40ad2f0 0x7fa5a40af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.038+0000 7fa5c0a00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] conn(0x7fa5a40ad2f0 0x7fa5a40af790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.041+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== osd.4 v2:172.21.15.167:6808/4005700417 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa5a40afe60 con 0x7fa5a40ad2f0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.058+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 --> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa5bc0631d0 con 0x7fa5a40ad2f0 2024-03-27T08:33:31.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5ba000700 1 -- 172.21.15.164:0/716727962 <== osd.4 v2:172.21.15.167:6808/4005700417 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa5bc0631d0 con 0x7fa5a40ad2f0 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] conn(0x7fa5a40ad2f0 msgr2=0x7fa5a40af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] conn(0x7fa5a40ad2f0 0x7fa5a40af790 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5a40a37b0 msgr2=0x7fa5a40a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5a40a37b0 0x7fa5a40a5c70 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0005950 tx=0x7fa5b000b410 comp rx=0 tx=0).stop 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 msgr2=0x7fa5bc19d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c3e00700 1 --2- 172.21.15.164:0/716727962 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa5bc108680 0x7fa5bc19d750 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4007f10 tx=0x7fa5b400d3b0 comp rx=0 tx=0).stop 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.059+0000 7fa5c1e00700 1 -- 172.21.15.164:0/716727962 reap_dead start 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.060+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 shutdown_connections 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.060+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 >> 172.21.15.164:0/716727962 conn(0x7fa5bc0797a0 msgr2=0x7fa5bc1006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.060+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 shutdown_connections 2024-03-27T08:33:31.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:31.060+0000 7fa5c3e00700 1 -- 172.21.15.164:0/716727962 wait complete. 2024-03-27T08:33:31.834 INFO:teuthology.orchestra.run.smithi164.stdout:77309411415 2024-03-27T08:33:31.835 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 -- 172.21.15.164:0/1240686399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06a2f0 msgr2=0x7fc95c06a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 --2- 172.21.15.164:0/1240686399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06a2f0 0x7fc95c06a770 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc9480099c0 tx=0x7fc948009cd0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 -- 172.21.15.164:0/1240686399 shutdown_connections 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 --2- 172.21.15.164:0/1240686399 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95c06acb0 0x7fc95c10f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 --2- 172.21.15.164:0/1240686399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc95c108670 0x7fc95c108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 --2- 172.21.15.164:0/1240686399 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06a2f0 0x7fc95c06a770 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.836+0000 7fc961000700 1 -- 172.21.15.164:0/1240686399 >> 172.21.15.164:0/1240686399 conn(0x7fc95c078470 msgr2=0x7fc95c078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.837+0000 7fc961000700 1 -- 172.21.15.164:0/1240686399 shutdown_connections 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.837+0000 7fc961000700 1 -- 172.21.15.164:0/1240686399 wait complete. 2024-03-27T08:33:32.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 Processor -- start 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 -- start start 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95c06a2f0 0x7fc95c19af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 0x7fc95c19b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc95c108670 0x7fc95c19f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c1128f0 con 0x7fc95c06acb0 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c112770 con 0x7fc95c108670 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc961000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc95c112a70 con 0x7fc95c06a2f0 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc959400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 0x7fc95c19b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc959400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 0x7fc95c19b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51936/0 (socket says 172.21.15.164:51936) 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.838+0000 7fc959400700 1 -- 172.21.15.164:0/1081870550 learned_addr learned my addr 172.21.15.164:0/1081870550 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959e00700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95c06a2f0 0x7fc95c19af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc95a800700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc95c108670 0x7fc95c19f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 -- 172.21.15.164:0/1081870550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95c06a2f0 msgr2=0x7fc95c19af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.365 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc95c06a2f0 0x7fc95c19af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 -- 172.21.15.164:0/1081870550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc95c108670 msgr2=0x7fc95c19f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc95c108670 0x7fc95c19f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c19ff60 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.839+0000 7fc959400700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 0x7fc95c19b490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc94800b580 tx=0x7fc948003730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.840+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc948027070 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.840+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc948004130 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.840+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c1a01f0 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.840+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc94800f460 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.840+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc95c1a7ad0 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.841+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc95c100980 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.843+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fc94802a070 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.844+0000 7fc952a00700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9400a37b0 0x7fc9400a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc9480d1c30 con 0x7fc95c06acb0 2024-03-27T08:33:32.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc959e00700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9400a37b0 0x7fc9400a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc952a00700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] conn(0x7fc9400ad2f0 0x7fc9400af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc9400afe60 con 0x7fc9400ad2f0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fc9480d1fe0 con 0x7fc95c06acb0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc95a800700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] conn(0x7fc9400ad2f0 0x7fc9400af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.845+0000 7fc959e00700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9400a37b0 0x7fc9400a5c70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc94c005fd0 tx=0x7fc94c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.846+0000 7fc95a800700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] conn(0x7fc9400ad2f0 0x7fc9400af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.847+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== osd.9 v2:172.21.15.164:6826/1825702850 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc9400afe60 con 0x7fc9400ad2f0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.865+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 --> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc95c103d40 con 0x7fc9400ad2f0 2024-03-27T08:33:32.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.865+0000 7fc952a00700 1 -- 172.21.15.164:0/1081870550 <== osd.9 v2:172.21.15.164:6826/1825702850 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc95c103d40 con 0x7fc9400ad2f0 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] conn(0x7fc9400ad2f0 msgr2=0x7fc9400af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] conn(0x7fc9400ad2f0 0x7fc9400af790 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9400a37b0 msgr2=0x7fc9400a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9400a37b0 0x7fc9400a5c70 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc94c005fd0 tx=0x7fc94c00a560 comp rx=0 tx=0).stop 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 msgr2=0x7fc95c19b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 --2- 172.21.15.164:0/1081870550 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc95c06acb0 0x7fc95c19b490 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc94800b580 tx=0x7fc948003730 comp rx=0 tx=0).stop 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc95a800700 1 -- 172.21.15.164:0/1081870550 reap_dead start 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 shutdown_connections 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 >> 172.21.15.164:0/1081870550 conn(0x7fc95c078470 msgr2=0x7fc95c0fff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:32.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 shutdown_connections 2024-03-27T08:33:32.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:29.866+0000 7fc961000700 1 -- 172.21.15.164:0/1081870550 wait complete. 2024-03-27T08:33:32.681 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:32 smithi164 ceph-mon[31788]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:32 smithi167 ceph-mon[34903]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:32 smithi173 ceph-mon[35397]: pgmap v387: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 170 B/s wr, 5 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:34.348 INFO:teuthology.orchestra.run.smithi164.stdout:300647710757 2024-03-27T08:33:34.349 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.9 2024-03-27T08:33:34.471 INFO:teuthology.orchestra.run.smithi164.stdout:55834574941 2024-03-27T08:33:34.471 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-27T08:33:34.544 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:34 smithi164 ceph-mon[31788]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:34.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.801+0000 7f9b4a400700 1 -- 172.21.15.164:0/3697805530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 msgr2=0x7f9b4410ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.801+0000 7f9b4a400700 1 --2- 172.21.15.164:0/3697805530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 0x7f9b4410ac10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9b340098f0 tx=0x7f9b34009c00 comp rx=0 tx=0).stop 2024-03-27T08:33:34.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 -- 172.21.15.164:0/3697805530 shutdown_connections 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 --2- 172.21.15.164:0/3697805530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b441051f0 0x7f9b44111700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 --2- 172.21.15.164:0/3697805530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 0x7f9b4410ac10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 --2- 172.21.15.164:0/3697805530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b44104830 0x7f9b44104cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 -- 172.21.15.164:0/3697805530 >> 172.21.15.164:0/3697805530 conn(0x7f9b44100320 msgr2=0x7f9b44102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 -- 172.21.15.164:0/3697805530 shutdown_connections 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.802+0000 7f9b4a400700 1 -- 172.21.15.164:0/3697805530 wait complete. 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.803+0000 7f9b4a400700 1 Processor -- start 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.803+0000 7f9b4a400700 1 -- start start 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b44104830 0x7f9b4419afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 0x7f9b4419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:34.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 0x7f9b4419f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44114b30 con 0x7f9b441051f0 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b441149b0 con 0x7f9b4410a830 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b4a400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9b44114cb0 con 0x7f9b44104830 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 0x7f9b4419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 0x7f9b4419b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51950/0 (socket says 172.21.15.164:51950) 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 -- 172.21.15.164:0/1832921571 learned_addr learned my addr 172.21.15.164:0/1832921571 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b43e00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 0x7f9b4419f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b43400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b44104830 0x7f9b4419afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 -- 172.21.15.164:0/1832921571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b44104830 msgr2=0x7f9b4419afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b44104830 0x7f9b4419afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 -- 172.21.15.164:0/1832921571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 msgr2=0x7f9b4419f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b4410a830 0x7f9b4419f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.804+0000 7f9b42a00700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4419ffd0 con 0x7f9b441051f0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b42a00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 0x7f9b4419b500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9c0 tx=0x7f9b3000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3000cbd0 con 0x7f9b441051f0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b441a02c0 con 0x7f9b441051f0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b3000cd70 con 0x7f9b441051f0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30005650 con 0x7f9b441051f0 2024-03-27T08:33:34.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.805+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b441a7b40 con 0x7f9b441051f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.806+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b44062dd0 con 0x7f9b441051f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.808+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f9b30004d90 con 0x7f9b441051f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b3be00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b280a37b0 0x7f9b280a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9b300d0410 con 0x7f9b441051f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b43400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b280a37b0 0x7f9b280a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b3be00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] conn(0x7f9b280ad2f0 0x7f9b280af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b280afe60 con 0x7f9b280ad2f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f9b300d07c0 con 0x7f9b441051f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.810+0000 7f9b43e00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] conn(0x7f9b280ad2f0 0x7f9b280af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.811+0000 7f9b43400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b280a37b0 0x7f9b280a5c70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009fd0 tx=0x7f9b34019040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.811+0000 7f9b43e00700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] conn(0x7f9b280ad2f0 0x7f9b280af790 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.812+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== osd.0 v2:172.21.15.164:6802/3960470757 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b280afe60 con 0x7f9b280ad2f0 2024-03-27T08:33:34.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.830+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 --> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b440631d0 con 0x7f9b280ad2f0 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.830+0000 7f9b3be00700 1 -- 172.21.15.164:0/1832921571 <== osd.0 v2:172.21.15.164:6802/3960470757 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9b440631d0 con 0x7f9b280ad2f0 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] conn(0x7f9b280ad2f0 msgr2=0x7f9b280af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] conn(0x7f9b280ad2f0 0x7f9b280af790 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b280a37b0 msgr2=0x7f9b280a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b280a37b0 0x7f9b280a5c70 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009fd0 tx=0x7f9b34019040 comp rx=0 tx=0).stop 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 msgr2=0x7f9b4419b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 --2- 172.21.15.164:0/1832921571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b441051f0 0x7f9b4419b500 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9b3000e9c0 tx=0x7f9b3000ecd0 comp rx=0 tx=0).stop 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b43e00700 1 -- 172.21.15.164:0/1832921571 reap_dead start 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 shutdown_connections 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.831+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 >> 172.21.15.164:0/1832921571 conn(0x7f9b44100320 msgr2=0x7f9b44100a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.832+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 shutdown_connections 2024-03-27T08:33:34.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:33.832+0000 7f9b4a400700 1 -- 172.21.15.164:0/1832921571 wait complete. 2024-03-27T08:33:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:34 smithi167 ceph-mon[34903]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:34 smithi173 ceph-mon[35397]: pgmap v388: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 170 B/s wr, 6 op/s; 9 B/s, 0 keys/s, 0 objects/s recovering 2024-03-27T08:33:35.735 INFO:teuthology.orchestra.run.smithi164.stdout:34359738470 2024-03-27T08:33:35.735 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.568+0000 7fd9e7200700 1 -- 172.21.15.164:0/1937337862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0103050 msgr2=0x7fd9e010f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.568+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1937337862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0103050 0x7fd9e010f490 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fd9d800b0d0 tx=0x7fd9d800b3e0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 -- 172.21.15.164:0/1937337862 shutdown_connections 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1937337862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0103050 0x7fd9e010f490 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1937337862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0108670 0x7fd9e0108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1937337862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9e0102690 0x7fd9e0102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 -- 172.21.15.164:0/1937337862 >> 172.21.15.164:0/1937337862 conn(0x7fd9e0079770 msgr2=0x7fd9e0079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 -- 172.21.15.164:0/1937337862 shutdown_connections 2024-03-27T08:33:36.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.569+0000 7fd9e7200700 1 -- 172.21.15.164:0/1937337862 wait complete. 2024-03-27T08:33:36.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.570+0000 7fd9e7200700 1 Processor -- start 2024-03-27T08:33:36.562 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.570+0000 7fd9e7200700 1 -- start start 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0102690 0x7fd9e0074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9e0103050 0x7fd9e0074e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 0x7fd9e00753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e01129d0 con 0x7fd9e0108670 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0112850 con 0x7fd9e0103050 2024-03-27T08:33:36.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e7200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd9e0112b50 con 0x7fd9e0102690 2024-03-27T08:33:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 0x7fd9e00753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e5200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 0x7fd9e00753c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33768/0 (socket says 172.21.15.164:33768) 2024-03-27T08:33:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9e5200700 1 -- 172.21.15.164:0/1849184421 learned_addr learned my addr 172.21.15.164:0/1849184421 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9df400700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9e0103050 0x7fd9e0074e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:36.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.571+0000 7fd9dfe00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0102690 0x7fd9e0074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 -- 172.21.15.164:0/1849184421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0102690 msgr2=0x7fd9e0074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0102690 0x7fd9e0074940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 -- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9e0103050 msgr2=0x7fd9e0074e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd9e0103050 0x7fd9e0074e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9e01a7380 con 0x7fd9e0108670 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9dfe00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd9e0102690 0x7fd9e0074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:36.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e5200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 0x7fd9e00753c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80079a0 tx=0x7fd9d80079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d8021070 con 0x7fd9e0108670 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd9d801db20 con 0x7fd9e0108670 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9e01a7610 con 0x7fd9e0108670 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.572+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9d801ba60 con 0x7fd9e0108670 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.573+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9e01a7a70 con 0x7fd9e0108670 2024-03-27T08:33:36.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.573+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd9e0062d50 con 0x7fd9e0108670 2024-03-27T08:33:36.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.576+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fd9d8024070 con 0x7fd9e0108670 2024-03-27T08:33:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.577+0000 7fd9dcc00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd9c40a3730 0x7fd9c40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.577+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd9d80d17d0 con 0x7fd9e0108670 2024-03-27T08:33:36.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.577+0000 7fd9dfe00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd9c40a3730 0x7fd9c40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.578+0000 7fd9dcc00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] conn(0x7fd9c40ad270 0x7fd9c40af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.578+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9c40afde0 con 0x7fd9c40ad270 2024-03-27T08:33:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.578+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fd9d80d1b80 con 0x7fd9e0108670 2024-03-27T08:33:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.578+0000 7fd9dfe00700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd9c40a3730 0x7fd9c40a5bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bcf0 tx=0x7fd9d000b2c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:36.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.578+0000 7fd9df400700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] conn(0x7fd9c40ad270 0x7fd9c40af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:36.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.579+0000 7fd9df400700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] conn(0x7fd9c40ad270 0x7fd9c40af710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:36.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.582+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== osd.10 v2:172.21.15.167:6824/1703441209 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd9c40afde0 con 0x7fd9c40ad270 2024-03-27T08:33:36.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.600+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 --> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9e00631d0 con 0x7fd9c40ad270 2024-03-27T08:33:36.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9dcc00700 1 -- 172.21.15.164:0/1849184421 <== osd.10 v2:172.21.15.167:6824/1703441209 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd9e00631d0 con 0x7fd9c40ad270 2024-03-27T08:33:36.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] conn(0x7fd9c40ad270 msgr2=0x7fd9c40af710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] conn(0x7fd9c40ad270 0x7fd9c40af710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd9c40a3730 msgr2=0x7fd9c40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd9c40a3730 0x7fd9c40a5bf0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd9d000bcf0 tx=0x7fd9d000b2c0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 msgr2=0x7fd9e00753c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e7200700 1 --2- 172.21.15.164:0/1849184421 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd9e0108670 0x7fd9e00753c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fd9d80079a0 tx=0x7fd9d80079d0 comp rx=0 tx=0).stop 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.601+0000 7fd9e5200700 1 -- 172.21.15.164:0/1849184421 reap_dead start 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.602+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 shutdown_connections 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.602+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 >> 172.21.15.164:0/1849184421 conn(0x7fd9e0079770 msgr2=0x7fd9e0101380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.602+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 shutdown_connections 2024-03-27T08:33:36.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:36.602+0000 7fd9e7200700 1 -- 172.21.15.164:0/1849184421 wait complete. 2024-03-27T08:33:36.658 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:36 smithi164 ceph-mon[31788]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T08:33:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:36 smithi167 ceph-mon[34903]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T08:33:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:36 smithi173 ceph-mon[35397]: pgmap v389: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-03-27T08:33:37.946 INFO:teuthology.orchestra.run.smithi164.stdout:150323855434 2024-03-27T08:33:37.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-27T08:33:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 -- 172.21.15.164:0/3621528158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370113810 msgr2=0x7f9370115c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.128 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 --2- 172.21.15.164:0/3621528158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370113810 0x7f9370115c00 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f936800b0d0 tx=0x7f936800b3e0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 -- 172.21.15.164:0/3621528158 shutdown_connections 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 --2- 172.21.15.164:0/3621528158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370113810 0x7f9370115c00 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 --2- 172.21.15.164:0/3621528158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 0x7f9370074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 --2- 172.21.15.164:0/3621528158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370075190 0x7f93701132d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 -- 172.21.15.164:0/3621528158 >> 172.21.15.164:0/3621528158 conn(0x7f93700797a0 msgr2=0x7f9370079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 -- 172.21.15.164:0/3621528158 shutdown_connections 2024-03-27T08:33:38.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.136+0000 7f9376200700 1 -- 172.21.15.164:0/3621528158 wait complete. 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.137+0000 7f9376200700 1 Processor -- start 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.137+0000 7f9376200700 1 -- start start 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 0x7f937019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 0x7f937019f920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370113810 0x7f93701a3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9370119010 con 0x7f9370075190 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9370118e90 con 0x7f9370074870 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f9376200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9370119190 con 0x7f9370113810 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 0x7f937019f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936ea00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 0x7f937019f920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33774/0 (socket says 172.21.15.164:33774) 2024-03-27T08:33:38.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936ea00700 1 -- 172.21.15.164:0/3477060833 learned_addr learned my addr 172.21.15.164:0/3477060833 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936f400700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 0x7f937019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936fe00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370113810 0x7f93701a3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936ea00700 1 -- 172.21.15.164:0/3477060833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370113810 msgr2=0x7f93701a3cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.138+0000 7f936ea00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9370113810 0x7f93701a3cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f936ea00700 1 -- 172.21.15.164:0/3477060833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 msgr2=0x7f937019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f936ea00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 0x7f937019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f936ea00700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93701a43f0 con 0x7f9370075190 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f936f400700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9370074870 0x7f937019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:38.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f936ea00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 0x7f937019f920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c8f0 tx=0x7f935c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c004220 con 0x7f9370075190 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f935c007dd0 con 0x7f9370075190 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93701a46e0 con 0x7f9370075190 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.139+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93701abf60 con 0x7f9370075190 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.140+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f935c003df0 con 0x7f9370075190 2024-03-27T08:33:38.133 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.140+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9350001030 con 0x7f9370075190 2024-03-27T08:33:38.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.144+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f935c007900 con 0x7f9370075190 2024-03-27T08:33:38.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.145+0000 7f9367e00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f93540a3730 0x7f93540a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:38.137 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f935c0cfff0 con 0x7f9370075190 2024-03-27T08:33:38.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f936f400700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f93540a3730 0x7f93540a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:38.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f9367e00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] conn(0x7f93540ad270 0x7f93540af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:38.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93540afde0 con 0x7f93540ad270 2024-03-27T08:33:38.138 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f935c0d0420 con 0x7f9370075190 2024-03-27T08:33:38.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.146+0000 7f936fe00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] conn(0x7f93540ad270 0x7f93540af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:38.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.147+0000 7f936f400700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f93540a3730 0x7f93540a5bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9360005950 tx=0x7f9360005f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:38.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.147+0000 7f936fe00700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] conn(0x7f93540ad270 0x7f93540af710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:38.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.149+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== osd.3 v2:172.21.15.164:6810/2703443862 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93540afde0 con 0x7f93540ad270 2024-03-27T08:33:38.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.166+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 --> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9350002e60 con 0x7f93540ad270 2024-03-27T08:33:38.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.167+0000 7f9367e00700 1 -- 172.21.15.164:0/3477060833 <== osd.3 v2:172.21.15.164:6810/2703443862 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9350002e60 con 0x7f93540ad270 2024-03-27T08:33:38.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.167+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] conn(0x7f93540ad270 msgr2=0x7f93540af710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.167+0000 7f9376200700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] conn(0x7f93540ad270 0x7f93540af710 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f93540a3730 msgr2=0x7f93540a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f93540a3730 0x7f93540a5bf0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9360005950 tx=0x7f9360005f50 comp rx=0 tx=0).stop 2024-03-27T08:33:38.160 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 msgr2=0x7f937019f920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 --2- 172.21.15.164:0/3477060833 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9370075190 0x7f937019f920 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f935c00c8f0 tx=0x7f935c00ccb0 comp rx=0 tx=0).stop 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f936fe00700 1 -- 172.21.15.164:0/3477060833 reap_dead start 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 shutdown_connections 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 >> 172.21.15.164:0/3477060833 conn(0x7f93700797a0 msgr2=0x7f93701125d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 shutdown_connections 2024-03-27T08:33:38.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.168+0000 7f9376200700 1 -- 172.21.15.164:0/3477060833 wait complete. 2024-03-27T08:33:38.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:38 smithi167 ceph-mon[34903]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-27T08:33:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:38 smithi173 ceph-mon[35397]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-27T08:33:38.907 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:38 smithi164 ceph-mon[31788]: pgmap v390: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 6 op/s 2024-03-27T08:33:38.961 INFO:teuthology.orchestra.run.smithi164.stdout:322122547233 2024-03-27T08:33:38.961 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.10 2024-03-27T08:33:39.211 INFO:teuthology.orchestra.run.smithi164.stdout:206158430265 2024-03-27T08:33:39.212 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.6 2024-03-27T08:33:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.390+0000 7f29bf000700 1 -- 172.21.15.164:0/3846104552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8109860 msgr2=0x7f29b810d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.390+0000 7f29bf000700 1 --2- 172.21.15.164:0/3846104552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8109860 0x7f29b810d8b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f29a40099c0 tx=0x7f29a4009cd0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 -- 172.21.15.164:0/3846104552 shutdown_connections 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 --2- 172.21.15.164:0/3846104552 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b810df90 0x7f29b8115b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 --2- 172.21.15.164:0/3846104552 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b8108eb0 0x7f29b8109290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 --2- 172.21.15.164:0/3846104552 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8109860 0x7f29b810d8b0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 -- 172.21.15.164:0/3846104552 >> 172.21.15.164:0/3846104552 conn(0x7f29b8075e10 msgr2=0x7f29b8078230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 -- 172.21.15.164:0/3846104552 shutdown_connections 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.391+0000 7f29bf000700 1 -- 172.21.15.164:0/3846104552 wait complete. 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 Processor -- start 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 -- start start 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 0x7f29b819f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8109860 0x7f29b819f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b810df90 0x7f29b81a3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:39.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8118f60 con 0x7f29b8108eb0 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f29b8118de0 con 0x7f29b810df90 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.392+0000 7f29bf000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f29b81190e0 con 0x7f29b8109860 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 0x7f29b819f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 0x7f29b819f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33794/0 (socket says 172.21.15.164:33794) 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 -- 172.21.15.164:0/1976773030 learned_addr learned my addr 172.21.15.164:0/1976773030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7400700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8109860 0x7f29b819f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29bd000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b810df90 0x7f29b81a3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 -- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8109860 msgr2=0x7f29b819f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f29b8109860 0x7f29b819f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 -- 172.21.15.164:0/1976773030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b810df90 msgr2=0x7f29b81a3c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b810df90 0x7f29b81a3c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b81a43a0 con 0x7f29b8108eb0 2024-03-27T08:33:39.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29bd000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f29b810df90 0x7f29b81a3c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.393+0000 7f29b7e00700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 0x7f29b819f390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c9b0 tx=0x7f29a800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.394+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8007b00 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.394+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f29a8007ca0 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.394+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29b81a4690 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.394+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29a8018780 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.394+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29b81abf10 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.395+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f29b8062d50 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.397+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f29a800f450 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.398+0000 7f29b4c00700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f299c0a3730 0x7f299c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.398+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f29a80d03c0 con 0x7f29b8108eb0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29b7400700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f299c0a3730 0x7f299c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:39.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29b4c00700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] conn(0x7f299c0ad270 0x7f299c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f29a800f8e0 con 0x7f299c0ad270 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f29a80d0810 con 0x7f29b8108eb0 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29b7400700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f299c0a3730 0x7f299c0a5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.399+0000 7f29bd000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] conn(0x7f299c0ad270 0x7f299c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.400+0000 7f29bd000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] conn(0x7f299c0ad270 0x7f299c0af710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.403+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== osd.8 v2:172.21.15.173:6816/4192455767 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f29a800f8e0 con 0x7f299c0ad270 2024-03-27T08:33:39.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.420+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 --> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f29b80631d0 con 0x7f299c0ad270 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29b4c00700 1 -- 172.21.15.164:0/1976773030 <== osd.8 v2:172.21.15.173:6816/4192455767 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f29b80631d0 con 0x7f299c0ad270 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] conn(0x7f299c0ad270 msgr2=0x7f299c0af710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] conn(0x7f299c0ad270 0x7f299c0af710 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f299c0a3730 msgr2=0x7f299c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f299c0a3730 0x7f299c0a5bf0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f29a4000c00 tx=0x7f29a4005fb0 comp rx=0 tx=0).stop 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 msgr2=0x7f29b819f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bf000700 1 --2- 172.21.15.164:0/1976773030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f29b8108eb0 0x7f29b819f390 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f29a800c9b0 tx=0x7f29a800cd70 comp rx=0 tx=0).stop 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.422+0000 7f29bd000700 1 -- 172.21.15.164:0/1976773030 reap_dead start 2024-03-27T08:33:39.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.423+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 shutdown_connections 2024-03-27T08:33:39.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.423+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 >> 172.21.15.164:0/1976773030 conn(0x7f29b8075e10 msgr2=0x7f29b80769b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:39.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.423+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 shutdown_connections 2024-03-27T08:33:39.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:38.423+0000 7f29bf000700 1 -- 172.21.15.164:0/1976773030 wait complete. 2024-03-27T08:33:40.015 INFO:teuthology.orchestra.run.smithi164.stdout:266287972398 2024-03-27T08:33:40.015 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.8 2024-03-27T08:33:40.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:40 smithi167 ceph-mon[34903]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:40 smithi173 ceph-mon[35397]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:40.998 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:40 smithi164 ceph-mon[31788]: pgmap v391: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:41.256 INFO:teuthology.orchestra.run.smithi164.stdout:115964117073 2024-03-27T08:33:41.256 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-27T08:33:41.457 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 -- 172.21.15.164:0/3269033844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 msgr2=0x7fdb2006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 --2- 172.21.15.164:0/3269033844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2006a770 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c0099c0 tx=0x7fdb0c009cd0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 -- 172.21.15.164:0/3269033844 shutdown_connections 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 --2- 172.21.15.164:0/3269033844 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb2006acb0 0x7fdb2010f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 --2- 172.21.15.164:0/3269033844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb20108670 0x7fdb20108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 --2- 172.21.15.164:0/3269033844 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2006a770 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 -- 172.21.15.164:0/3269033844 >> 172.21.15.164:0/3269033844 conn(0x7fdb20078470 msgr2=0x7fdb20078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:41.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.501+0000 7fdb28000700 1 -- 172.21.15.164:0/3269033844 shutdown_connections 2024-03-27T08:33:41.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.502+0000 7fdb28000700 1 -- 172.21.15.164:0/3269033844 wait complete. 2024-03-27T08:33:41.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.503+0000 7fdb28000700 1 Processor -- start 2024-03-27T08:33:41.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.503+0000 7fdb28000700 1 -- start start 2024-03-27T08:33:41.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb2006acb0 0x7fdb2019fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb20108670 0x7fdb2010e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20112900 con 0x7fdb2006a2f0 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20112780 con 0x7fdb20108670 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb28000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdb20112a80 con 0x7fdb2006acb0 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb25600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb25600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2019f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33802/0 (socket says 172.21.15.164:33802) 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb25600700 1 -- 172.21.15.164:0/1444935956 learned_addr learned my addr 172.21.15.164:0/1444935956 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:41.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.504+0000 7fdb24c00700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb2006acb0 0x7fdb2019fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb26000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb20108670 0x7fdb2010e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 -- 172.21.15.164:0/1444935956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb2006acb0 msgr2=0x7fdb2019fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdb2006acb0 0x7fdb2019fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 -- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb20108670 msgr2=0x7fdb2010e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb20108670 0x7fdb2010e6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb2010efb0 con 0x7fdb2006a2f0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb25600700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2019f980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb30 tx=0x7fdb1400eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400cd40 con 0x7fdb2006a2f0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdb140044f0 con 0x7fdb2006a2f0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.505+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb14010490 con 0x7fdb2006a2f0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.506+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb2010f2a0 con 0x7fdb2006a2f0 2024-03-27T08:33:41.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.506+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb2019b660 con 0x7fdb2006a2f0 2024-03-27T08:33:41.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.507+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdb201008c0 con 0x7fdb2006a2f0 2024-03-27T08:33:41.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.509+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fdb14004000 con 0x7fdb2006a2f0 2024-03-27T08:33:41.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.511+0000 7fdb1e000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdb080a37b0 0x7fdb080a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.511+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fdb140d0400 con 0x7fdb2006a2f0 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.511+0000 7fdb1e000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] conn(0x7fdb080ad2f0 0x7fdb080af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.511+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb14023e50 con 0x7fdb080ad2f0 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.511+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7fdb140d0850 con 0x7fdb2006a2f0 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.512+0000 7fdb24c00700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdb080a37b0 0x7fdb080a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.512+0000 7fdb26000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] conn(0x7fdb080ad2f0 0x7fdb080af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.513+0000 7fdb24c00700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdb080a37b0 0x7fdb080a5c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb20103340 tx=0x7fdb0c005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.513+0000 7fdb26000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] conn(0x7fdb080ad2f0 0x7fdb080af790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.515+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== osd.7 v2:172.21.15.167:6816/3522297748 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdb14023e50 con 0x7fdb080ad2f0 2024-03-27T08:33:41.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.536+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 --> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdb20103d40 con 0x7fdb080ad2f0 2024-03-27T08:33:41.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb1e000700 1 -- 172.21.15.164:0/1444935956 <== osd.7 v2:172.21.15.167:6816/3522297748 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fdb20103d40 con 0x7fdb080ad2f0 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] conn(0x7fdb080ad2f0 msgr2=0x7fdb080af790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] conn(0x7fdb080ad2f0 0x7fdb080af790 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdb080a37b0 msgr2=0x7fdb080a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdb080a37b0 0x7fdb080a5c70 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fdb20103340 tx=0x7fdb0c005fb0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 msgr2=0x7fdb2019f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.537+0000 7fdb28000700 1 --2- 172.21.15.164:0/1444935956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdb2006a2f0 0x7fdb2019f980 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdb1400eb30 tx=0x7fdb1400eef0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.538+0000 7fdb26000700 1 -- 172.21.15.164:0/1444935956 reap_dead start 2024-03-27T08:33:41.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.538+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 shutdown_connections 2024-03-27T08:33:41.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.538+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 >> 172.21.15.164:0/1444935956 conn(0x7fdb20078470 msgr2=0x7fdb200ffee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:41.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.538+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 shutdown_connections 2024-03-27T08:33:41.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.538+0000 7fdb28000700 1 -- 172.21.15.164:0/1444935956 wait complete. 2024-03-27T08:33:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 -- 172.21.15.164:0/4229696316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c103050 msgr2=0x7f487c10f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 --2- 172.21.15.164:0/4229696316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c103050 0x7f487c10f550 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f487400b0a0 tx=0x7f487400b3b0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 -- 172.21.15.164:0/4229696316 shutdown_connections 2024-03-27T08:33:41.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 --2- 172.21.15.164:0/4229696316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c103050 0x7f487c10f550 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 --2- 172.21.15.164:0/4229696316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487c108680 0x7f487c108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 --2- 172.21.15.164:0/4229696316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f487c102690 0x7f487c102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.776+0000 7f4884000700 1 -- 172.21.15.164:0/4229696316 >> 172.21.15.164:0/4229696316 conn(0x7f487c0797a0 msgr2=0x7f487c079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.777+0000 7f4884000700 1 -- 172.21.15.164:0/4229696316 shutdown_connections 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.777+0000 7f4884000700 1 -- 172.21.15.164:0/4229696316 wait complete. 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 Processor -- start 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 -- start start 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 0x7f487c19b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f487c103050 0x7f487c19b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487c108680 0x7f487c19f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f487c112a30 con 0x7f487c102690 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f487c1128b0 con 0x7f487c108680 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4884000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f487c112bb0 con 0x7f487c103050 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.778+0000 7f4881600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 0x7f487c19b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 0x7f487c19b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33832/0 (socket says 172.21.15.164:33832) 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 -- 172.21.15.164:0/2655751330 learned_addr learned my addr 172.21.15.164:0/2655751330 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4880c00700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f487c103050 0x7f487c19b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4882000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487c108680 0x7f487c19f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 -- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f487c103050 msgr2=0x7f487c19b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f487c103050 0x7f487c19b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 -- 172.21.15.164:0/2655751330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487c108680 msgr2=0x7f487c19f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f487c108680 0x7f487c19f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f487c1a0030 con 0x7f487c102690 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.779+0000 7f4881600700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 0x7f487c19b020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f487000d950 tx=0x7f487000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.780+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4870016070 con 0x7f487c102690 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.780+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f487c1a0320 con 0x7f487c102690 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.780+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f487000fd60 con 0x7f487c102690 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.780+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487000e3b0 con 0x7f487c102690 2024-03-27T08:33:41.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.780+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f487c1a7ba0 con 0x7f487c102690 2024-03-27T08:33:41.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.781+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f487c100ee0 con 0x7f487c102690 2024-03-27T08:33:41.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.783+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f4870019070 con 0x7f487c102690 2024-03-27T08:33:41.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f487a000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48640a3730 0x7f48640a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f48700cfe90 con 0x7f487c102690 2024-03-27T08:33:41.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f4880c00700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48640a3730 0x7f48640a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f487a000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] conn(0x7f48640ad270 0x7f48640af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:41.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4870005690 con 0x7f48640ad270 2024-03-27T08:33:41.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.785+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_get_version_reply(handle=1 version=90) ==== 24+0+0 (secure 0 0 0) 0x7f48700d02e0 con 0x7f487c102690 2024-03-27T08:33:41.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.786+0000 7f4880c00700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48640a3730 0x7f48640a5bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f487c0768d0 tx=0x7f486800a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.786+0000 7f4882000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] conn(0x7f48640ad270 0x7f48640af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:41.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.787+0000 7f4882000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] conn(0x7f48640ad270 0x7f48640af710 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:41.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.789+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== osd.11 v2:172.21.15.173:6824/2517065128 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4870005690 con 0x7f48640ad270 2024-03-27T08:33:41.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.807+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 --> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f487c103dc0 con 0x7f48640ad270 2024-03-27T08:33:41.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.808+0000 7f487a000700 1 -- 172.21.15.164:0/2655751330 <== osd.11 v2:172.21.15.173:6824/2517065128 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f487c103dc0 con 0x7f48640ad270 2024-03-27T08:33:41.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.808+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] conn(0x7f48640ad270 msgr2=0x7f48640af710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] conn(0x7f48640ad270 0x7f48640af710 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48640a3730 msgr2=0x7f48640a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48640a3730 0x7f48640a5bf0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f487c0768d0 tx=0x7f486800a300 comp rx=0 tx=0).stop 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 msgr2=0x7f487c19b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 --2- 172.21.15.164:0/2655751330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f487c102690 0x7f487c19b020 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f487000d950 tx=0x7f487000dc60 comp rx=0 tx=0).stop 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4882000700 1 -- 172.21.15.164:0/2655751330 reap_dead start 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 shutdown_connections 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 >> 172.21.15.164:0/2655751330 conn(0x7f487c0797a0 msgr2=0x7f487c100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 shutdown_connections 2024-03-27T08:33:41.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:41.809+0000 7f4884000700 1 -- 172.21.15.164:0/2655751330 wait complete. 2024-03-27T08:33:42.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:42 smithi173 ceph-mon[35397]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:42 smithi164 ceph-mon[31788]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:42 smithi167 ceph-mon[34903]: pgmap v392: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:42.913 INFO:teuthology.orchestra.run.smithi164.stdout:356482285594 2024-03-27T08:33:42.913 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.11 2024-03-27T08:33:43.171 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:43.171 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:43.181 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:43.182 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:43.182 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:44.219 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:44.250 INFO:teuthology.orchestra.run.smithi164.stdout:231928234040 2024-03-27T08:33:44.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph osd last-stat-seq osd.7 2024-03-27T08:33:44.328 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:44 smithi164 ceph-mon[31788]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:44 smithi167 ceph-mon[34903]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:44 smithi173 ceph-mon[35397]: pgmap v393: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:46.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:46 smithi167 ceph-mon[34903]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:46 smithi173 ceph-mon[35397]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:46.956 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:46 smithi164 ceph-mon[31788]: pgmap v394: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:47.640 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:48 smithi164 ceph-mon[31788]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:48.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:48 smithi167 ceph-mon[34903]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:48.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:48 smithi173 ceph-mon[35397]: pgmap v395: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:50.066 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:33:50.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.506+0000 7f667fc00700 1 -- 172.21.15.164:0/2584582323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678108620 msgr2=0x7f6678108a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.506+0000 7f667fc00700 1 --2- 172.21.15.164:0/2584582323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678108620 0x7f6678108a00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f666c009990 tx=0x7f666c009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 -- 172.21.15.164:0/2584582323 shutdown_connections 2024-03-27T08:33:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 --2- 172.21.15.164:0/2584582323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678102fe0 0x7f667810f4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 --2- 172.21.15.164:0/2584582323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678108620 0x7f6678108a00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 --2- 172.21.15.164:0/2584582323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 0x7f6678102aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 -- 172.21.15.164:0/2584582323 >> 172.21.15.164:0/2584582323 conn(0x7f66780fe0f0 msgr2=0x7f6678100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 -- 172.21.15.164:0/2584582323 shutdown_connections 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.507+0000 7f667fc00700 1 -- 172.21.15.164:0/2584582323 wait complete. 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 Processor -- start 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 -- start start 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 0x7f6678198d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678108620 0x7f667819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6678112920 con 0x7f6678102fe0 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66781127a0 con 0x7f6678108620 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.508+0000 7f667fc00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6678112aa0 con 0x7f6678102620 2024-03-27T08:33:50.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36878/0 (socket says 172.21.15.164:36878) 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 -- 172.21.15.164:0/3528716081 learned_addr learned my addr 172.21.15.164:0/3528716081 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f667d200700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 0x7f6678198d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f667dc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678108620 0x7f667819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 -- 172.21.15.164:0/3528716081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 msgr2=0x7f6678198d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 0x7f6678198d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 -- 172.21.15.164:0/3528716081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678108620 msgr2=0x7f667819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678108620 0x7f667819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 -- 172.21.15.164:0/3528716081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f667819dda0 con 0x7f6678102fe0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.509+0000 7f6677e00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f666400d950 tx=0x7f666400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.510+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6664016070 con 0x7f6678102fe0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.510+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6664009b40 con 0x7f6678102fe0 2024-03-27T08:33:50.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.510+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f666400f620 con 0x7f6678102fe0 2024-03-27T08:33:50.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.510+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f667819e090 con 0x7f6678102fe0 2024-03-27T08:33:50.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.510+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66781a5910 con 0x7f6678102fe0 2024-03-27T08:33:50.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.511+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f667810abb0 con 0x7f6678102fe0 2024-03-27T08:33:50.421 INFO:teuthology.orchestra.run.smithi164.stdout:171798691909 2024-03-27T08:33:50.421 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.513+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f6664019070 con 0x7f6678102fe0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.514+0000 7f6675600700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 0x7f66600a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.514+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f66640cfad0 con 0x7f6678102fe0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.515+0000 7f667d200700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 0x7f66600a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.515+0000 7f667d200700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 0x7f66600a5c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f666c006010 tx=0x7f666c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.517+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f666409c4f0 con 0x7f6678102fe0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.756+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f667810a590 con 0x7f6678102fe0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.757+0000 7f6675600700 1 -- 172.21.15.164:0/3528716081 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f666409bdf0 con 0x7f6678102fe0 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 msgr2=0x7f66600a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 0x7f66600a5c70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f666c006010 tx=0x7f666c00b540 comp rx=0 tx=0).stop 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 msgr2=0x7f66781992d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f666400d950 tx=0x7f666400dd10 comp rx=0 tx=0).stop 2024-03-27T08:33:50.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 shutdown_connections 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f66600a37b0 0x7f66600a5c70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6678108620 0x7f667819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6678102620 0x7f6678198d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 --2- 172.21.15.164:0/3528716081 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6678102fe0 0x7f66781992d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 >> 172.21.15.164:0/3528716081 conn(0x7f66780fe0f0 msgr2=0x7f66780fe850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 shutdown_connections 2024-03-27T08:33:50.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:49.760+0000 7f667fc00700 1 -- 172.21.15.164:0/3528716081 wait complete. 2024-03-27T08:33:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:50 smithi167 ceph-mon[34903]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:33:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3528716081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T08:33:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:50.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:50 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:50 smithi173 ceph-mon[35397]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:33:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3528716081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T08:33:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:50.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:50 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:50.845 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:50 smithi164 ceph-mon[31788]: pgmap v396: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:33:50.845 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:33:50.845 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3528716081' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-27T08:33:50.845 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:50.845 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:50 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:52 smithi167 ceph-mon[34903]: pgmap v397: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:52 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:52 smithi173 ceph-mon[35397]: pgmap v397: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:52 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.945 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:52 smithi164 ceph-mon[31788]: pgmap v397: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:52.945 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:52.945 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:52 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:53.145 INFO:tasks.cephadm.ceph_manager.ceph:need seq 171798691904 got 171798691909 for osd.5 2024-03-27T08:33:53.145 DEBUG:teuthology.parallel:result is None 2024-03-27T08:33:54.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:54 smithi173 ceph-mon[35397]: pgmap v398: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:54.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:54 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:54 smithi164 ceph-mon[31788]: pgmap v398: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:54 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:54.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:54.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:54 smithi167 ceph-mon[34903]: pgmap v398: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:54.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:54 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 -- 172.21.15.164:0/2259906119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 msgr2=0x7f3930108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 --2- 172.21.15.164:0/2259906119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f3930108a60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f3920009990 tx=0x7f3920009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 -- 172.21.15.164:0/2259906119 shutdown_connections 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 --2- 172.21.15.164:0/2259906119 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930103050 0x7f393010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 --2- 172.21.15.164:0/2259906119 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f3930108a60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 --2- 172.21.15.164:0/2259906119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930102690 0x7f3930102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 -- 172.21.15.164:0/2259906119 >> 172.21.15.164:0/2259906119 conn(0x7f39300797a0 msgr2=0x7f3930079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 -- 172.21.15.164:0/2259906119 shutdown_connections 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.954+0000 7f3935e00700 1 -- 172.21.15.164:0/2259906119 wait complete. 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.955+0000 7f3935e00700 1 Processor -- start 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 -- start start 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930102690 0x7f3930074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 0x7f3930074e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f39301129f0 con 0x7f3930108680 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3930112870 con 0x7f3930103050 2024-03-27T08:33:56.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f3935e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3930112b70 con 0x7f3930102690 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f392f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f392f400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45860/0 (socket says 172.21.15.164:45860) 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f392f400700 1 -- 172.21.15.164:0/3578376612 learned_addr learned my addr 172.21.15.164:0/3578376612 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.956+0000 7f392e000700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 0x7f3930074e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392ea00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930102690 0x7f3930074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 -- 172.21.15.164:0/3578376612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930102690 msgr2=0x7f3930074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930102690 0x7f3930074940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 -- 172.21.15.164:0/3578376612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 msgr2=0x7f3930074e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 0x7f3930074e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 -- 172.21.15.164:0/3578376612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39301a73b0 con 0x7f3930108680 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392e000700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 0x7f3930074e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:56.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f392f400700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f392800ab50 tx=0x7f392800af10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3928017020 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39301a76a0 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.957+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3928004bb0 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.958+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39280053e0 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.958+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39301a7c30 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.959+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3930069300 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.961+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f3928005580 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.963+0000 7f3934a00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 0x7f39140a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.963+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f39280cf5b0 con 0x7f3930108680 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.963+0000 7f392ea00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 0x7f39140a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.964+0000 7f392ea00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 0x7f39140a5bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f392000b5c0 tx=0x7f3920005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:56.572 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:55.972+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3928021020 con 0x7f3930108680 2024-03-27T08:33:56.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.213+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3930075e70 con 0x7f3930108680 2024-03-27T08:33:56.573 INFO:teuthology.orchestra.run.smithi164.stdout:322122547236 2024-03-27T08:33:56.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.213+0000 7f3934a00700 1 -- 172.21.15.164:0/3578376612 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f392809c060 con 0x7f3930108680 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 msgr2=0x7f39140a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 0x7f39140a5bf0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f392000b5c0 tx=0x7f3920005fd0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 msgr2=0x7f39300753c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f392800ab50 tx=0x7f392800af10 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 shutdown_connections 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f39140a3730 0x7f39140a5bf0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3930108680 0x7f39300753c0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3930102690 0x7f3930074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 --2- 172.21.15.164:0/3578376612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3930103050 0x7f3930074e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 >> 172.21.15.164:0/3578376612 conn(0x7f39300797a0 msgr2=0x7f39301006a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 shutdown_connections 2024-03-27T08:33:56.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.216+0000 7f3935e00700 1 -- 172.21.15.164:0/3578376612 wait complete. 2024-03-27T08:33:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:56 smithi164 ceph-mon[31788]: pgmap v399: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:56 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3578376612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T08:33:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:56 smithi167 ceph-mon[34903]: pgmap v399: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:57.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:56 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:57.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3578376612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T08:33:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:56 smithi173 ceph-mon[35397]: pgmap v399: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:33:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:56 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:33:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3578376612' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.679+0000 7fc2f1200700 1 -- 172.21.15.164:0/68734375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec108680 msgr2=0x7fc2ec108a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.679+0000 7fc2f1200700 1 --2- 172.21.15.164:0/68734375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec108680 0x7fc2ec108a60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc009990 tx=0x7fc2dc009ca0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 -- 172.21.15.164:0/68734375 shutdown_connections 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 --2- 172.21.15.164:0/68734375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec103050 0x7fc2ec10f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 --2- 172.21.15.164:0/68734375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec108680 0x7fc2ec108a60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 --2- 172.21.15.164:0/68734375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 -- 172.21.15.164:0/68734375 >> 172.21.15.164:0/68734375 conn(0x7fc2ec0797a0 msgr2=0x7fc2ec079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:57.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 -- 172.21.15.164:0/68734375 shutdown_connections 2024-03-27T08:33:57.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.680+0000 7fc2f1200700 1 -- 172.21.15.164:0/68734375 wait complete. 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.681+0000 7fc2f1200700 1 Processor -- start 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.681+0000 7fc2f1200700 1 -- start start 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec19b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec103050 0x7fc2ec19b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec1129f0 con 0x7fc2ec108680 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec112870 con 0x7fc2ec103050 2024-03-27T08:33:57.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2f1200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2ec112b70 con 0x7fc2ec102690 2024-03-27T08:33:57.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2ea800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:57.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2ea800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45886/0 (socket says 172.21.15.164:45886) 2024-03-27T08:33:57.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2ea800700 1 -- 172.21.15.164:0/4053157740 learned_addr learned my addr 172.21.15.164:0/4053157740 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:33:57.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2e9400700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec103050 0x7fc2ec19b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:57.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2e9e00700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec19b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.682+0000 7fc2ea800700 1 -- 172.21.15.164:0/4053157740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 msgr2=0x7fc2ec19b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2ea800700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec19b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2ea800700 1 -- 172.21.15.164:0/4053157740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec103050 msgr2=0x7fc2ec19b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2ea800700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec103050 0x7fc2ec19b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2ea800700 1 -- 172.21.15.164:0/4053157740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2ec1a00f0 con 0x7fc2ec108680 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2e9e00700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.683+0000 7fc2ea800700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400efc0 tx=0x7fc2e400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.684+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e40092e0 con 0x7fc2ec108680 2024-03-27T08:33:57.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.684+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e4004bb0 con 0x7fc2ec108680 2024-03-27T08:33:57.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.684+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2ec1a0380 con 0x7fc2ec108680 2024-03-27T08:33:57.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.684+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4004280 con 0x7fc2ec108680 2024-03-27T08:33:57.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.684+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2ec1a7c60 con 0x7fc2ec108680 2024-03-27T08:33:57.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.685+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2ec069300 con 0x7fc2ec108680 2024-03-27T08:33:57.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.687+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fc2e401b030 con 0x7fc2ec108680 2024-03-27T08:33:57.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.689+0000 7fc2e2a00700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 0x7fc2d00a5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:33:57.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.689+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc2e40d01b0 con 0x7fc2ec108680 2024-03-27T08:33:57.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.689+0000 7fc2e9e00700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 0x7fc2d00a5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:33:57.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.690+0000 7fc2e9e00700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 0x7fc2d00a5d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc006010 tx=0x7fc2dc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:33:57.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.692+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc2e4022020 con 0x7fc2ec108680 2024-03-27T08:33:57.749 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:57 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1933634751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T08:33:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.961+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fc2ec1a7e90 con 0x7fc2ec108680 2024-03-27T08:33:57.953 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.961+0000 7fc2e2a00700 1 -- 172.21.15.164:0/4053157740 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc2e4010040 con 0x7fc2ec108680 2024-03-27T08:33:57.953 INFO:teuthology.orchestra.run.smithi164.stdout:300647710762 2024-03-27T08:33:57.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.964+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 msgr2=0x7fc2d00a5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.964+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 0x7fc2d00a5d40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc006010 tx=0x7fc2dc01a040 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.964+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 msgr2=0x7fc2ec19f9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.964+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fc2e400efc0 tx=0x7fc2e400c3a0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 shutdown_connections 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d00a3880 0x7fc2d00a5d40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2ec108680 0x7fc2ec19f9b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2ec102690 0x7fc2ec19b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 --2- 172.21.15.164:0/4053157740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2ec103050 0x7fc2ec19b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 >> 172.21.15.164:0/4053157740 conn(0x7fc2ec0797a0 msgr2=0x7fc2ec100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 shutdown_connections 2024-03-27T08:33:57.957 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:57.965+0000 7fc2f1200700 1 -- 172.21.15.164:0/4053157740 wait complete. 2024-03-27T08:33:58.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:57 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1933634751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T08:33:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:57 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1933634751' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-27T08:33:58.278 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547233 got 322122547236 for osd.10 2024-03-27T08:33:58.278 DEBUG:teuthology.parallel:result is None 2024-03-27T08:33:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:58 smithi164 ceph-mon[31788]: pgmap v400: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:58 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4053157740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T08:33:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:58 smithi167 ceph-mon[34903]: pgmap v400: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:58 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4053157740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T08:33:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:58 smithi173 ceph-mon[35397]: pgmap v400: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:33:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:58 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4053157740' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-03-27T08:33:59.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:33:59 smithi164 ceph-mon[31788]: pgmap v401: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:33:59 smithi167 ceph-mon[34903]: pgmap v401: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:00.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:33:59 smithi173 ceph-mon[35397]: pgmap v401: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 -- 172.21.15.164:0/1033455211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101ef0 msgr2=0x7f87e810e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 --2- 172.21.15.164:0/1033455211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101ef0 0x7f87e810e3d0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f87e000b0a0 tx=0x7f87e000b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 -- 172.21.15.164:0/1033455211 shutdown_connections 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 --2- 172.21.15.164:0/1033455211 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101ef0 0x7f87e810e3d0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 --2- 172.21.15.164:0/1033455211 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8107640 0x7f87e8107a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 --2- 172.21.15.164:0/1033455211 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8101530 0x7f87e81019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 -- 172.21.15.164:0/1033455211 >> 172.21.15.164:0/1033455211 conn(0x7f87e80784b0 msgr2=0x7f87e80788c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 -- 172.21.15.164:0/1033455211 shutdown_connections 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.803+0000 7f87f0000700 1 -- 172.21.15.164:0/1033455211 wait complete. 2024-03-27T08:34:00.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.804+0000 7f87f0000700 1 Processor -- start 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 -- start start 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8101ef0 0x7f87e81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 0x7f87e819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f87e8111850 con 0x7f87e8101530 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81116d0 con 0x7f87e8107640 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87f0000700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87e81119d0 con 0x7f87e8101ef0 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87ed600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87ed600700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45892/0 (socket says 172.21.15.164:45892) 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.805+0000 7f87ed600700 1 -- 172.21.15.164:0/366318639 learned_addr learned my addr 172.21.15.164:0/366318639 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ee000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 0x7f87e819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ecc00700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8101ef0 0x7f87e81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 -- 172.21.15.164:0/366318639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8101ef0 msgr2=0x7f87e81992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8101ef0 0x7f87e81992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 -- 172.21.15.164:0/366318639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 msgr2=0x7f87e819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 0x7f87e819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 -- 172.21.15.164:0/366318639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e819ddb0 con 0x7f87e8101530 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ee000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 0x7f87e819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.806+0000 7f87ed600700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00d980 tx=0x7f87dc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.807+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc017070 con 0x7f87e8101530 2024-03-27T08:34:00.197 INFO:teuthology.orchestra.run.smithi164.stdout:266287972402 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.807+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e819e0a0 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.807+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f87dc004d00 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.807+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87dc005520 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.807+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e81a5920 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.809+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87e8102c50 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.811+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f87dc004750 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.812+0000 7f87e6000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 0x7f87d00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.812+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f87dc0cfa40 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.813+0000 7f87ecc00700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 0x7f87d00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.813+0000 7f87ecc00700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 0x7f87d00a5bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87d4005950 tx=0x7f87d40058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.820+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f87dc020020 con 0x7f87e8101530 2024-03-27T08:34:00.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.060+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f87e8063250 con 0x7f87e8101530 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.061+0000 7f87e6000700 1 -- 172.21.15.164:0/366318639 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f87dc09c4c0 con 0x7f87e8101530 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.063+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 msgr2=0x7f87d00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.063+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 0x7f87d00a5bf0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f87d4005950 tx=0x7f87d40058e0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.063+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 msgr2=0x7f87e8198da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f87dc00d980 tx=0x7f87dc00dd40 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 shutdown_connections 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f87d00a3730 0x7f87d00a5bf0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f87e8107640 0x7f87e819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f87e8101530 0x7f87e8198da0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 --2- 172.21.15.164:0/366318639 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f87e8101ef0 0x7f87e81992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 >> 172.21.15.164:0/366318639 conn(0x7f87e80784b0 msgr2=0x7f87e81007f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 shutdown_connections 2024-03-27T08:34:00.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.064+0000 7f87f0000700 1 -- 172.21.15.164:0/366318639 wait complete. 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.913+0000 7f56bca00700 1 -- 172.21.15.164:0/3319433349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b806acb0 msgr2=0x7f56b810f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.913+0000 7f56bca00700 1 --2- 172.21.15.164:0/3319433349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b806acb0 0x7f56b810f4d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f56b000b0a0 tx=0x7f56b000b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.913+0000 7f56bca00700 1 -- 172.21.15.164:0/3319433349 shutdown_connections 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 --2- 172.21.15.164:0/3319433349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b806acb0 0x7f56b810f4d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 --2- 172.21.15.164:0/3319433349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b8108670 0x7f56b8108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 --2- 172.21.15.164:0/3319433349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b806a2f0 0x7f56b806a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 -- 172.21.15.164:0/3319433349 >> 172.21.15.164:0/3319433349 conn(0x7f56b8078470 msgr2=0x7f56b8078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:00.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 -- 172.21.15.164:0/3319433349 shutdown_connections 2024-03-27T08:34:00.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.914+0000 7f56bca00700 1 -- 172.21.15.164:0/3319433349 wait complete. 2024-03-27T08:34:00.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.915+0000 7f56bca00700 1 Processor -- start 2024-03-27T08:34:00.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.915+0000 7f56bca00700 1 -- start start 2024-03-27T08:34:00.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.915+0000 7f56bca00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b806a2f0 0x7f56b819ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56bca00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b806acb0 0x7f56b819b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56bca00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56bca00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f56b81128f0 con 0x7f56b806acb0 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56bca00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8112770 con 0x7f56b8108670 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56bca00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f56b8112a70 con 0x7f56b806a2f0 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56b6800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56b5e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b806a2f0 0x7f56b819ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56b6800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:45140/0 (socket says 172.21.15.164:45140) 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.916+0000 7f56b6800700 1 -- 172.21.15.164:0/2429320695 learned_addr learned my addr 172.21.15.164:0/2429320695 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 -- 172.21.15.164:0/2429320695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b806a2f0 msgr2=0x7f56b819ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b806a2f0 0x7f56b819ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 -- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b806acb0 msgr2=0x7f56b819b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b806acb0 0x7f56b819b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 -- 172.21.15.164:0/2429320695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56b819fdf0 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.917+0000 7f56b6800700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56b0006070 tx=0x7f56b0004d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.918+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b0021070 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.918+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f56b0003c00 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.918+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56b001d450 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.918+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56b81a0080 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.919+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56b81a7960 con 0x7f56b8108670 2024-03-27T08:34:00.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.920+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56b8103d40 con 0x7f56b8108670 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.925+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f56b0003db0 con 0x7f56b8108670 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.926+0000 7f56aea00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 0x7f569c0a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.927+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f56b000f070 con 0x7f56b8108670 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.927+0000 7f56b5e00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 0x7f569c0a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.927+0000 7f56b5e00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 0x7f569c0a5c70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009c60 tx=0x7f56a8009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:59.931+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f56b009d820 con 0x7f56b8108670 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.176+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f56b81a7b30 con 0x7f56b8108670 2024-03-27T08:34:00.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.177+0000 7f56aea00700 1 -- 172.21.15.164:0/2429320695 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f56b009d120 con 0x7f56b8108670 2024-03-27T08:34:00.590 INFO:teuthology.orchestra.run.smithi164.stdout:115964117078 2024-03-27T08:34:00.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.179+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 msgr2=0x7f569c0a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.179+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 0x7f569c0a5c70 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f56a8009c60 tx=0x7f56a8009260 comp rx=0 tx=0).stop 2024-03-27T08:34:00.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.179+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 msgr2=0x7f56b819f6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:00.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.179+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56b0006070 tx=0x7f56b0004d70 comp rx=0 tx=0).stop 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 shutdown_connections 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f569c0a37b0 0x7f569c0a5c70 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56b8108670 0x7f56b819f6b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f56b806a2f0 0x7f56b819ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 --2- 172.21.15.164:0/2429320695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f56b806acb0 0x7f56b819b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 >> 172.21.15.164:0/2429320695 conn(0x7f56b8078470 msgr2=0x7f56b810d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 shutdown_connections 2024-03-27T08:34:00.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:00.180+0000 7f56bca00700 1 -- 172.21.15.164:0/2429320695 wait complete. 2024-03-27T08:34:00.892 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/366318639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T08:34:00.892 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2429320695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T08:34:00.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/366318639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T08:34:00.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2429320695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T08:34:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/366318639' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-03-27T08:34:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2429320695' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 -- 172.21.15.164:0/50964319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 msgr2=0x7f85d010efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 --2- 172.21.15.164:0/50964319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d010efe0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f85c800b0a0 tx=0x7f85c800b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 -- 172.21.15.164:0/50964319 shutdown_connections 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 --2- 172.21.15.164:0/50964319 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d010efe0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 --2- 172.21.15.164:0/50964319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d0103b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 --2- 172.21.15.164:0/50964319 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 0x7f85d010c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 -- 172.21.15.164:0/50964319 >> 172.21.15.164:0/50964319 conn(0x7f85d00fcf20 msgr2=0x7f85d00ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 -- 172.21.15.164:0/50964319 shutdown_connections 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.500+0000 7f85cf200700 1 -- 172.21.15.164:0/50964319 wait complete. 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.501+0000 7f85cf200700 1 Processor -- start 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 -- start start 2024-03-27T08:34:01.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 0x7f85d0101930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f85d01128a0 con 0x7f85d010cb70 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0112720 con 0x7f85d0103790 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cf200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f85d0112a20 con 0x7f85d01040b0 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85ce800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cde00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cde00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:45098/0 (socket says 172.21.15.164:45098) 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85ce800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45878/0 (socket says 172.21.15.164:45878) 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.502+0000 7f85cde00700 1 -- 172.21.15.164:0/1933634751 learned_addr learned my addr 172.21.15.164:0/1933634751 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85cd400700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 0x7f85d0101930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 -- 172.21.15.164:0/1933634751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 msgr2=0x7f85d0101930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 0x7f85d0101930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 -- 172.21.15.164:0/1933634751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 msgr2=0x7f85d01013f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 -- 172.21.15.164:0/1933634751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85d01a7240 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85cde00700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85ce800700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85c800b070 tx=0x7f85c8004cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8021070 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85c8007e50 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.503+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85d01a74d0 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.504+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85c8004780 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.504+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85d01a7a10 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.505+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85d0069300 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.507+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f85c8003c00 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.508+0000 7f85c6a00700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 0x7f85b40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.508+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f85c800f020 con 0x7f85d010cb70 2024-03-27T08:34:01.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.508+0000 7f85cde00700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 0x7f85b40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.509+0000 7f85cde00700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 0x7f85b40a5bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85c0011550 tx=0x7f85c0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:01.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.510+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f85c802a020 con 0x7f85d010cb70 2024-03-27T08:34:01.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.725+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f85d0102920 con 0x7f85d010cb70 2024-03-27T08:34:01.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.725+0000 7f85c6a00700 1 -- 172.21.15.164:0/1933634751 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f85c809e0e0 con 0x7f85d010cb70 2024-03-27T08:34:01.095 INFO:teuthology.orchestra.run.smithi164.stdout:55834574947 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 msgr2=0x7f85b40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 0x7f85b40a5bf0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f85c0011550 tx=0x7f85c0009260 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 msgr2=0x7f85d0101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f85c800b070 tx=0x7f85c8004cf0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 shutdown_connections 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f85b40a3730 0x7f85b40a5bf0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f85d010cb70 0x7f85d0101e70 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85d0103790 0x7f85d01013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 --2- 172.21.15.164:0/1933634751 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f85d01040b0 0x7f85d0101930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.728+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 >> 172.21.15.164:0/1933634751 conn(0x7f85d00fcf20 msgr2=0x7f85d00fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.729+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 shutdown_connections 2024-03-27T08:34:01.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:33:56.729+0000 7f85cf200700 1 -- 172.21.15.164:0/1933634751 wait complete. 2024-03-27T08:34:01.331 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:01.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 -- 172.21.15.164:0/3809418433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b3006a2f0 msgr2=0x7f9b3006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 --2- 172.21.15.164:0/3809418433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b3006a2f0 0x7f9b3006a770 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0099c0 tx=0x7f9b1c009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 -- 172.21.15.164:0/3809418433 shutdown_connections 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 --2- 172.21.15.164:0/3809418433 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006acb0 0x7f9b3010f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 --2- 172.21.15.164:0/3809418433 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b30108670 0x7f9b30108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 --2- 172.21.15.164:0/3809418433 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b3006a2f0 0x7f9b3006a770 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.154+0000 7f9b37800700 1 -- 172.21.15.164:0/3809418433 >> 172.21.15.164:0/3809418433 conn(0x7f9b30078470 msgr2=0x7f9b30078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.155+0000 7f9b37800700 1 -- 172.21.15.164:0/3809418433 shutdown_connections 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.155+0000 7f9b37800700 1 -- 172.21.15.164:0/3809418433 wait complete. 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 Processor -- start 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 -- start start 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 0x7f9b3019af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b3006acb0 0x7f9b3019b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9b301128f0 con 0x7f9b30108670 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30112770 con 0x7f9b3006a2f0 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.156+0000 7f9b37800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9b30112a70 con 0x7f9b3006acb0 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45928/0 (socket says 172.21.15.164:45928) 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 -- 172.21.15.164:0/3001797794 learned_addr learned my addr 172.21.15.164:0/3001797794 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b34e00700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 0x7f9b3019af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b2fe00700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b3006acb0 0x7f9b3019b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 -- 172.21.15.164:0/3001797794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b3006acb0 msgr2=0x7f9b3019b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b3006acb0 0x7f9b3019b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 -- 172.21.15.164:0/3001797794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 msgr2=0x7f9b3019af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 0x7f9b3019af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 -- 172.21.15.164:0/3001797794 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3019ff50 con 0x7f9b30108670 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b34e00700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 0x7f9b3019af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b35800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b28007ee0 tx=0x7f9b2800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.157+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2800ddd0 con 0x7f9b30108670 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.158+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b28004020 con 0x7f9b30108670 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.158+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b28015660 con 0x7f9b30108670 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.158+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b301a0240 con 0x7f9b30108670 2024-03-27T08:34:01.427 INFO:teuthology.orchestra.run.smithi164.stdout:77309411421 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.158+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b301a7ac0 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.159+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b30069300 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.162+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f9b280041d0 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.164+0000 7f9b2d600700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 0x7f9b180a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.164+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9b280d0360 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.166+0000 7f9b34e00700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 0x7f9b180a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.166+0000 7f9b34e00700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 0x7f9b180a5bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b24005e10 tx=0x7f9b24005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.168+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9b28010070 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.391+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9b301a7c90 con 0x7f9b30108670 2024-03-27T08:34:01.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.391+0000 7f9b2d600700 1 -- 172.21.15.164:0/3001797794 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9b2809cd80 con 0x7f9b30108670 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 msgr2=0x7f9b180a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 0x7f9b180a5bf0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f9b24005e10 tx=0x7f9b24005d80 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 msgr2=0x7f9b3019f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f9b28007ee0 tx=0x7f9b2800d3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 shutdown_connections 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b180a3730 0x7f9b180a5bf0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b30108670 0x7f9b3019f810 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b3006a2f0 0x7f9b3019af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.393+0000 7f9b37800700 1 --2- 172.21.15.164:0/3001797794 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b3006acb0 0x7f9b3019b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.394+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 >> 172.21.15.164:0/3001797794 conn(0x7f9b30078470 msgr2=0x7f9b300fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.394+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 shutdown_connections 2024-03-27T08:34:01.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:01.394+0000 7f9b37800700 1 -- 172.21.15.164:0/3001797794 wait complete. 2024-03-27T08:34:01.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:01 smithi164 ceph-mon[31788]: pgmap v402: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:01.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:01 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3001797794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T08:34:02.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:01 smithi167 ceph-mon[34903]: pgmap v402: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:02.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:01 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3001797794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T08:34:02.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:01 smithi173 ceph-mon[35397]: pgmap v402: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:02.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:01 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3001797794' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 -- 172.21.15.164:0/1698325950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101c20 msgr2=0x7fecd810e8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 --2- 172.21.15.164:0/1698325950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101c20 0x7fecd810e8e0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009990 tx=0x7fecc4009ca0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 -- 172.21.15.164:0/1698325950 shutdown_connections 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 --2- 172.21.15.164:0/1698325950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd810ee20 0x7fecd8111210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 --2- 172.21.15.164:0/1698325950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd8101270 0x7fecd8101650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 --2- 172.21.15.164:0/1698325950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101c20 0x7fecd810e8e0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 -- 172.21.15.164:0/1698325950 >> 172.21.15.164:0/1698325950 conn(0x7fecd80fcf10 msgr2=0x7fecd80ff330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:02.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 -- 172.21.15.164:0/1698325950 shutdown_connections 2024-03-27T08:34:02.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.207+0000 7fecde800700 1 -- 172.21.15.164:0/1698325950 wait complete. 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.208+0000 7fecde800700 1 Processor -- start 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.208+0000 7fecde800700 1 -- start start 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd8101c20 0x7fecd819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd810ee20 0x7fecd819f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8114ae0 con 0x7fecd8101270 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8114960 con 0x7fecd810ee20 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecde800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fecd8114c60 con 0x7fecd8101c20 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecdd400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecdd400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45948/0 (socket says 172.21.15.164:45948) 2024-03-27T08:34:02.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecdd400700 1 -- 172.21.15.164:0/136282290 learned_addr learned my addr 172.21.15.164:0/136282290 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:02.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecdde00700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd810ee20 0x7fecd819f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:02.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.209+0000 7fecdca00700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd8101c20 0x7fecd819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:02.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 -- 172.21.15.164:0/136282290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd8101c20 msgr2=0x7fecd819b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd8101c20 0x7fecd819b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 -- 172.21.15.164:0/136282290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd810ee20 msgr2=0x7fecd819f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd810ee20 0x7fecd819f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 -- 172.21.15.164:0/136282290 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecd819ff50 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecdd400700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d980 tx=0x7feccc00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc016070 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feccc004d00 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feccc005550 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.210+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecd81a0240 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.211+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecd81a7ac0 con 0x7fecd8101270 2024-03-27T08:34:02.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.212+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecd8069300 con 0x7fecd8101270 2024-03-27T08:34:02.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.215+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7feccc004750 con 0x7fecd8101270 2024-03-27T08:34:02.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.217+0000 7fecd6000700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 0x7fecc00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:02.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.217+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7feccc0d0230 con 0x7fecd8101270 2024-03-27T08:34:02.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.217+0000 7fecdca00700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 0x7fecc00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:02.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.218+0000 7fecdca00700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 0x7fecc00a5bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b5c0 tx=0x7fecc4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:02.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.220+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7feccc01f020 con 0x7fecd8101270 2024-03-27T08:34:02.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.461+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fecd802dd30 con 0x7fecd8101270 2024-03-27T08:34:02.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.462+0000 7fecd6000700 1 -- 172.21.15.164:0/136282290 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feccc09cc50 con 0x7fecd8101270 2024-03-27T08:34:02.454 INFO:teuthology.orchestra.run.smithi164.stdout:34359738475 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 msgr2=0x7fecc00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 0x7fecc00a5bf0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fecc400b5c0 tx=0x7fecc4005fd0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 msgr2=0x7fecd819af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7feccc00d980 tx=0x7feccc00dc90 comp rx=0 tx=0).stop 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 shutdown_connections 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fecc00a3730 0x7fecc00a5bf0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fecd810ee20 0x7fecd819f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fecd8101270 0x7fecd819af90 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 --2- 172.21.15.164:0/136282290 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fecd8101c20 0x7fecd819b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:02.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 >> 172.21.15.164:0/136282290 conn(0x7fecd80fcf10 msgr2=0x7fecd80ff300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:02.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 shutdown_connections 2024-03-27T08:34:02.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:02.465+0000 7fecde800700 1 -- 172.21.15.164:0/136282290 wait complete. 2024-03-27T08:34:02.715 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:02.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:02 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/136282290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T08:34:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:02 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/136282290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T08:34:03.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:02 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/136282290' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-27T08:34:03.289 INFO:tasks.cephadm.ceph_manager.ceph:need seq 300647710757 got 300647710762 for osd.9 2024-03-27T08:34:03.290 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:03.734 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574941 got 55834574947 for osd.1 2024-03-27T08:34:03.734 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:03.876 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:03 smithi164 ceph-mon[31788]: pgmap v403: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:04.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:03 smithi167 ceph-mon[34903]: pgmap v403: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:04.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:03 smithi173 ceph-mon[35397]: pgmap v403: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 -- 172.21.15.164:0/4106306861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 msgr2=0x7f2834111430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 --2- 172.21.15.164:0/4106306861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f2834111430 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f282c00b0a0 tx=0x7f282c00b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 -- 172.21.15.164:0/4106306861 shutdown_connections 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 --2- 172.21.15.164:0/4106306861 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f2834111430 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 --2- 172.21.15.164:0/4106306861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834074870 0x7f2834074c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 --2- 172.21.15.164:0/4106306861 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834075190 0x7f283410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 -- 172.21.15.164:0/4106306861 >> 172.21.15.164:0/4106306861 conn(0x7f2834079770 msgr2=0x7f2834079b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:04.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 -- 172.21.15.164:0/4106306861 shutdown_connections 2024-03-27T08:34:04.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.214+0000 7f283ac00700 1 -- 172.21.15.164:0/4106306861 wait complete. 2024-03-27T08:34:04.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.215+0000 7f283ac00700 1 Processor -- start 2024-03-27T08:34:04.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.215+0000 7f283ac00700 1 -- start start 2024-03-27T08:34:04.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834074870 0x7f283419af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:04.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 0x7f283419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:04.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:04.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2834114ae0 con 0x7f283410f040 2024-03-27T08:34:04.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2834114960 con 0x7f2834075190 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f283ac00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2834114c60 con 0x7f2834074870 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45976/0 (socket says 172.21.15.164:45976) 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 -- 172.21.15.164:0/3635127067 learned_addr learned my addr 172.21.15.164:0/3635127067 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2833400700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 0x7f283419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2833e00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834074870 0x7f283419af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 -- 172.21.15.164:0/3635127067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834074870 msgr2=0x7f283419af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834074870 0x7f283419af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 -- 172.21.15.164:0/3635127067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 msgr2=0x7f283419b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 0x7f283419b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2838c00700 1 -- 172.21.15.164:0/3635127067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f283419ff50 con 0x7f283410f040 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.216+0000 7f2833400700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 0x7f283419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.217+0000 7f2838c00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f282c006070 tx=0x7f282c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:04.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.217+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c021070 con 0x7f283410f040 2024-03-27T08:34:04.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.217+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28341a01e0 con 0x7f283410f040 2024-03-27T08:34:04.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.217+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f282c007c80 con 0x7f283410f040 2024-03-27T08:34:04.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.217+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28341a7ac0 con 0x7f283410f040 2024-03-27T08:34:04.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.218+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f282c021070 con 0x7f283410f040 2024-03-27T08:34:04.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.218+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2834069300 con 0x7f283410f040 2024-03-27T08:34:04.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.221+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f282c004000 con 0x7f283410f040 2024-03-27T08:34:04.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.222+0000 7f2830c00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 0x7f28180a5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:04.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.222+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f282c00f030 con 0x7f283410f040 2024-03-27T08:34:04.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.222+0000 7f2833e00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 0x7f28180a5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:04.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.223+0000 7f2833e00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 0x7f28180a5df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2824009bf0 tx=0x7f2824009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:04.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.224+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f282c09dc30 con 0x7f283410f040 2024-03-27T08:34:04.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.451+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f283419c2a0 con 0x7f283410f040 2024-03-27T08:34:04.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.453+0000 7f2830c00700 1 -- 172.21.15.164:0/3635127067 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f282c09d530 con 0x7f283410f040 2024-03-27T08:34:04.445 INFO:teuthology.orchestra.run.smithi164.stdout:206158430273 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 msgr2=0x7f28180a5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 0x7f28180a5df0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2824009bf0 tx=0x7f2824009260 comp rx=0 tx=0).stop 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 msgr2=0x7f283419f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f282c006070 tx=0x7f282c004e20 comp rx=0 tx=0).stop 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 shutdown_connections 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f28180a3930 0x7f28180a5df0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f283410f040 0x7f283419f810 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2834074870 0x7f283419af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 --2- 172.21.15.164:0/3635127067 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2834075190 0x7f283419b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:04.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.456+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 >> 172.21.15.164:0/3635127067 conn(0x7f2834079770 msgr2=0x7f28340ff850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:04.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.457+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 shutdown_connections 2024-03-27T08:34:04.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.457+0000 7f283ac00700 1 -- 172.21.15.164:0/3635127067 wait complete. 2024-03-27T08:34:04.553 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738470 got 34359738475 for osd.0 2024-03-27T08:34:04.554 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:04.725 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/564811148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T08:34:04.725 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3635127067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T08:34:05.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/564811148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T08:34:05.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3635127067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T08:34:05.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/564811148' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-27T08:34:05.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3635127067' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-03-27T08:34:05.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 -- 172.21.15.164:0/3291914656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe02006a2f0 msgr2=0x7fe02006a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:05.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 --2- 172.21.15.164:0/3291914656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe02006a2f0 0x7fe02006a770 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fe0080099c0 tx=0x7fe008009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 -- 172.21.15.164:0/3291914656 shutdown_connections 2024-03-27T08:34:05.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 --2- 172.21.15.164:0/3291914656 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02010f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 --2- 172.21.15.164:0/3291914656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe020108670 0x7fe020108a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 --2- 172.21.15.164:0/3291914656 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe02006a2f0 0x7fe02006a770 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.772+0000 7fe026800700 1 -- 172.21.15.164:0/3291914656 >> 172.21.15.164:0/3291914656 conn(0x7fe020078470 msgr2=0x7fe020078880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.773+0000 7fe026800700 1 -- 172.21.15.164:0/3291914656 shutdown_connections 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.773+0000 7fe026800700 1 -- 172.21.15.164:0/3291914656 wait complete. 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 Processor -- start 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 -- start start 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02006a2f0 0x7fe02019af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02019b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe020112900 con 0x7fe020108670 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe020112780 con 0x7fe02006a2f0 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe026800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe020112a80 con 0x7fe02006acb0 2024-03-27T08:34:05.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.774+0000 7fe01fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45960/0 (socket says 172.21.15.164:45960) 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 -- 172.21.15.164:0/564811148 learned_addr learned my addr 172.21.15.164:0/564811148 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01f400700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02006a2f0 0x7fe02019af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe017e00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02019b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 -- 172.21.15.164:0/564811148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 msgr2=0x7fe02019b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02019b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 -- 172.21.15.164:0/564811148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02006a2f0 msgr2=0x7fe02019af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02006a2f0 0x7fe02019af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 -- 172.21.15.164:0/564811148 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe02019ff80 con 0x7fe020108670 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe017e00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.775+0000 7fe01fe00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe01800ef30 tx=0x7fe01800c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.776+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0180092e0 con 0x7fe020108670 2024-03-27T08:34:05.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.776+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe018004bb0 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.776+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0201a0210 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.776+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe018004280 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.776+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0201a7af0 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.777+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe020069300 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.779+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7fe01801b030 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.780+0000 7fe01cc00700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 0x7fe0040a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.781+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe0180cfa30 con 0x7fe020108670 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.781+0000 7fe01f400700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 0x7fe0040a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.782+0000 7fe01f400700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 0x7fe0040a5bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe010009c60 tx=0x7fe010009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:05.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:03.785+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fe018022020 con 0x7fe020108670 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stdout:150323855440 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.019+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe0201a7cc0 con 0x7fe020108670 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.020+0000 7fe01cc00700 1 -- 172.21.15.164:0/564811148 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe018010040 con 0x7fe020108670 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 msgr2=0x7fe0040a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 0x7fe0040a5bf0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fe010009c60 tx=0x7fe010009260 comp rx=0 tx=0).stop 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 msgr2=0x7fe02019f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe01800ef30 tx=0x7fe01800c3a0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 shutdown_connections 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe0040a3730 0x7fe0040a5bf0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe020108670 0x7fe02019f840 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe02006a2f0 0x7fe02019af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 --2- 172.21.15.164:0/564811148 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe02006acb0 0x7fe02019b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 >> 172.21.15.164:0/564811148 conn(0x7fe020078470 msgr2=0x7fe02010d800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 shutdown_connections 2024-03-27T08:34:05.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:04.023+0000 7fe026800700 1 -- 172.21.15.164:0/564811148 wait complete. 2024-03-27T08:34:05.781 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:05 smithi164 ceph-mon[31788]: pgmap v404: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:06.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:05 smithi167 ceph-mon[34903]: pgmap v404: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:06.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:05 smithi173 ceph-mon[35397]: pgmap v404: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:06.788 INFO:tasks.cephadm.ceph_manager.ceph:need seq 115964117073 got 115964117078 for osd.3 2024-03-27T08:34:06.788 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:07.720 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430265 got 206158430273 for osd.6 2024-03-27T08:34:07.720 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:08.311 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411415 got 77309411421 for osd.2 2024-03-27T08:34:08.312 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:08.322 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972398 got 266287972402 for osd.8 2024-03-27T08:34:08.322 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:08.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:08 smithi164 ceph-mon[31788]: pgmap v405: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:08.772 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:08 smithi167 ceph-mon[34903]: pgmap v405: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:08 smithi173 ceph-mon[35397]: pgmap v405: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:10.150 INFO:tasks.cephadm.ceph_manager.ceph:need seq 150323855434 got 150323855440 for osd.4 2024-03-27T08:34:10.151 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 -- 172.21.15.164:0/3231181341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800102690 msgr2=0x7f6800102b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 --2- 172.21.15.164:0/3231181341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800102690 0x7f6800102b10 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f67e8009990 tx=0x7f67e8009ca0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 -- 172.21.15.164:0/3231181341 shutdown_connections 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 --2- 172.21.15.164:0/3231181341 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800103050 0x7f680010f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 --2- 172.21.15.164:0/3231181341 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800108680 0x7f6800108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 --2- 172.21.15.164:0/3231181341 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800102690 0x7f6800102b10 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.383+0000 7f6807400700 1 -- 172.21.15.164:0/3231181341 >> 172.21.15.164:0/3231181341 conn(0x7f68000797a0 msgr2=0x7f6800079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:10.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.384+0000 7f6807400700 1 -- 172.21.15.164:0/3231181341 shutdown_connections 2024-03-27T08:34:10.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.384+0000 7f6807400700 1 -- 172.21.15.164:0/3231181341 wait complete. 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 Processor -- start 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 -- start start 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800102690 0x7f680019b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800103050 0x7f680019b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.385+0000 7f6807400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6800112a30 con 0x7f6800108680 2024-03-27T08:34:10.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6807400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68001128b0 con 0x7f6800102690 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6807400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6800112bb0 con 0x7f6800103050 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6804a00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800102690 0x7f680019b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43328/0 (socket says 172.21.15.164:43328) 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 -- 172.21.15.164:0/3561408404 learned_addr learned my addr 172.21.15.164:0/3561408404 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f67f7e00700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800103050 0x7f680019b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 -- 172.21.15.164:0/3561408404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800103050 msgr2=0x7f680019b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800103050 0x7f680019b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 -- 172.21.15.164:0/3561408404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800102690 msgr2=0x7f680019b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800102690 0x7f680019b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.386+0000 7f6805400700 1 -- 172.21.15.164:0/3561408404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001a00b0 con 0x7f6800108680 2024-03-27T08:34:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f6805400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67f8007f10 tx=0x7f67f800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8009e20 con 0x7f6800108680 2024-03-27T08:34:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001a03a0 con 0x7f6800108680 2024-03-27T08:34:10.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f67f800dbd0 con 0x7f6800108680 2024-03-27T08:34:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8005980 con 0x7f6800108680 2024-03-27T08:34:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.387+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68001a7c20 con 0x7f6800108680 2024-03-27T08:34:10.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.388+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6800069300 con 0x7f6800108680 2024-03-27T08:34:10.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.390+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f67f801a020 con 0x7f6800108680 2024-03-27T08:34:10.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.391+0000 7f67fe000700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 0x7f67e40a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.392+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f67f80cf5c0 con 0x7f6800108680 2024-03-27T08:34:10.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.392+0000 7f6804a00700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 0x7f67e40a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.392+0000 7f6804a00700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 0x7f67e40a5bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67f00045b0 tx=0x7f67f000b3c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:10.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.396+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f67f8010070 con 0x7f6800108680 2024-03-27T08:34:10.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.630+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f68001a7e50 con 0x7f6800108680 2024-03-27T08:34:10.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.631+0000 7f67fe000700 1 -- 172.21.15.164:0/3561408404 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f67f809bfe0 con 0x7f6800108680 2024-03-27T08:34:10.623 INFO:teuthology.orchestra.run.smithi164.stdout:356482285600 2024-03-27T08:34:10.626 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:10 smithi164 ceph-mon[31788]: pgmap v406: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:10.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 msgr2=0x7f67e40a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 0x7f67e40a5bf0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f67f00045b0 tx=0x7f67f000b3c0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 msgr2=0x7f680019f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f67f8007f10 tx=0x7f67f800d3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 shutdown_connections 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f67e40a3730 0x7f67e40a5bf0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6800108680 0x7f680019f970 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6800102690 0x7f680019b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 --2- 172.21.15.164:0/3561408404 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6800103050 0x7f680019b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.634+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 >> 172.21.15.164:0/3561408404 conn(0x7f68000797a0 msgr2=0x7f6800100500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.635+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 shutdown_connections 2024-03-27T08:34:10.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.635+0000 7f6807400700 1 -- 172.21.15.164:0/3561408404 wait complete. 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 -- 172.21.15.164:0/2585277759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80103050 msgr2=0x7f9b8010f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 --2- 172.21.15.164:0/2585277759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80103050 0x7f9b8010f550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f9b7800b0a0 tx=0x7f9b7800b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 -- 172.21.15.164:0/2585277759 shutdown_connections 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 --2- 172.21.15.164:0/2585277759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80103050 0x7f9b8010f550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 --2- 172.21.15.164:0/2585277759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 0x7f9b80108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 --2- 172.21.15.164:0/2585277759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80102690 0x7f9b80102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 -- 172.21.15.164:0/2585277759 >> 172.21.15.164:0/2585277759 conn(0x7f9b800797a0 msgr2=0x7f9b80079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:10.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 -- 172.21.15.164:0/2585277759 shutdown_connections 2024-03-27T08:34:10.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.721+0000 7f9b87e00700 1 -- 172.21.15.164:0/2585277759 wait complete. 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.722+0000 7f9b87e00700 1 Processor -- start 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.722+0000 7f9b87e00700 1 -- start start 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.722+0000 7f9b87e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b87e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80103050 0x7f9b80199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b87e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 0x7f9b8019d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b87e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9b801129a0 con 0x7f9b80102690 2024-03-27T08:34:10.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b87e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b80112820 con 0x7f9b80103050 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b87e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9b80112b20 con 0x7f9b80108680 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43346/0 (socket says 172.21.15.164:43346) 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 -- 172.21.15.164:0/4264010466 learned_addr learned my addr 172.21.15.164:0/4264010466 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b84a00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80103050 0x7f9b80199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 0x7f9b8019d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 -- 172.21.15.164:0/4264010466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 msgr2=0x7f9b8019d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 0x7f9b8019d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 -- 172.21.15.164:0/4264010466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80103050 msgr2=0x7f9b80199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80103050 0x7f9b80199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.723+0000 7f9b85400700 1 -- 172.21.15.164:0/4264010466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b8019de00 con 0x7f9b80102690 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b85400700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c970 tx=0x7f9b7400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74007aa0 con 0x7f9b80102690 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b74004d00 con 0x7f9b80102690 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b8019e0f0 con 0x7f9b80102690 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b801a5970 con 0x7f9b80102690 2024-03-27T08:34:10.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.724+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b74005600 con 0x7f9b80102690 2024-03-27T08:34:10.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.726+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b60005330 con 0x7f9b80102690 2024-03-27T08:34:10.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.727+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f9b74007c40 con 0x7f9b80102690 2024-03-27T08:34:10.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.729+0000 7f9b7e000700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 0x7f9b680a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.729+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9b740cfb80 con 0x7f9b80102690 2024-03-27T08:34:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.729+0000 7f9b84a00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 0x7f9b680a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:10.721 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.730+0000 7f9b84a00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 0x7f9b680a5bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b80079e10 tx=0x7f9b6c00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:10.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.733+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9b7409c630 con 0x7f9b80102690 2024-03-27T08:34:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:10 smithi167 ceph-mon[34903]: pgmap v406: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:10 smithi173 ceph-mon[35397]: pgmap v406: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:10.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.963+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9b600058f0 con 0x7f9b80102690 2024-03-27T08:34:10.955 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.963+0000 7f9b7e000700 1 -- 172.21.15.164:0/4264010466 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f9b7409bf30 con 0x7f9b80102690 2024-03-27T08:34:10.955 INFO:teuthology.orchestra.run.smithi164.stdout:231928234045 2024-03-27T08:34:10.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 msgr2=0x7f9b680a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 0x7f9b680a5bf0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9b80079e10 tx=0x7f9b6c00b410 comp rx=0 tx=0).stop 2024-03-27T08:34:10.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 msgr2=0x7f9b80198df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:10.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f9b7400c970 tx=0x7f9b7400cc80 comp rx=0 tx=0).stop 2024-03-27T08:34:10.958 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 shutdown_connections 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b680a3730 0x7f9b680a5bf0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9b80108680 0x7f9b8019d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9b80102690 0x7f9b80198df0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 --2- 172.21.15.164:0/4264010466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b80103050 0x7f9b80199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 >> 172.21.15.164:0/4264010466 conn(0x7f9b800797a0 msgr2=0x7f9b80100700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 shutdown_connections 2024-03-27T08:34:10.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:10.966+0000 7f9b87e00700 1 -- 172.21.15.164:0/4264010466 wait complete. 2024-03-27T08:34:11.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:11 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3561408404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T08:34:11.666 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:11 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4264010466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T08:34:11.726 INFO:tasks.cephadm.ceph_manager.ceph:need seq 231928234040 got 231928234045 for osd.7 2024-03-27T08:34:11.726 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:11.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:11 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3561408404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T08:34:11.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:11 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4264010466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T08:34:11.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:11 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3561408404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-03-27T08:34:11.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:11 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4264010466' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-03-27T08:34:12.066 INFO:tasks.cephadm.ceph_manager.ceph:need seq 356482285594 got 356482285600 for osd.11 2024-03-27T08:34:12.066 DEBUG:teuthology.parallel:result is None 2024-03-27T08:34:12.067 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-27T08:34:12.067 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-27T08:34:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:12 smithi164 ceph-mon[31788]: pgmap v407: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:12 smithi167 ceph-mon[34903]: pgmap v407: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:12 smithi173 ceph-mon[35397]: pgmap v407: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:12.966 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:14.529 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:14 smithi164 ceph-mon[31788]: pgmap v408: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:14 smithi167 ceph-mon[34903]: pgmap v408: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:14 smithi173 ceph-mon[35397]: pgmap v408: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 -- 172.21.15.164:0/24445494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18103050 msgr2=0x7f7d1810f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 --2- 172.21.15.164:0/24445494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18103050 0x7f7d1810f550 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b0a0 tx=0x7f7d1000b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 -- 172.21.15.164:0/24445494 shutdown_connections 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 --2- 172.21.15.164:0/24445494 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18103050 0x7f7d1810f550 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 --2- 172.21.15.164:0/24445494 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18108680 0x7f7d18108a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 --2- 172.21.15.164:0/24445494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18102690 0x7f7d18102b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 -- 172.21.15.164:0/24445494 >> 172.21.15.164:0/24445494 conn(0x7f7d180797a0 msgr2=0x7f7d18079bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 -- 172.21.15.164:0/24445494 shutdown_connections 2024-03-27T08:34:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.036+0000 7f7d1f200700 1 -- 172.21.15.164:0/24445494 wait complete. 2024-03-27T08:34:15.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.037+0000 7f7d1f200700 1 Processor -- start 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.037+0000 7f7d1f200700 1 -- start start 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.037+0000 7f7d1f200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18102690 0x7f7d18074940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1f200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18103050 0x7f7d18074e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1f200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1f200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7d181129f0 con 0x7f7d18108680 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1f200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18112870 con 0x7f7d18103050 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1f200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7d18112b70 con 0x7f7d18102690 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43362/0 (socket says 172.21.15.164:43362) 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 -- 172.21.15.164:0/1844422397 learned_addr learned my addr 172.21.15.164:0/1844422397 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:15.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d17400700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18103050 0x7f7d18074e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d17e00700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18102690 0x7f7d18074940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:15.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 -- 172.21.15.164:0/1844422397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18102690 msgr2=0x7f7d18074940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18102690 0x7f7d18074940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 -- 172.21.15.164:0/1844422397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18103050 msgr2=0x7f7d18074e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18103050 0x7f7d18074e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.038+0000 7f7d1d200700 1 -- 172.21.15.164:0/1844422397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d181a7380 con 0x7f7d18108680 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d1d200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b070 tx=0x7f7d10004da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10021070 con 0x7f7d18108680 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7d10003c00 con 0x7f7d18108680 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d181a7610 con 0x7f7d18108680 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d1001d450 con 0x7f7d18108680 2024-03-27T08:34:15.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.039+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d181a7ac0 con 0x7f7d18108680 2024-03-27T08:34:15.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.040+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d18069300 con 0x7f7d18108680 2024-03-27T08:34:15.034 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.042+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 17) ==== 138422+0+0 (secure 0 0 0) 0x7f7d10007a00 con 0x7f7d18108680 2024-03-27T08:34:15.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.044+0000 7f7d14c00700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 0x7f7cfc0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.044+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7d1000f020 con 0x7f7d18108680 2024-03-27T08:34:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.044+0000 7f7d17e00700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 0x7f7cfc0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:15.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.045+0000 7f7d17e00700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 0x7f7cfc0a5bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005fd0 tx=0x7f7d08005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:15.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.048+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7d1002a020 con 0x7f7d18108680 2024-03-27T08:34:15.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.281+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d18062a80 con 0x7f7cfc0a3730 2024-03-27T08:34:15.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.305+0000 7f7d14c00700 1 -- 172.21.15.164:0/1844422397 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258725 (secure 0 0 0) 0x7f7d18062a80 con 0x7f7cfc0a3730 2024-03-27T08:34:15.299 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:15.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 msgr2=0x7f7cfc0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:15.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 0x7f7cfc0a5bf0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7d08005fd0 tx=0x7f7d08005ee0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 msgr2=0x7f7d180753c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:15.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b070 tx=0x7f7d10004da0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 shutdown_connections 2024-03-27T08:34:15.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7cfc0a3730 0x7f7cfc0a5bf0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7d18108680 0x7f7d180753c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7d18102690 0x7f7d18074940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 --2- 172.21.15.164:0/1844422397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7d18103050 0x7f7d18074e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:15.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.310+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 >> 172.21.15.164:0/1844422397 conn(0x7f7d180797a0 msgr2=0x7f7d181006e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:15.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.312+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 shutdown_connections 2024-03-27T08:34:15.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:15.312+0000 7f7d1f200700 1 -- 172.21.15.164:0/1844422397 wait complete. 2024-03-27T08:34:15.305 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:34:16.059 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":408,"stamp":"2024-03-27T08:34:13.340511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655649,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":629,"num_read_kb":429,"num_write":341,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362720,"kb_used_data":13500,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579104,"statfs":{"total":1151940427776,"available":1151569002496,"internally_reserved":0,"allocated":13824000,"data_stored":7578795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005169"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.463209+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:33:18.463209+0000","last_peered":"2024-03-27T08:33:18.463209+0000","last_clean":"2024-03-27T08:33:18.463209+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:33:18.463209+0000","last_undegraded":"2024-03-27T08:33:18.463209+0000","last_fullsized":"2024-03-27T08:33:18.463209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453310+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:33:18.453310+0000","last_peered":"2024-03-27T08:33:18.453310+0000","last_clean":"2024-03-27T08:33:18.453310+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:33:18.453310+0000","last_undegraded":"2024-03-27T08:33:18.453310+0000","last_fullsized":"2024-03-27T08:33:18.453310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453221+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:33:18.453221+0000","last_peered":"2024-03-27T08:33:18.453221+0000","last_clean":"2024-03-27T08:33:18.453221+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:33:18.453221+0000","last_undegraded":"2024-03-27T08:33:18.453221+0000","last_fullsized":"2024-03-27T08:33:18.453221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.610547+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:33:18.610547+0000","last_peered":"2024-03-27T08:33:18.610547+0000","last_clean":"2024-03-27T08:33:18.610547+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:33:18.610547+0000","last_undegraded":"2024-03-27T08:33:18.610547+0000","last_fullsized":"2024-03-27T08:33:18.610547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459181+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:33:18.459181+0000","last_peered":"2024-03-27T08:33:18.459181+0000","last_clean":"2024-03-27T08:33:18.459181+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:33:18.459181+0000","last_undegraded":"2024-03-27T08:33:18.459181+0000","last_fullsized":"2024-03-27T08:33:18.459181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456503+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:33:18.456503+0000","last_peered":"2024-03-27T08:33:18.456503+0000","last_clean":"2024-03-27T08:33:18.456503+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:33:18.456503+0000","last_undegraded":"2024-03-27T08:33:18.456503+0000","last_fullsized":"2024-03-27T08:33:18.456503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453060+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:33:18.453060+0000","last_peered":"2024-03-27T08:33:18.453060+0000","last_clean":"2024-03-27T08:33:18.453060+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:33:18.453060+0000","last_undegraded":"2024-03-27T08:33:18.453060+0000","last_fullsized":"2024-03-27T08:33:18.453060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466377+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:33:18.466377+0000","last_peered":"2024-03-27T08:33:18.466377+0000","last_clean":"2024-03-27T08:33:18.466377+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:33:18.466377+0000","last_undegraded":"2024-03-27T08:33:18.466377+0000","last_fullsized":"2024-03-27T08:33:18.466377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661145+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:33:18.661145+0000","last_peered":"2024-03-27T08:33:18.661145+0000","last_clean":"2024-03-27T08:33:18.661145+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:33:18.661145+0000","last_undegraded":"2024-03-27T08:33:18.661145+0000","last_fullsized":"2024-03-27T08:33:18.661145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.668027+0000","last_change":"2024-03-27T08:33:18.668027+0000","last_active":"2024-03-27T08:33:18.668027+0000","last_peered":"2024-03-27T08:33:18.668027+0000","last_clean":"2024-03-27T08:33:18.668027+0000","last_became_active":"2024-03-27T08:33:18.667495+0000","last_became_peered":"2024-03-27T08:33:18.667495+0000","last_unstale":"2024-03-27T08:33:18.668027+0000","last_undegraded":"2024-03-27T08:33:18.668027+0000","last_fullsized":"2024-03-27T08:33:18.668027+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:00:53.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453545+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:33:18.453545+0000","last_peered":"2024-03-27T08:33:18.453545+0000","last_clean":"2024-03-27T08:33:18.453545+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:33:18.453545+0000","last_undegraded":"2024-03-27T08:33:18.453545+0000","last_fullsized":"2024-03-27T08:33:18.453545+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.610714+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:33:18.610714+0000","last_peered":"2024-03-27T08:33:18.610714+0000","last_clean":"2024-03-27T08:33:18.610714+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:33:18.610714+0000","last_undegraded":"2024-03-27T08:33:18.610714+0000","last_fullsized":"2024-03-27T08:33:18.610714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450452+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:33:18.450452+0000","last_peered":"2024-03-27T08:33:18.450452+0000","last_clean":"2024-03-27T08:33:18.450452+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:33:18.450452+0000","last_undegraded":"2024-03-27T08:33:18.450452+0000","last_fullsized":"2024-03-27T08:33:18.450452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453458+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:33:18.453458+0000","last_peered":"2024-03-27T08:33:18.453458+0000","last_clean":"2024-03-27T08:33:18.453458+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:33:18.453458+0000","last_undegraded":"2024-03-27T08:33:18.453458+0000","last_fullsized":"2024-03-27T08:33:18.453458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453518+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:33:18.453518+0000","last_peered":"2024-03-27T08:33:18.453518+0000","last_clean":"2024-03-27T08:33:18.453518+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:33:18.453518+0000","last_undegraded":"2024-03-27T08:33:18.453518+0000","last_fullsized":"2024-03-27T08:33:18.453518+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660391+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:33:18.660391+0000","last_peered":"2024-03-27T08:33:18.660391+0000","last_clean":"2024-03-27T08:33:18.660391+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:33:18.660391+0000","last_undegraded":"2024-03-27T08:33:18.660391+0000","last_fullsized":"2024-03-27T08:33:18.660391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.463547+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:33:18.463547+0000","last_peered":"2024-03-27T08:33:18.463547+0000","last_clean":"2024-03-27T08:33:18.463547+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:33:18.463547+0000","last_undegraded":"2024-03-27T08:33:18.463547+0000","last_fullsized":"2024-03-27T08:33:18.463547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.663170+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:33:18.663170+0000","last_peered":"2024-03-27T08:33:18.663170+0000","last_clean":"2024-03-27T08:33:18.663170+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:33:18.663170+0000","last_undegraded":"2024-03-27T08:33:18.663170+0000","last_fullsized":"2024-03-27T08:33:18.663170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466238+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:33:18.466238+0000","last_peered":"2024-03-27T08:33:18.466238+0000","last_clean":"2024-03-27T08:33:18.466238+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:33:18.466238+0000","last_undegraded":"2024-03-27T08:33:18.466238+0000","last_fullsized":"2024-03-27T08:33:18.466238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666490+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:33:18.666490+0000","last_peered":"2024-03-27T08:33:18.666490+0000","last_clean":"2024-03-27T08:33:18.666490+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:33:18.666490+0000","last_undegraded":"2024-03-27T08:33:18.666490+0000","last_fullsized":"2024-03-27T08:33:18.666490+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467704+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:33:18.467704+0000","last_peered":"2024-03-27T08:33:18.467704+0000","last_clean":"2024-03-27T08:33:18.467704+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:33:18.467704+0000","last_undegraded":"2024-03-27T08:33:18.467704+0000","last_fullsized":"2024-03-27T08:33:18.467704+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467813+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:33:18.467813+0000","last_peered":"2024-03-27T08:33:18.467813+0000","last_clean":"2024-03-27T08:33:18.467813+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:33:18.467813+0000","last_undegraded":"2024-03-27T08:33:18.467813+0000","last_fullsized":"2024-03-27T08:33:18.467813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453957+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:33:18.453957+0000","last_peered":"2024-03-27T08:33:18.453957+0000","last_clean":"2024-03-27T08:33:18.453957+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:33:18.453957+0000","last_undegraded":"2024-03-27T08:33:18.453957+0000","last_fullsized":"2024-03-27T08:33:18.453957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.622405+0000","last_change":"2024-03-27T08:33:18.622405+0000","last_active":"2024-03-27T08:33:18.622405+0000","last_peered":"2024-03-27T08:33:18.622405+0000","last_clean":"2024-03-27T08:33:18.622405+0000","last_became_active":"2024-03-27T08:33:18.614323+0000","last_became_peered":"2024-03-27T08:33:18.614323+0000","last_unstale":"2024-03-27T08:33:18.622405+0000","last_undegraded":"2024-03-27T08:33:18.622405+0000","last_fullsized":"2024-03-27T08:33:18.622405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:33:48.011900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660547+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:33:18.660547+0000","last_peered":"2024-03-27T08:33:18.660547+0000","last_clean":"2024-03-27T08:33:18.660547+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:33:18.660547+0000","last_undegraded":"2024-03-27T08:33:18.660547+0000","last_fullsized":"2024-03-27T08:33:18.660547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460278+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:33:18.460278+0000","last_peered":"2024-03-27T08:33:18.460278+0000","last_clean":"2024-03-27T08:33:18.460278+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:33:18.460278+0000","last_undegraded":"2024-03-27T08:33:18.460278+0000","last_fullsized":"2024-03-27T08:33:18.460278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454773+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:33:18.454773+0000","last_peered":"2024-03-27T08:33:18.454773+0000","last_clean":"2024-03-27T08:33:18.454773+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:33:18.454773+0000","last_undegraded":"2024-03-27T08:33:18.454773+0000","last_fullsized":"2024-03-27T08:33:18.454773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:07.873601+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:34:07.873601+0000","last_peered":"2024-03-27T08:34:07.873601+0000","last_clean":"2024-03-27T08:34:07.873601+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:34:07.873601+0000","last_undegraded":"2024-03-27T08:34:07.873601+0000","last_fullsized":"2024-03-27T08:34:07.873601+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.667599+0000","last_change":"2024-03-27T08:33:18.667599+0000","last_active":"2024-03-27T08:33:18.667599+0000","last_peered":"2024-03-27T08:33:18.667599+0000","last_clean":"2024-03-27T08:33:18.667599+0000","last_became_active":"2024-03-27T08:33:18.666812+0000","last_became_peered":"2024-03-27T08:33:18.666812+0000","last_unstale":"2024-03-27T08:33:18.667599+0000","last_undegraded":"2024-03-27T08:33:18.667599+0000","last_fullsized":"2024-03-27T08:33:18.667599+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:54:57.708196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456293+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:33:18.456293+0000","last_peered":"2024-03-27T08:33:18.456293+0000","last_clean":"2024-03-27T08:33:18.456293+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:33:18.456293+0000","last_undegraded":"2024-03-27T08:33:18.456293+0000","last_fullsized":"2024-03-27T08:33:18.456293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453710+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:33:18.453710+0000","last_peered":"2024-03-27T08:33:18.453710+0000","last_clean":"2024-03-27T08:33:18.453710+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:33:18.453710+0000","last_undegraded":"2024-03-27T08:33:18.453710+0000","last_fullsized":"2024-03-27T08:33:18.453710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450210+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:33:18.450210+0000","last_peered":"2024-03-27T08:33:18.450210+0000","last_clean":"2024-03-27T08:33:18.450210+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:33:18.450210+0000","last_undegraded":"2024-03-27T08:33:18.450210+0000","last_fullsized":"2024-03-27T08:33:18.450210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466424+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:33:18.466424+0000","last_peered":"2024-03-27T08:33:18.466424+0000","last_clean":"2024-03-27T08:33:18.466424+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:33:18.466424+0000","last_undegraded":"2024-03-27T08:33:18.466424+0000","last_fullsized":"2024-03-27T08:33:18.466424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453068+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:33:18.453068+0000","last_peered":"2024-03-27T08:33:18.453068+0000","last_clean":"2024-03-27T08:33:18.453068+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:33:18.453068+0000","last_undegraded":"2024-03-27T08:33:18.453068+0000","last_fullsized":"2024-03-27T08:33:18.453068+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.662952+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:33:18.662952+0000","last_peered":"2024-03-27T08:33:18.662952+0000","last_clean":"2024-03-27T08:33:18.662952+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:33:18.662952+0000","last_undegraded":"2024-03-27T08:33:18.662952+0000","last_fullsized":"2024-03-27T08:33:18.662952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":102,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:09.877443+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:34:09.877443+0000","last_peered":"2024-03-27T08:34:09.877443+0000","last_clean":"2024-03-27T08:34:09.877443+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:34:09.877443+0000","last_undegraded":"2024-03-27T08:34:09.877443+0000","last_fullsized":"2024-03-27T08:34:09.877443+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":80,"num_read_kb":80,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660815+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:33:18.660815+0000","last_peered":"2024-03-27T08:33:18.660815+0000","last_clean":"2024-03-27T08:33:18.660815+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:33:18.660815+0000","last_undegraded":"2024-03-27T08:33:18.660815+0000","last_fullsized":"2024-03-27T08:33:18.660815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453550+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:33:18.453550+0000","last_peered":"2024-03-27T08:33:18.453550+0000","last_clean":"2024-03-27T08:33:18.453550+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:33:18.453550+0000","last_undegraded":"2024-03-27T08:33:18.453550+0000","last_fullsized":"2024-03-27T08:33:18.453550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453961+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:33:18.453961+0000","last_peered":"2024-03-27T08:33:18.453961+0000","last_clean":"2024-03-27T08:33:18.453961+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:33:18.453961+0000","last_undegraded":"2024-03-27T08:33:18.453961+0000","last_fullsized":"2024-03-27T08:33:18.453961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.455076+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:33:18.455076+0000","last_peered":"2024-03-27T08:33:18.455076+0000","last_clean":"2024-03-27T08:33:18.455076+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:33:18.455076+0000","last_undegraded":"2024-03-27T08:33:18.455076+0000","last_fullsized":"2024-03-27T08:33:18.455076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660427+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:33:18.660427+0000","last_peered":"2024-03-27T08:33:18.660427+0000","last_clean":"2024-03-27T08:33:18.660427+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:33:18.660427+0000","last_undegraded":"2024-03-27T08:33:18.660427+0000","last_fullsized":"2024-03-27T08:33:18.660427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'28","reported_seq":216,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:10.867394+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:34:10.867394+0000","last_peered":"2024-03-27T08:34:10.867394+0000","last_clean":"2024-03-27T08:34:10.867394+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:34:10.867394+0000","last_undegraded":"2024-03-27T08:34:10.867394+0000","last_fullsized":"2024-03-27T08:34:10.867394+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":144,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461671+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:33:18.461671+0000","last_peered":"2024-03-27T08:33:18.461671+0000","last_clean":"2024-03-27T08:33:18.461671+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:33:18.461671+0000","last_undegraded":"2024-03-27T08:33:18.461671+0000","last_fullsized":"2024-03-27T08:33:18.461671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466604+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:33:18.466604+0000","last_peered":"2024-03-27T08:33:18.466604+0000","last_clean":"2024-03-27T08:33:18.466604+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:33:18.466604+0000","last_undegraded":"2024-03-27T08:33:18.466604+0000","last_fullsized":"2024-03-27T08:33:18.466604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450169+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:33:18.450169+0000","last_peered":"2024-03-27T08:33:18.450169+0000","last_clean":"2024-03-27T08:33:18.450169+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:33:18.450169+0000","last_undegraded":"2024-03-27T08:33:18.450169+0000","last_fullsized":"2024-03-27T08:33:18.450169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453319+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:33:18.453319+0000","last_peered":"2024-03-27T08:33:18.453319+0000","last_clean":"2024-03-27T08:33:18.453319+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:33:18.453319+0000","last_undegraded":"2024-03-27T08:33:18.453319+0000","last_fullsized":"2024-03-27T08:33:18.453319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453312+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:33:18.453312+0000","last_peered":"2024-03-27T08:33:18.453312+0000","last_clean":"2024-03-27T08:33:18.453312+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:33:18.453312+0000","last_undegraded":"2024-03-27T08:33:18.453312+0000","last_fullsized":"2024-03-27T08:33:18.453312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":104,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:09.892023+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:34:09.892023+0000","last_peered":"2024-03-27T08:34:09.892023+0000","last_clean":"2024-03-27T08:34:09.892023+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:34:09.892023+0000","last_undegraded":"2024-03-27T08:34:09.892023+0000","last_fullsized":"2024-03-27T08:34:09.892023+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452807+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:33:18.452807+0000","last_peered":"2024-03-27T08:33:18.452807+0000","last_clean":"2024-03-27T08:33:18.452807+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:33:18.452807+0000","last_undegraded":"2024-03-27T08:33:18.452807+0000","last_fullsized":"2024-03-27T08:33:18.452807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.511034+0000","last_change":"2024-03-27T08:33:18.509705+0000","last_active":"2024-03-27T08:33:18.511034+0000","last_peered":"2024-03-27T08:33:18.511034+0000","last_clean":"2024-03-27T08:33:18.511034+0000","last_became_active":"2024-03-27T08:33:18.470729+0000","last_became_peered":"2024-03-27T08:33:18.470729+0000","last_unstale":"2024-03-27T08:33:18.511034+0000","last_undegraded":"2024-03-27T08:33:18.511034+0000","last_fullsized":"2024-03-27T08:33:18.511034+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:16.965904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453361+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:33:18.453361+0000","last_peered":"2024-03-27T08:33:18.453361+0000","last_clean":"2024-03-27T08:33:18.453361+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:33:18.453361+0000","last_undegraded":"2024-03-27T08:33:18.453361+0000","last_fullsized":"2024-03-27T08:33:18.453361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460181+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:33:18.460181+0000","last_peered":"2024-03-27T08:33:18.460181+0000","last_clean":"2024-03-27T08:33:18.460181+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:33:18.460181+0000","last_undegraded":"2024-03-27T08:33:18.460181+0000","last_fullsized":"2024-03-27T08:33:18.460181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462281+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:33:18.462281+0000","last_peered":"2024-03-27T08:33:18.462281+0000","last_clean":"2024-03-27T08:33:18.462281+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:33:18.462281+0000","last_undegraded":"2024-03-27T08:33:18.462281+0000","last_fullsized":"2024-03-27T08:33:18.462281+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666124+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:33:18.666124+0000","last_peered":"2024-03-27T08:33:18.666124+0000","last_clean":"2024-03-27T08:33:18.666124+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:33:18.666124+0000","last_undegraded":"2024-03-27T08:33:18.666124+0000","last_fullsized":"2024-03-27T08:33:18.666124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456446+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:33:18.456446+0000","last_peered":"2024-03-27T08:33:18.456446+0000","last_clean":"2024-03-27T08:33:18.456446+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:33:18.456446+0000","last_undegraded":"2024-03-27T08:33:18.456446+0000","last_fullsized":"2024-03-27T08:33:18.456446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453111+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:33:18.453111+0000","last_peered":"2024-03-27T08:33:18.453111+0000","last_clean":"2024-03-27T08:33:18.453111+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:33:18.453111+0000","last_undegraded":"2024-03-27T08:33:18.453111+0000","last_fullsized":"2024-03-27T08:33:18.453111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.668500+0000","last_change":"2024-03-27T08:33:18.668500+0000","last_active":"2024-03-27T08:33:18.668500+0000","last_peered":"2024-03-27T08:33:18.668500+0000","last_clean":"2024-03-27T08:33:18.668500+0000","last_became_active":"2024-03-27T08:33:18.668118+0000","last_became_peered":"2024-03-27T08:33:18.668118+0000","last_unstale":"2024-03-27T08:33:18.668500+0000","last_undegraded":"2024-03-27T08:33:18.668500+0000","last_fullsized":"2024-03-27T08:33:18.668500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:47.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453743+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:33:18.453743+0000","last_peered":"2024-03-27T08:33:18.453743+0000","last_clean":"2024-03-27T08:33:18.453743+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:33:18.453743+0000","last_undegraded":"2024-03-27T08:33:18.453743+0000","last_fullsized":"2024-03-27T08:33:18.453743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":101,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:07.885113+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:34:07.885113+0000","last_peered":"2024-03-27T08:34:07.885113+0000","last_clean":"2024-03-27T08:34:07.885113+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:34:07.885113+0000","last_undegraded":"2024-03-27T08:34:07.885113+0000","last_fullsized":"2024-03-27T08:34:07.885113+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467538+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:33:18.467538+0000","last_peered":"2024-03-27T08:33:18.467538+0000","last_clean":"2024-03-27T08:33:18.467538+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:33:18.467538+0000","last_undegraded":"2024-03-27T08:33:18.467538+0000","last_fullsized":"2024-03-27T08:33:18.467538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613191+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:33:18.613191+0000","last_peered":"2024-03-27T08:33:18.613191+0000","last_clean":"2024-03-27T08:33:18.613191+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:33:18.613191+0000","last_undegraded":"2024-03-27T08:33:18.613191+0000","last_fullsized":"2024-03-27T08:33:18.613191+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452942+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:33:18.452942+0000","last_peered":"2024-03-27T08:33:18.452942+0000","last_clean":"2024-03-27T08:33:18.452942+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:33:18.452942+0000","last_undegraded":"2024-03-27T08:33:18.452942+0000","last_fullsized":"2024-03-27T08:33:18.452942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450019+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:33:18.450019+0000","last_peered":"2024-03-27T08:33:18.450019+0000","last_clean":"2024-03-27T08:33:18.450019+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:33:18.450019+0000","last_undegraded":"2024-03-27T08:33:18.450019+0000","last_fullsized":"2024-03-27T08:33:18.450019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453013+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:33:18.453013+0000","last_peered":"2024-03-27T08:33:18.453013+0000","last_clean":"2024-03-27T08:33:18.453013+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:33:18.453013+0000","last_undegraded":"2024-03-27T08:33:18.453013+0000","last_fullsized":"2024-03-27T08:33:18.453013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461953+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:33:18.461953+0000","last_peered":"2024-03-27T08:33:18.461953+0000","last_clean":"2024-03-27T08:33:18.461953+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:33:18.461953+0000","last_undegraded":"2024-03-27T08:33:18.461953+0000","last_fullsized":"2024-03-27T08:33:18.461953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450570+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:33:18.450570+0000","last_peered":"2024-03-27T08:33:18.450570+0000","last_clean":"2024-03-27T08:33:18.450570+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:33:18.450570+0000","last_undegraded":"2024-03-27T08:33:18.450570+0000","last_fullsized":"2024-03-27T08:33:18.450570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666397+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:33:18.666397+0000","last_peered":"2024-03-27T08:33:18.666397+0000","last_clean":"2024-03-27T08:33:18.666397+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:33:18.666397+0000","last_undegraded":"2024-03-27T08:33:18.666397+0000","last_fullsized":"2024-03-27T08:33:18.666397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467948+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:33:18.467948+0000","last_peered":"2024-03-27T08:33:18.467948+0000","last_clean":"2024-03-27T08:33:18.467948+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:33:18.467948+0000","last_undegraded":"2024-03-27T08:33:18.467948+0000","last_fullsized":"2024-03-27T08:33:18.467948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613484+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:33:18.613484+0000","last_peered":"2024-03-27T08:33:18.613484+0000","last_clean":"2024-03-27T08:33:18.613484+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:33:18.613484+0000","last_undegraded":"2024-03-27T08:33:18.613484+0000","last_fullsized":"2024-03-27T08:33:18.613484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.469718+0000","last_change":"2024-03-27T08:33:18.469718+0000","last_active":"2024-03-27T08:33:18.469718+0000","last_peered":"2024-03-27T08:33:18.469718+0000","last_clean":"2024-03-27T08:33:18.469718+0000","last_became_active":"2024-03-27T08:33:18.469083+0000","last_became_peered":"2024-03-27T08:33:18.469083+0000","last_unstale":"2024-03-27T08:33:18.469718+0000","last_undegraded":"2024-03-27T08:33:18.469718+0000","last_fullsized":"2024-03-27T08:33:18.469718+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:13.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661205+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:33:18.661205+0000","last_peered":"2024-03-27T08:33:18.661205+0000","last_clean":"2024-03-27T08:33:18.661205+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:33:18.661205+0000","last_undegraded":"2024-03-27T08:33:18.661205+0000","last_fullsized":"2024-03-27T08:33:18.661205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.458546+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:33:18.458546+0000","last_peered":"2024-03-27T08:33:18.458546+0000","last_clean":"2024-03-27T08:33:18.458546+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:33:18.458546+0000","last_undegraded":"2024-03-27T08:33:18.458546+0000","last_fullsized":"2024-03-27T08:33:18.458546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466650+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:33:18.466650+0000","last_peered":"2024-03-27T08:33:18.466650+0000","last_clean":"2024-03-27T08:33:18.466650+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:33:18.466650+0000","last_undegraded":"2024-03-27T08:33:18.466650+0000","last_fullsized":"2024-03-27T08:33:18.466650+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467013+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:33:18.467013+0000","last_peered":"2024-03-27T08:33:18.467013+0000","last_clean":"2024-03-27T08:33:18.467013+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:33:18.467013+0000","last_undegraded":"2024-03-27T08:33:18.467013+0000","last_fullsized":"2024-03-27T08:33:18.467013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.479534+0000","last_change":"2024-03-27T08:33:18.478350+0000","last_active":"2024-03-27T08:33:18.479534+0000","last_peered":"2024-03-27T08:33:18.479534+0000","last_clean":"2024-03-27T08:33:18.479534+0000","last_became_active":"2024-03-27T08:33:18.470274+0000","last_became_peered":"2024-03-27T08:33:18.470274+0000","last_unstale":"2024-03-27T08:33:18.479534+0000","last_undegraded":"2024-03-27T08:33:18.479534+0000","last_fullsized":"2024-03-27T08:33:18.479534+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:54.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467522+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:33:18.467522+0000","last_peered":"2024-03-27T08:33:18.467522+0000","last_clean":"2024-03-27T08:33:18.467522+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:33:18.467522+0000","last_undegraded":"2024-03-27T08:33:18.467522+0000","last_fullsized":"2024-03-27T08:33:18.467522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459568+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:33:18.459568+0000","last_peered":"2024-03-27T08:33:18.459568+0000","last_clean":"2024-03-27T08:33:18.459568+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:33:18.459568+0000","last_undegraded":"2024-03-27T08:33:18.459568+0000","last_fullsized":"2024-03-27T08:33:18.459568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453206+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:33:18.453206+0000","last_peered":"2024-03-27T08:33:18.453206+0000","last_clean":"2024-03-27T08:33:18.453206+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:33:18.453206+0000","last_undegraded":"2024-03-27T08:33:18.453206+0000","last_fullsized":"2024-03-27T08:33:18.453206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466304+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:33:18.466304+0000","last_peered":"2024-03-27T08:33:18.466304+0000","last_clean":"2024-03-27T08:33:18.466304+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:33:18.466304+0000","last_undegraded":"2024-03-27T08:33:18.466304+0000","last_fullsized":"2024-03-27T08:33:18.466304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453613+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:33:18.453613+0000","last_peered":"2024-03-27T08:33:18.453613+0000","last_clean":"2024-03-27T08:33:18.453613+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:33:18.453613+0000","last_undegraded":"2024-03-27T08:33:18.453613+0000","last_fullsized":"2024-03-27T08:33:18.453613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454425+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:33:18.454425+0000","last_peered":"2024-03-27T08:33:18.454425+0000","last_clean":"2024-03-27T08:33:18.454425+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:33:18.454425+0000","last_undegraded":"2024-03-27T08:33:18.454425+0000","last_fullsized":"2024-03-27T08:33:18.454425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453145+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:33:18.453145+0000","last_peered":"2024-03-27T08:33:18.453145+0000","last_clean":"2024-03-27T08:33:18.453145+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:33:18.453145+0000","last_undegraded":"2024-03-27T08:33:18.453145+0000","last_fullsized":"2024-03-27T08:33:18.453145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450569+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:33:18.450569+0000","last_peered":"2024-03-27T08:33:18.450569+0000","last_clean":"2024-03-27T08:33:18.450569+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:33:18.450569+0000","last_undegraded":"2024-03-27T08:33:18.450569+0000","last_fullsized":"2024-03-27T08:33:18.450569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453520+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:33:18.453520+0000","last_peered":"2024-03-27T08:33:18.453520+0000","last_clean":"2024-03-27T08:33:18.453520+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:33:18.453520+0000","last_undegraded":"2024-03-27T08:33:18.453520+0000","last_fullsized":"2024-03-27T08:33:18.453520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467287+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:33:18.467287+0000","last_peered":"2024-03-27T08:33:18.467287+0000","last_clean":"2024-03-27T08:33:18.467287+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:33:18.467287+0000","last_undegraded":"2024-03-27T08:33:18.467287+0000","last_fullsized":"2024-03-27T08:33:18.467287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462787+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:33:18.462787+0000","last_peered":"2024-03-27T08:33:18.462787+0000","last_clean":"2024-03-27T08:33:18.462787+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:33:18.462787+0000","last_undegraded":"2024-03-27T08:33:18.462787+0000","last_fullsized":"2024-03-27T08:33:18.462787+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.669781+0000","last_change":"2024-03-27T08:33:18.669781+0000","last_active":"2024-03-27T08:33:18.669781+0000","last_peered":"2024-03-27T08:33:18.669781+0000","last_clean":"2024-03-27T08:33:18.669781+0000","last_became_active":"2024-03-27T08:33:18.668571+0000","last_became_peered":"2024-03-27T08:33:18.668571+0000","last_unstale":"2024-03-27T08:33:18.669781+0000","last_undegraded":"2024-03-27T08:33:18.669781+0000","last_fullsized":"2024-03-27T08:33:18.669781+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:11:18.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453403+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:33:18.453403+0000","last_peered":"2024-03-27T08:33:18.453403+0000","last_clean":"2024-03-27T08:33:18.453403+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:33:18.453403+0000","last_undegraded":"2024-03-27T08:33:18.453403+0000","last_fullsized":"2024-03-27T08:33:18.453403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450678+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:33:18.450678+0000","last_peered":"2024-03-27T08:33:18.450678+0000","last_clean":"2024-03-27T08:33:18.450678+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:33:18.450678+0000","last_undegraded":"2024-03-27T08:33:18.450678+0000","last_fullsized":"2024-03-27T08:33:18.450678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462419+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:33:18.462419+0000","last_peered":"2024-03-27T08:33:18.462419+0000","last_clean":"2024-03-27T08:33:18.462419+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:33:18.462419+0000","last_undegraded":"2024-03-27T08:33:18.462419+0000","last_fullsized":"2024-03-27T08:33:18.462419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467295+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:33:18.467295+0000","last_peered":"2024-03-27T08:33:18.467295+0000","last_clean":"2024-03-27T08:33:18.467295+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:33:18.467295+0000","last_undegraded":"2024-03-27T08:33:18.467295+0000","last_fullsized":"2024-03-27T08:33:18.467295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467927+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:33:18.467927+0000","last_peered":"2024-03-27T08:33:18.467927+0000","last_clean":"2024-03-27T08:33:18.467927+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:33:18.467927+0000","last_undegraded":"2024-03-27T08:33:18.467927+0000","last_fullsized":"2024-03-27T08:33:18.467927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453330+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:33:18.453330+0000","last_peered":"2024-03-27T08:33:18.453330+0000","last_clean":"2024-03-27T08:33:18.453330+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:33:18.453330+0000","last_undegraded":"2024-03-27T08:33:18.453330+0000","last_fullsized":"2024-03-27T08:33:18.453330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466630+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:33:18.466630+0000","last_peered":"2024-03-27T08:33:18.466630+0000","last_clean":"2024-03-27T08:33:18.466630+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:33:18.466630+0000","last_undegraded":"2024-03-27T08:33:18.466630+0000","last_fullsized":"2024-03-27T08:33:18.466630+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660419+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:33:18.660419+0000","last_peered":"2024-03-27T08:33:18.660419+0000","last_clean":"2024-03-27T08:33:18.660419+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:33:18.660419+0000","last_undegraded":"2024-03-27T08:33:18.660419+0000","last_fullsized":"2024-03-27T08:33:18.660419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450384+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:33:18.450384+0000","last_peered":"2024-03-27T08:33:18.450384+0000","last_clean":"2024-03-27T08:33:18.450384+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:33:18.450384+0000","last_undegraded":"2024-03-27T08:33:18.450384+0000","last_fullsized":"2024-03-27T08:33:18.450384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461450+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:33:18.461450+0000","last_peered":"2024-03-27T08:33:18.461450+0000","last_clean":"2024-03-27T08:33:18.461450+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:33:18.461450+0000","last_undegraded":"2024-03-27T08:33:18.461450+0000","last_fullsized":"2024-03-27T08:33:18.461450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65047,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":503,"num_read_kb":320,"num_write":158,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285601,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":468348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547240,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1120763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710765,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":468472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972405,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":468280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234046,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712428,"statfs":{"total":95995035648,"available":95961526272,"internally_reserved":0,"allocated":1581056,"data_stored":1060322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430275,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":467861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":528700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":469132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":530441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117080,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":468172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855442,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":468298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691913,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1593344,"data_stored":1060006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:34:16.063 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph pg dump --format=json 2024-03-27T08:34:16.534 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:16 smithi167 ceph-mon[34903]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:16 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:16 smithi167 ceph-mon[34903]: pgmap v409: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:16.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:16 smithi173 ceph-mon[35397]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:16.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:16 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.575 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:16 smithi173 ceph-mon[35397]: pgmap v409: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:16.679 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:16 smithi164 ceph-mon[31788]: from='client.14973 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:16.679 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.679 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:16 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:16.679 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:16 smithi164 ceph-mon[31788]: pgmap v409: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:17.547 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:34:17.547 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:34:17.547 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:17.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:34:17.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:34:17.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:17.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:34:17.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:34:17.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:34:18.505 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:18 smithi164 ceph-mon[31788]: pgmap v410: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:18.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:18 smithi167 ceph-mon[34903]: pgmap v410: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:18.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:18 smithi173 ceph-mon[35397]: pgmap v410: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 -- 172.21.15.164:0/2721460359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106cd0 msgr2=0x7f63c81117e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2721460359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106cd0 0x7f63c81117e0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f63c000b0a0 tx=0x7f63c000b3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 -- 172.21.15.164:0/2721460359 shutdown_connections 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2721460359 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106cd0 0x7f63c81117e0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2721460359 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 0x7f63c8104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2721460359 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106310 0x7f63c8106790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 -- 172.21.15.164:0/2721460359 >> 172.21.15.164:0/2721460359 conn(0x7f63c81002e0 msgr2=0x7f63c8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:18.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.756+0000 7f63cfc00700 1 -- 172.21.15.164:0/2721460359 shutdown_connections 2024-03-27T08:34:18.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.757+0000 7f63cfc00700 1 -- 172.21.15.164:0/2721460359 wait complete. 2024-03-27T08:34:18.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 Processor -- start 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 -- start start 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 0x7f63c819b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106cd0 0x7f63c819f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8114c60 con 0x7f63c8106310 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8114ae0 con 0x7f63c8104bc0 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cfc00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f63c8114de0 con 0x7f63c8106cd0 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63c7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63c7e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33008/0 (socket says 172.21.15.164:33008) 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63c7e00700 1 -- 172.21.15.164:0/2392229228 learned_addr learned my addr 172.21.15.164:0/2392229228 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.758+0000 7f63cd200700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 0x7f63c819b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:18.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63cdc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106cd0 0x7f63c819f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 -- 172.21.15.164:0/2392229228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106cd0 msgr2=0x7f63c819f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106cd0 0x7f63c819f8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 -- 172.21.15.164:0/2392229228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 msgr2=0x7f63c819b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 0x7f63c819b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 -- 172.21.15.164:0/2392229228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63c81a0030 con 0x7f63c8106310 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c7e00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63b400d950 tx=0x7f63b400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.759+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b4016070 con 0x7f63c8106310 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.760+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63b4009e10 con 0x7f63c8106310 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.760+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63c81a0320 con 0x7f63c8106310 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.760+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63b400f620 con 0x7f63c8106310 2024-03-27T08:34:18.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.760+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63c81a7ba0 con 0x7f63c8106310 2024-03-27T08:34:18.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.761+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63c8069300 con 0x7f63c8106310 2024-03-27T08:34:18.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.763+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f63b4019070 con 0x7f63c8106310 2024-03-27T08:34:18.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.764+0000 7f63c5600700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 0x7f63b00a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:18.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.764+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f63b40cf8b0 con 0x7f63c8106310 2024-03-27T08:34:18.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.764+0000 7f63cd200700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 0x7f63b00a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:18.757 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.765+0000 7f63cd200700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 0x7f63b00a5be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009c60 tx=0x7f63bc009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:18.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.769+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f63b409c430 con 0x7f63c8106310 2024-03-27T08:34:18.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.988+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63c8062a80 con 0x7f63b00a3720 2024-03-27T08:34:18.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:18.997+0000 7f63c5600700 1 -- 172.21.15.164:0/2392229228 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258725 (secure 0 0 0) 0x7f63c8062a80 con 0x7f63b00a3720 2024-03-27T08:34:18.993 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:18.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.002+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 msgr2=0x7f63b00a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:18.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.002+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 0x7f63b00a5be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f63bc009c60 tx=0x7f63bc009260 comp rx=0 tx=0).stop 2024-03-27T08:34:18.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.002+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 msgr2=0x7f63c819b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.002+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f63b400d950 tx=0x7f63b400dc60 comp rx=0 tx=0).stop 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 shutdown_connections 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f63b00a3720 0x7f63b00a5be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f63c8106cd0 0x7f63c819f8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63c8104bc0 0x7f63c819b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 --2- 172.21.15.164:0/2392229228 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f63c8106310 0x7f63c819b5b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 >> 172.21.15.164:0/2392229228 conn(0x7f63c81002e0 msgr2=0x7f63c810a680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 shutdown_connections 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:19.003+0000 7f63cfc00700 1 -- 172.21.15.164:0/2392229228 wait complete. 2024-03-27T08:34:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:34:19.568 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:19 smithi167 ceph-mon[34903]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-27T08:34:19.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:19 smithi173 ceph-mon[35397]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-27T08:34:19.718 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:19 smithi164 ceph-mon[31788]: mgrmap e18: x(active, since 11m), standbys: z, y 2024-03-27T08:34:19.770 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":410,"stamp":"2024-03-27T08:34:17.342568+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":655649,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":659,"num_read_kb":444,"num_write":341,"num_write_kb":3048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":275,"ondisk_log_size":275,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":362720,"kb_used_data":13500,"kb_used_omap":18,"kb_used_meta":349037,"kb_avail":1124579104,"statfs":{"total":1151940427776,"available":1151569002496,"internally_reserved":0,"allocated":13824000,"data_stored":7578795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":357414201},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005537"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.463209+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:33:18.463209+0000","last_peered":"2024-03-27T08:33:18.463209+0000","last_clean":"2024-03-27T08:33:18.463209+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:33:18.463209+0000","last_undegraded":"2024-03-27T08:33:18.463209+0000","last_fullsized":"2024-03-27T08:33:18.463209+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453310+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:33:18.453310+0000","last_peered":"2024-03-27T08:33:18.453310+0000","last_clean":"2024-03-27T08:33:18.453310+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:33:18.453310+0000","last_undegraded":"2024-03-27T08:33:18.453310+0000","last_fullsized":"2024-03-27T08:33:18.453310+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453221+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:33:18.453221+0000","last_peered":"2024-03-27T08:33:18.453221+0000","last_clean":"2024-03-27T08:33:18.453221+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:33:18.453221+0000","last_undegraded":"2024-03-27T08:33:18.453221+0000","last_fullsized":"2024-03-27T08:33:18.453221+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.610547+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:33:18.610547+0000","last_peered":"2024-03-27T08:33:18.610547+0000","last_clean":"2024-03-27T08:33:18.610547+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:33:18.610547+0000","last_undegraded":"2024-03-27T08:33:18.610547+0000","last_fullsized":"2024-03-27T08:33:18.610547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459181+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:33:18.459181+0000","last_peered":"2024-03-27T08:33:18.459181+0000","last_clean":"2024-03-27T08:33:18.459181+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:33:18.459181+0000","last_undegraded":"2024-03-27T08:33:18.459181+0000","last_fullsized":"2024-03-27T08:33:18.459181+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456503+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:33:18.456503+0000","last_peered":"2024-03-27T08:33:18.456503+0000","last_clean":"2024-03-27T08:33:18.456503+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:33:18.456503+0000","last_undegraded":"2024-03-27T08:33:18.456503+0000","last_fullsized":"2024-03-27T08:33:18.456503+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453060+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:33:18.453060+0000","last_peered":"2024-03-27T08:33:18.453060+0000","last_clean":"2024-03-27T08:33:18.453060+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:33:18.453060+0000","last_undegraded":"2024-03-27T08:33:18.453060+0000","last_fullsized":"2024-03-27T08:33:18.453060+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466377+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:33:18.466377+0000","last_peered":"2024-03-27T08:33:18.466377+0000","last_clean":"2024-03-27T08:33:18.466377+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:33:18.466377+0000","last_undegraded":"2024-03-27T08:33:18.466377+0000","last_fullsized":"2024-03-27T08:33:18.466377+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661145+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:33:18.661145+0000","last_peered":"2024-03-27T08:33:18.661145+0000","last_clean":"2024-03-27T08:33:18.661145+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:33:18.661145+0000","last_undegraded":"2024-03-27T08:33:18.661145+0000","last_fullsized":"2024-03-27T08:33:18.661145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.668027+0000","last_change":"2024-03-27T08:33:18.668027+0000","last_active":"2024-03-27T08:33:18.668027+0000","last_peered":"2024-03-27T08:33:18.668027+0000","last_clean":"2024-03-27T08:33:18.668027+0000","last_became_active":"2024-03-27T08:33:18.667495+0000","last_became_peered":"2024-03-27T08:33:18.667495+0000","last_unstale":"2024-03-27T08:33:18.668027+0000","last_undegraded":"2024-03-27T08:33:18.668027+0000","last_fullsized":"2024-03-27T08:33:18.668027+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:00:53.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453545+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:33:18.453545+0000","last_peered":"2024-03-27T08:33:18.453545+0000","last_clean":"2024-03-27T08:33:18.453545+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:33:18.453545+0000","last_undegraded":"2024-03-27T08:33:18.453545+0000","last_fullsized":"2024-03-27T08:33:18.453545+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.610714+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:33:18.610714+0000","last_peered":"2024-03-27T08:33:18.610714+0000","last_clean":"2024-03-27T08:33:18.610714+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:33:18.610714+0000","last_undegraded":"2024-03-27T08:33:18.610714+0000","last_fullsized":"2024-03-27T08:33:18.610714+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450452+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:33:18.450452+0000","last_peered":"2024-03-27T08:33:18.450452+0000","last_clean":"2024-03-27T08:33:18.450452+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:33:18.450452+0000","last_undegraded":"2024-03-27T08:33:18.450452+0000","last_fullsized":"2024-03-27T08:33:18.450452+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453458+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:33:18.453458+0000","last_peered":"2024-03-27T08:33:18.453458+0000","last_clean":"2024-03-27T08:33:18.453458+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:33:18.453458+0000","last_undegraded":"2024-03-27T08:33:18.453458+0000","last_fullsized":"2024-03-27T08:33:18.453458+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453518+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:33:18.453518+0000","last_peered":"2024-03-27T08:33:18.453518+0000","last_clean":"2024-03-27T08:33:18.453518+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:33:18.453518+0000","last_undegraded":"2024-03-27T08:33:18.453518+0000","last_fullsized":"2024-03-27T08:33:18.453518+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660391+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:33:18.660391+0000","last_peered":"2024-03-27T08:33:18.660391+0000","last_clean":"2024-03-27T08:33:18.660391+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:33:18.660391+0000","last_undegraded":"2024-03-27T08:33:18.660391+0000","last_fullsized":"2024-03-27T08:33:18.660391+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.463547+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:33:18.463547+0000","last_peered":"2024-03-27T08:33:18.463547+0000","last_clean":"2024-03-27T08:33:18.463547+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:33:18.463547+0000","last_undegraded":"2024-03-27T08:33:18.463547+0000","last_fullsized":"2024-03-27T08:33:18.463547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.663170+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:33:18.663170+0000","last_peered":"2024-03-27T08:33:18.663170+0000","last_clean":"2024-03-27T08:33:18.663170+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:33:18.663170+0000","last_undegraded":"2024-03-27T08:33:18.663170+0000","last_fullsized":"2024-03-27T08:33:18.663170+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466238+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:33:18.466238+0000","last_peered":"2024-03-27T08:33:18.466238+0000","last_clean":"2024-03-27T08:33:18.466238+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:33:18.466238+0000","last_undegraded":"2024-03-27T08:33:18.466238+0000","last_fullsized":"2024-03-27T08:33:18.466238+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666490+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:33:18.666490+0000","last_peered":"2024-03-27T08:33:18.666490+0000","last_clean":"2024-03-27T08:33:18.666490+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:33:18.666490+0000","last_undegraded":"2024-03-27T08:33:18.666490+0000","last_fullsized":"2024-03-27T08:33:18.666490+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467704+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:33:18.467704+0000","last_peered":"2024-03-27T08:33:18.467704+0000","last_clean":"2024-03-27T08:33:18.467704+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:33:18.467704+0000","last_undegraded":"2024-03-27T08:33:18.467704+0000","last_fullsized":"2024-03-27T08:33:18.467704+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467813+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:33:18.467813+0000","last_peered":"2024-03-27T08:33:18.467813+0000","last_clean":"2024-03-27T08:33:18.467813+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:33:18.467813+0000","last_undegraded":"2024-03-27T08:33:18.467813+0000","last_fullsized":"2024-03-27T08:33:18.467813+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453957+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:33:18.453957+0000","last_peered":"2024-03-27T08:33:18.453957+0000","last_clean":"2024-03-27T08:33:18.453957+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:33:18.453957+0000","last_undegraded":"2024-03-27T08:33:18.453957+0000","last_fullsized":"2024-03-27T08:33:18.453957+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.622405+0000","last_change":"2024-03-27T08:33:18.622405+0000","last_active":"2024-03-27T08:33:18.622405+0000","last_peered":"2024-03-27T08:33:18.622405+0000","last_clean":"2024-03-27T08:33:18.622405+0000","last_became_active":"2024-03-27T08:33:18.614323+0000","last_became_peered":"2024-03-27T08:33:18.614323+0000","last_unstale":"2024-03-27T08:33:18.622405+0000","last_undegraded":"2024-03-27T08:33:18.622405+0000","last_fullsized":"2024-03-27T08:33:18.622405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:33:48.011900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660547+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:33:18.660547+0000","last_peered":"2024-03-27T08:33:18.660547+0000","last_clean":"2024-03-27T08:33:18.660547+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:33:18.660547+0000","last_undegraded":"2024-03-27T08:33:18.660547+0000","last_fullsized":"2024-03-27T08:33:18.660547+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460278+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:33:18.460278+0000","last_peered":"2024-03-27T08:33:18.460278+0000","last_clean":"2024-03-27T08:33:18.460278+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:33:18.460278+0000","last_undegraded":"2024-03-27T08:33:18.460278+0000","last_fullsized":"2024-03-27T08:33:18.460278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454773+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:33:18.454773+0000","last_peered":"2024-03-27T08:33:18.454773+0000","last_clean":"2024-03-27T08:33:18.454773+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:33:18.454773+0000","last_undegraded":"2024-03-27T08:33:18.454773+0000","last_fullsized":"2024-03-27T08:33:18.454773+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"88'6","reported_seq":111,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:12.886576+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:34:12.886576+0000","last_peered":"2024-03-27T08:34:12.886576+0000","last_clean":"2024-03-27T08:34:12.886576+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:34:12.886576+0000","last_undegraded":"2024-03-27T08:34:12.886576+0000","last_fullsized":"2024-03-27T08:34:12.886576+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.667599+0000","last_change":"2024-03-27T08:33:18.667599+0000","last_active":"2024-03-27T08:33:18.667599+0000","last_peered":"2024-03-27T08:33:18.667599+0000","last_clean":"2024-03-27T08:33:18.667599+0000","last_became_active":"2024-03-27T08:33:18.666812+0000","last_became_peered":"2024-03-27T08:33:18.666812+0000","last_unstale":"2024-03-27T08:33:18.667599+0000","last_undegraded":"2024-03-27T08:33:18.667599+0000","last_fullsized":"2024-03-27T08:33:18.667599+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:54:57.708196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456293+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:33:18.456293+0000","last_peered":"2024-03-27T08:33:18.456293+0000","last_clean":"2024-03-27T08:33:18.456293+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:33:18.456293+0000","last_undegraded":"2024-03-27T08:33:18.456293+0000","last_fullsized":"2024-03-27T08:33:18.456293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453710+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:33:18.453710+0000","last_peered":"2024-03-27T08:33:18.453710+0000","last_clean":"2024-03-27T08:33:18.453710+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:33:18.453710+0000","last_undegraded":"2024-03-27T08:33:18.453710+0000","last_fullsized":"2024-03-27T08:33:18.453710+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450210+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:33:18.450210+0000","last_peered":"2024-03-27T08:33:18.450210+0000","last_clean":"2024-03-27T08:33:18.450210+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:33:18.450210+0000","last_undegraded":"2024-03-27T08:33:18.450210+0000","last_fullsized":"2024-03-27T08:33:18.450210+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466424+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:33:18.466424+0000","last_peered":"2024-03-27T08:33:18.466424+0000","last_clean":"2024-03-27T08:33:18.466424+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:33:18.466424+0000","last_undegraded":"2024-03-27T08:33:18.466424+0000","last_fullsized":"2024-03-27T08:33:18.466424+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453068+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:33:18.453068+0000","last_peered":"2024-03-27T08:33:18.453068+0000","last_clean":"2024-03-27T08:33:18.453068+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:33:18.453068+0000","last_undegraded":"2024-03-27T08:33:18.453068+0000","last_fullsized":"2024-03-27T08:33:18.453068+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.662952+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:33:18.662952+0000","last_peered":"2024-03-27T08:33:18.662952+0000","last_clean":"2024-03-27T08:33:18.662952+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:33:18.662952+0000","last_undegraded":"2024-03-27T08:33:18.662952+0000","last_fullsized":"2024-03-27T08:33:18.662952+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"88'3","reported_seq":107,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:14.890405+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:34:14.890405+0000","last_peered":"2024-03-27T08:34:14.890405+0000","last_clean":"2024-03-27T08:34:14.890405+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:34:14.890405+0000","last_undegraded":"2024-03-27T08:34:14.890405+0000","last_fullsized":"2024-03-27T08:34:14.890405+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":85,"num_read_kb":85,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660815+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:33:18.660815+0000","last_peered":"2024-03-27T08:33:18.660815+0000","last_clean":"2024-03-27T08:33:18.660815+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:33:18.660815+0000","last_undegraded":"2024-03-27T08:33:18.660815+0000","last_fullsized":"2024-03-27T08:33:18.660815+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453550+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:33:18.453550+0000","last_peered":"2024-03-27T08:33:18.453550+0000","last_clean":"2024-03-27T08:33:18.453550+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:33:18.453550+0000","last_undegraded":"2024-03-27T08:33:18.453550+0000","last_fullsized":"2024-03-27T08:33:18.453550+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453961+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:33:18.453961+0000","last_peered":"2024-03-27T08:33:18.453961+0000","last_clean":"2024-03-27T08:33:18.453961+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:33:18.453961+0000","last_undegraded":"2024-03-27T08:33:18.453961+0000","last_fullsized":"2024-03-27T08:33:18.453961+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.455076+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:33:18.455076+0000","last_peered":"2024-03-27T08:33:18.455076+0000","last_clean":"2024-03-27T08:33:18.455076+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:33:18.455076+0000","last_undegraded":"2024-03-27T08:33:18.455076+0000","last_fullsized":"2024-03-27T08:33:18.455076+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660427+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:33:18.660427+0000","last_peered":"2024-03-27T08:33:18.660427+0000","last_clean":"2024-03-27T08:33:18.660427+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:33:18.660427+0000","last_undegraded":"2024-03-27T08:33:18.660427+0000","last_fullsized":"2024-03-27T08:33:18.660427+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'28","reported_seq":226,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:15.878569+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:34:15.878569+0000","last_peered":"2024-03-27T08:34:15.878569+0000","last_clean":"2024-03-27T08:34:15.878569+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:34:15.878569+0000","last_undegraded":"2024-03-27T08:34:15.878569+0000","last_fullsized":"2024-03-27T08:34:15.878569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61046,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":179,"num_read_kb":149,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461671+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:33:18.461671+0000","last_peered":"2024-03-27T08:33:18.461671+0000","last_clean":"2024-03-27T08:33:18.461671+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:33:18.461671+0000","last_undegraded":"2024-03-27T08:33:18.461671+0000","last_fullsized":"2024-03-27T08:33:18.461671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466604+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:33:18.466604+0000","last_peered":"2024-03-27T08:33:18.466604+0000","last_clean":"2024-03-27T08:33:18.466604+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:33:18.466604+0000","last_undegraded":"2024-03-27T08:33:18.466604+0000","last_fullsized":"2024-03-27T08:33:18.466604+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450169+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:33:18.450169+0000","last_peered":"2024-03-27T08:33:18.450169+0000","last_clean":"2024-03-27T08:33:18.450169+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:33:18.450169+0000","last_undegraded":"2024-03-27T08:33:18.450169+0000","last_fullsized":"2024-03-27T08:33:18.450169+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453319+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:33:18.453319+0000","last_peered":"2024-03-27T08:33:18.453319+0000","last_clean":"2024-03-27T08:33:18.453319+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:33:18.453319+0000","last_undegraded":"2024-03-27T08:33:18.453319+0000","last_fullsized":"2024-03-27T08:33:18.453319+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453312+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:33:18.453312+0000","last_peered":"2024-03-27T08:33:18.453312+0000","last_clean":"2024-03-27T08:33:18.453312+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:33:18.453312+0000","last_undegraded":"2024-03-27T08:33:18.453312+0000","last_fullsized":"2024-03-27T08:33:18.453312+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"88'3","reported_seq":109,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:14.905021+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:34:14.905021+0000","last_peered":"2024-03-27T08:34:14.905021+0000","last_clean":"2024-03-27T08:34:14.905021+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:34:14.905021+0000","last_undegraded":"2024-03-27T08:34:14.905021+0000","last_fullsized":"2024-03-27T08:34:14.905021+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":88,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452807+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:33:18.452807+0000","last_peered":"2024-03-27T08:33:18.452807+0000","last_clean":"2024-03-27T08:33:18.452807+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:33:18.452807+0000","last_undegraded":"2024-03-27T08:33:18.452807+0000","last_fullsized":"2024-03-27T08:33:18.452807+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.511034+0000","last_change":"2024-03-27T08:33:18.509705+0000","last_active":"2024-03-27T08:33:18.511034+0000","last_peered":"2024-03-27T08:33:18.511034+0000","last_clean":"2024-03-27T08:33:18.511034+0000","last_became_active":"2024-03-27T08:33:18.470729+0000","last_became_peered":"2024-03-27T08:33:18.470729+0000","last_unstale":"2024-03-27T08:33:18.511034+0000","last_undegraded":"2024-03-27T08:33:18.511034+0000","last_fullsized":"2024-03-27T08:33:18.511034+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:16.965904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453361+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:33:18.453361+0000","last_peered":"2024-03-27T08:33:18.453361+0000","last_clean":"2024-03-27T08:33:18.453361+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:33:18.453361+0000","last_undegraded":"2024-03-27T08:33:18.453361+0000","last_fullsized":"2024-03-27T08:33:18.453361+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460181+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:33:18.460181+0000","last_peered":"2024-03-27T08:33:18.460181+0000","last_clean":"2024-03-27T08:33:18.460181+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:33:18.460181+0000","last_undegraded":"2024-03-27T08:33:18.460181+0000","last_fullsized":"2024-03-27T08:33:18.460181+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462281+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:33:18.462281+0000","last_peered":"2024-03-27T08:33:18.462281+0000","last_clean":"2024-03-27T08:33:18.462281+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:33:18.462281+0000","last_undegraded":"2024-03-27T08:33:18.462281+0000","last_fullsized":"2024-03-27T08:33:18.462281+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666124+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:33:18.666124+0000","last_peered":"2024-03-27T08:33:18.666124+0000","last_clean":"2024-03-27T08:33:18.666124+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:33:18.666124+0000","last_undegraded":"2024-03-27T08:33:18.666124+0000","last_fullsized":"2024-03-27T08:33:18.666124+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"88'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456446+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:33:18.456446+0000","last_peered":"2024-03-27T08:33:18.456446+0000","last_clean":"2024-03-27T08:33:18.456446+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:33:18.456446+0000","last_undegraded":"2024-03-27T08:33:18.456446+0000","last_fullsized":"2024-03-27T08:33:18.456446+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453111+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:33:18.453111+0000","last_peered":"2024-03-27T08:33:18.453111+0000","last_clean":"2024-03-27T08:33:18.453111+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:33:18.453111+0000","last_undegraded":"2024-03-27T08:33:18.453111+0000","last_fullsized":"2024-03-27T08:33:18.453111+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.668500+0000","last_change":"2024-03-27T08:33:18.668500+0000","last_active":"2024-03-27T08:33:18.668500+0000","last_peered":"2024-03-27T08:33:18.668500+0000","last_clean":"2024-03-27T08:33:18.668500+0000","last_became_active":"2024-03-27T08:33:18.668118+0000","last_became_peered":"2024-03-27T08:33:18.668118+0000","last_unstale":"2024-03-27T08:33:18.668500+0000","last_undegraded":"2024-03-27T08:33:18.668500+0000","last_fullsized":"2024-03-27T08:33:18.668500+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:47.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453743+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:33:18.453743+0000","last_peered":"2024-03-27T08:33:18.453743+0000","last_clean":"2024-03-27T08:33:18.453743+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:33:18.453743+0000","last_undegraded":"2024-03-27T08:33:18.453743+0000","last_fullsized":"2024-03-27T08:33:18.453743+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"88'4","reported_seq":106,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:12.898574+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:34:12.898574+0000","last_peered":"2024-03-27T08:34:12.898574+0000","last_clean":"2024-03-27T08:34:12.898574+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:34:12.898574+0000","last_undegraded":"2024-03-27T08:34:12.898574+0000","last_fullsized":"2024-03-27T08:34:12.898574+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":83,"num_read_kb":83,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467538+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:33:18.467538+0000","last_peered":"2024-03-27T08:33:18.467538+0000","last_clean":"2024-03-27T08:33:18.467538+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:33:18.467538+0000","last_undegraded":"2024-03-27T08:33:18.467538+0000","last_fullsized":"2024-03-27T08:33:18.467538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613191+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:33:18.613191+0000","last_peered":"2024-03-27T08:33:18.613191+0000","last_clean":"2024-03-27T08:33:18.613191+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:33:18.613191+0000","last_undegraded":"2024-03-27T08:33:18.613191+0000","last_fullsized":"2024-03-27T08:33:18.613191+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452942+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:33:18.452942+0000","last_peered":"2024-03-27T08:33:18.452942+0000","last_clean":"2024-03-27T08:33:18.452942+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:33:18.452942+0000","last_undegraded":"2024-03-27T08:33:18.452942+0000","last_fullsized":"2024-03-27T08:33:18.452942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450019+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:33:18.450019+0000","last_peered":"2024-03-27T08:33:18.450019+0000","last_clean":"2024-03-27T08:33:18.450019+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:33:18.450019+0000","last_undegraded":"2024-03-27T08:33:18.450019+0000","last_fullsized":"2024-03-27T08:33:18.450019+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453013+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:33:18.453013+0000","last_peered":"2024-03-27T08:33:18.453013+0000","last_clean":"2024-03-27T08:33:18.453013+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:33:18.453013+0000","last_undegraded":"2024-03-27T08:33:18.453013+0000","last_fullsized":"2024-03-27T08:33:18.453013+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461953+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:33:18.461953+0000","last_peered":"2024-03-27T08:33:18.461953+0000","last_clean":"2024-03-27T08:33:18.461953+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:33:18.461953+0000","last_undegraded":"2024-03-27T08:33:18.461953+0000","last_fullsized":"2024-03-27T08:33:18.461953+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450570+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:33:18.450570+0000","last_peered":"2024-03-27T08:33:18.450570+0000","last_clean":"2024-03-27T08:33:18.450570+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:33:18.450570+0000","last_undegraded":"2024-03-27T08:33:18.450570+0000","last_fullsized":"2024-03-27T08:33:18.450570+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"88'9","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666397+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:33:18.666397+0000","last_peered":"2024-03-27T08:33:18.666397+0000","last_clean":"2024-03-27T08:33:18.666397+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:33:18.666397+0000","last_undegraded":"2024-03-27T08:33:18.666397+0000","last_fullsized":"2024-03-27T08:33:18.666397+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467948+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:33:18.467948+0000","last_peered":"2024-03-27T08:33:18.467948+0000","last_clean":"2024-03-27T08:33:18.467948+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:33:18.467948+0000","last_undegraded":"2024-03-27T08:33:18.467948+0000","last_fullsized":"2024-03-27T08:33:18.467948+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613484+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:33:18.613484+0000","last_peered":"2024-03-27T08:33:18.613484+0000","last_clean":"2024-03-27T08:33:18.613484+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:33:18.613484+0000","last_undegraded":"2024-03-27T08:33:18.613484+0000","last_fullsized":"2024-03-27T08:33:18.613484+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.469718+0000","last_change":"2024-03-27T08:33:18.469718+0000","last_active":"2024-03-27T08:33:18.469718+0000","last_peered":"2024-03-27T08:33:18.469718+0000","last_clean":"2024-03-27T08:33:18.469718+0000","last_became_active":"2024-03-27T08:33:18.469083+0000","last_became_peered":"2024-03-27T08:33:18.469083+0000","last_unstale":"2024-03-27T08:33:18.469718+0000","last_undegraded":"2024-03-27T08:33:18.469718+0000","last_fullsized":"2024-03-27T08:33:18.469718+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:13.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661205+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:33:18.661205+0000","last_peered":"2024-03-27T08:33:18.661205+0000","last_clean":"2024-03-27T08:33:18.661205+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:33:18.661205+0000","last_undegraded":"2024-03-27T08:33:18.661205+0000","last_fullsized":"2024-03-27T08:33:18.661205+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.458546+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:33:18.458546+0000","last_peered":"2024-03-27T08:33:18.458546+0000","last_clean":"2024-03-27T08:33:18.458546+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:33:18.458546+0000","last_undegraded":"2024-03-27T08:33:18.458546+0000","last_fullsized":"2024-03-27T08:33:18.458546+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466650+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:33:18.466650+0000","last_peered":"2024-03-27T08:33:18.466650+0000","last_clean":"2024-03-27T08:33:18.466650+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:33:18.466650+0000","last_undegraded":"2024-03-27T08:33:18.466650+0000","last_fullsized":"2024-03-27T08:33:18.466650+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467013+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:33:18.467013+0000","last_peered":"2024-03-27T08:33:18.467013+0000","last_clean":"2024-03-27T08:33:18.467013+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:33:18.467013+0000","last_undegraded":"2024-03-27T08:33:18.467013+0000","last_fullsized":"2024-03-27T08:33:18.467013+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"88'1","reported_seq":15,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.479534+0000","last_change":"2024-03-27T08:33:18.478350+0000","last_active":"2024-03-27T08:33:18.479534+0000","last_peered":"2024-03-27T08:33:18.479534+0000","last_clean":"2024-03-27T08:33:18.479534+0000","last_became_active":"2024-03-27T08:33:18.470274+0000","last_became_peered":"2024-03-27T08:33:18.470274+0000","last_unstale":"2024-03-27T08:33:18.479534+0000","last_undegraded":"2024-03-27T08:33:18.479534+0000","last_fullsized":"2024-03-27T08:33:18.479534+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:54.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467522+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:33:18.467522+0000","last_peered":"2024-03-27T08:33:18.467522+0000","last_clean":"2024-03-27T08:33:18.467522+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:33:18.467522+0000","last_undegraded":"2024-03-27T08:33:18.467522+0000","last_fullsized":"2024-03-27T08:33:18.467522+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459568+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:33:18.459568+0000","last_peered":"2024-03-27T08:33:18.459568+0000","last_clean":"2024-03-27T08:33:18.459568+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:33:18.459568+0000","last_undegraded":"2024-03-27T08:33:18.459568+0000","last_fullsized":"2024-03-27T08:33:18.459568+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453206+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:33:18.453206+0000","last_peered":"2024-03-27T08:33:18.453206+0000","last_clean":"2024-03-27T08:33:18.453206+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:33:18.453206+0000","last_undegraded":"2024-03-27T08:33:18.453206+0000","last_fullsized":"2024-03-27T08:33:18.453206+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466304+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:33:18.466304+0000","last_peered":"2024-03-27T08:33:18.466304+0000","last_clean":"2024-03-27T08:33:18.466304+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:33:18.466304+0000","last_undegraded":"2024-03-27T08:33:18.466304+0000","last_fullsized":"2024-03-27T08:33:18.466304+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453613+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:33:18.453613+0000","last_peered":"2024-03-27T08:33:18.453613+0000","last_clean":"2024-03-27T08:33:18.453613+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:33:18.453613+0000","last_undegraded":"2024-03-27T08:33:18.453613+0000","last_fullsized":"2024-03-27T08:33:18.453613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454425+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:33:18.454425+0000","last_peered":"2024-03-27T08:33:18.454425+0000","last_clean":"2024-03-27T08:33:18.454425+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:33:18.454425+0000","last_undegraded":"2024-03-27T08:33:18.454425+0000","last_fullsized":"2024-03-27T08:33:18.454425+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"88'1","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453145+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:33:18.453145+0000","last_peered":"2024-03-27T08:33:18.453145+0000","last_clean":"2024-03-27T08:33:18.453145+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:33:18.453145+0000","last_undegraded":"2024-03-27T08:33:18.453145+0000","last_fullsized":"2024-03-27T08:33:18.453145+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450569+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:33:18.450569+0000","last_peered":"2024-03-27T08:33:18.450569+0000","last_clean":"2024-03-27T08:33:18.450569+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:33:18.450569+0000","last_undegraded":"2024-03-27T08:33:18.450569+0000","last_fullsized":"2024-03-27T08:33:18.450569+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453520+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:33:18.453520+0000","last_peered":"2024-03-27T08:33:18.453520+0000","last_clean":"2024-03-27T08:33:18.453520+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:33:18.453520+0000","last_undegraded":"2024-03-27T08:33:18.453520+0000","last_fullsized":"2024-03-27T08:33:18.453520+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467287+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:33:18.467287+0000","last_peered":"2024-03-27T08:33:18.467287+0000","last_clean":"2024-03-27T08:33:18.467287+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:33:18.467287+0000","last_undegraded":"2024-03-27T08:33:18.467287+0000","last_fullsized":"2024-03-27T08:33:18.467287+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462787+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:33:18.462787+0000","last_peered":"2024-03-27T08:33:18.462787+0000","last_clean":"2024-03-27T08:33:18.462787+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:33:18.462787+0000","last_undegraded":"2024-03-27T08:33:18.462787+0000","last_fullsized":"2024-03-27T08:33:18.462787+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.669781+0000","last_change":"2024-03-27T08:33:18.669781+0000","last_active":"2024-03-27T08:33:18.669781+0000","last_peered":"2024-03-27T08:33:18.669781+0000","last_clean":"2024-03-27T08:33:18.669781+0000","last_became_active":"2024-03-27T08:33:18.668571+0000","last_became_peered":"2024-03-27T08:33:18.668571+0000","last_unstale":"2024-03-27T08:33:18.669781+0000","last_undegraded":"2024-03-27T08:33:18.669781+0000","last_fullsized":"2024-03-27T08:33:18.669781+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:11:18.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453403+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:33:18.453403+0000","last_peered":"2024-03-27T08:33:18.453403+0000","last_clean":"2024-03-27T08:33:18.453403+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:33:18.453403+0000","last_undegraded":"2024-03-27T08:33:18.453403+0000","last_fullsized":"2024-03-27T08:33:18.453403+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450678+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:33:18.450678+0000","last_peered":"2024-03-27T08:33:18.450678+0000","last_clean":"2024-03-27T08:33:18.450678+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:33:18.450678+0000","last_undegraded":"2024-03-27T08:33:18.450678+0000","last_fullsized":"2024-03-27T08:33:18.450678+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462419+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:33:18.462419+0000","last_peered":"2024-03-27T08:33:18.462419+0000","last_clean":"2024-03-27T08:33:18.462419+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:33:18.462419+0000","last_undegraded":"2024-03-27T08:33:18.462419+0000","last_fullsized":"2024-03-27T08:33:18.462419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467295+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:33:18.467295+0000","last_peered":"2024-03-27T08:33:18.467295+0000","last_clean":"2024-03-27T08:33:18.467295+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:33:18.467295+0000","last_undegraded":"2024-03-27T08:33:18.467295+0000","last_fullsized":"2024-03-27T08:33:18.467295+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467927+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:33:18.467927+0000","last_peered":"2024-03-27T08:33:18.467927+0000","last_clean":"2024-03-27T08:33:18.467927+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:33:18.467927+0000","last_undegraded":"2024-03-27T08:33:18.467927+0000","last_fullsized":"2024-03-27T08:33:18.467927+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453330+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:33:18.453330+0000","last_peered":"2024-03-27T08:33:18.453330+0000","last_clean":"2024-03-27T08:33:18.453330+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:33:18.453330+0000","last_undegraded":"2024-03-27T08:33:18.453330+0000","last_fullsized":"2024-03-27T08:33:18.453330+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466630+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:33:18.466630+0000","last_peered":"2024-03-27T08:33:18.466630+0000","last_clean":"2024-03-27T08:33:18.466630+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:33:18.466630+0000","last_undegraded":"2024-03-27T08:33:18.466630+0000","last_fullsized":"2024-03-27T08:33:18.466630+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.660419+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:33:18.660419+0000","last_peered":"2024-03-27T08:33:18.660419+0000","last_clean":"2024-03-27T08:33:18.660419+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:33:18.660419+0000","last_undegraded":"2024-03-27T08:33:18.660419+0000","last_fullsized":"2024-03-27T08:33:18.660419+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450384+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:33:18.450384+0000","last_peered":"2024-03-27T08:33:18.450384+0000","last_clean":"2024-03-27T08:33:18.450384+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:33:18.450384+0000","last_undegraded":"2024-03-27T08:33:18.450384+0000","last_fullsized":"2024-03-27T08:33:18.450384+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.461450+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:33:18.461450+0000","last_peered":"2024-03-27T08:33:18.461450+0000","last_clean":"2024-03-27T08:33:18.461450+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:33:18.461450+0000","last_undegraded":"2024-03-27T08:33:18.461450+0000","last_fullsized":"2024-03-27T08:33:18.461450+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":65047,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":533,"num_read_kb":335,"num_write":158,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":195141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285602,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":468348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547241,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28652,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716500,"statfs":{"total":95995035648,"available":95965696000,"internally_reserved":0,"allocated":1667072,"data_stored":1120763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710766,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":987136,"data_stored":468472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972405,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":978944,"data_stored":468280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234047,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32724,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712428,"statfs":{"total":95995035648,"available":95961526272,"internally_reserved":0,"allocated":1581056,"data_stored":1060322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430276,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":974848,"data_stored":467861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36356,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708796,"statfs":{"total":95995035648,"available":95957807104,"internally_reserved":0,"allocated":1036288,"data_stored":528700,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36316,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708836,"statfs":{"total":95995035648,"available":95957848064,"internally_reserved":0,"allocated":995328,"data_stored":469132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411424,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28052,"kb_used_data":1036,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717100,"statfs":{"total":95995035648,"available":95966310400,"internally_reserved":0,"allocated":1060864,"data_stored":530441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117081,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32148,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713004,"statfs":{"total":95995035648,"available":95962116096,"internally_reserved":0,"allocated":991232,"data_stored":468172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855443,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717176,"statfs":{"total":95995035648,"available":95966388224,"internally_reserved":0,"allocated":978944,"data_stored":468298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691914,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28576,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716576,"statfs":{"total":95995035648,"available":95965773824,"internally_reserved":0,"allocated":1593344,"data_stored":1060006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":62787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":62624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:34:19.774 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-27T08:34:19.774 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-27T08:34:19.774 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-27T08:34:19.774 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph health --format=json 2024-03-27T08:34:20.267 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:20.573 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:20 smithi164 ceph-mon[31788]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:20.573 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:20 smithi164 ceph-mon[31788]: pgmap v411: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:34:20.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:20 smithi173 ceph-mon[35397]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:20.574 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:20 smithi173 ceph-mon[35397]: pgmap v411: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:34:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:20 smithi167 ceph-mon[34903]: from='client.14979 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:34:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:20 smithi167 ceph-mon[34903]: pgmap v411: 97 pgs: 97 active+clean; 640 KiB data, 354 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:34:22.435 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 -- 172.21.15.164:0/2594103791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0075330 msgr2=0x7f6ad010e980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/2594103791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0075330 0x7f6ad010e980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6abc009990 tx=0x7f6abc009ca0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 -- 172.21.15.164:0/2594103791 shutdown_connections 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/2594103791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad01112d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/2594103791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0074a10 0x7f6ad0074df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/2594103791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0075330 0x7f6ad010e980 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 -- 172.21.15.164:0/2594103791 >> 172.21.15.164:0/2594103791 conn(0x7f6ad00fe0f0 msgr2=0x7f6ad0100510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 -- 172.21.15.164:0/2594103791 shutdown_connections 2024-03-27T08:34:22.436 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.443+0000 7f6ad4a00700 1 -- 172.21.15.164:0/2594103791 wait complete. 2024-03-27T08:34:22.436 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:22 smithi164 ceph-mon[31788]: pgmap v412: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:34:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.444+0000 7f6ad4a00700 1 Processor -- start 2024-03-27T08:34:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.444+0000 7f6ad4a00700 1 -- start start 2024-03-27T08:34:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:22.438 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0075330 0x7f6ad019b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad019f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0114bc0 con 0x7f6ad0074a10 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0114a40 con 0x7f6ad010eec0 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ad4a00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6ad0114d40 con 0x7f6ad0075330 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33016/0 (socket says 172.21.15.164:33016) 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 -- 172.21.15.164:0/3355377254 learned_addr learned my addr 172.21.15.164:0/3355377254 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6ace800700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad019f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acd400700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0075330 0x7f6ad019b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 -- 172.21.15.164:0/3355377254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0075330 msgr2=0x7f6ad019b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0075330 0x7f6ad019b5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.445+0000 7f6acde00700 1 -- 172.21.15.164:0/3355377254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 msgr2=0x7f6ad019f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6acde00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad019f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.439 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6acde00700 1 -- 172.21.15.164:0/3355377254 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ad01a00c0 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ace800700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6acde00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000b530 tx=0x7f6ac000b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0015020 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6ac0011d00 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ad01a03b0 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ac0010e40 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.446+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ad01a7c30 con 0x7f6ad0074a10 2024-03-27T08:34:22.440 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.448+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ad0069300 con 0x7f6ad0074a10 2024-03-27T08:34:22.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.449+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f6ac0018020 con 0x7f6ad0074a10 2024-03-27T08:34:22.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.451+0000 7f6ac6a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 0x7f6ab40a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:22.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.451+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f6ac00cf550 con 0x7f6ad0074a10 2024-03-27T08:34:22.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.451+0000 7f6acd400700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 0x7f6ab40a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:22.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.452+0000 7f6acd400700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 0x7f6ab40a5be0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b5c0 tx=0x7f6abc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:22.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.455+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6ac001f020 con 0x7f6ad0074a10 2024-03-27T08:34:22.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.734+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6ad019c410 con 0x7f6ad0074a10 2024-03-27T08:34:22.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.735+0000 7f6ac6a00700 1 -- 172.21.15.164:0/3355377254 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f6ac0010380 con 0x7f6ad0074a10 2024-03-27T08:34:22.727 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:22.727 INFO:teuthology.orchestra.run.smithi164.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.738+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 msgr2=0x7f6ab40a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.738+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 0x7f6ab40a5be0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6abc00b5c0 tx=0x7f6abc005fb0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.738+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 msgr2=0x7f6ad019b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.738+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6ac000b530 tx=0x7f6ac000b8f0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 shutdown_connections 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6ab40a3720 0x7f6ab40a5be0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ad010eec0 0x7f6ad019f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6ad0074a10 0x7f6ad019b0b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 --2- 172.21.15.164:0/3355377254 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6ad0075330 0x7f6ad019b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 >> 172.21.15.164:0/3355377254 conn(0x7f6ad00fe0f0 msgr2=0x7f6ad00fee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 shutdown_connections 2024-03-27T08:34:22.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:22.739+0000 7f6ad4a00700 1 -- 172.21.15.164:0/3355377254 wait complete. 2024-03-27T08:34:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:22 smithi167 ceph-mon[34903]: pgmap v412: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:34:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:22 smithi173 ceph-mon[35397]: pgmap v412: 97 pgs: 97 active+clean; 640 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:34:23.529 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-27T08:34:23.529 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:34:23.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:23 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3355377254' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 -- 172.21.15.164:0/1779190323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 msgr2=0x7f80e0076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 --2- 172.21.15.164:0/1779190323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e0076930 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f80d0009900 tx=0x7f80d002bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 -- 172.21.15.164:0/1779190323 shutdown_connections 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 --2- 172.21.15.164:0/1779190323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e00780f0 0x7f80e0078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 --2- 172.21.15.164:0/1779190323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e0077750 0x7f80e0077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 --2- 172.21.15.164:0/1779190323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e0076930 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 -- 172.21.15.164:0/1779190323 >> 172.21.15.164:0/1779190323 conn(0x7f80e00ff300 msgr2=0x7f80e0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 -- 172.21.15.164:0/1779190323 shutdown_connections 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.762+0000 7f80e5600640 1 -- 172.21.15.164:0/1779190323 wait complete. 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.763+0000 7f80e5600640 1 Processor -- start 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.763+0000 7f80e5600640 1 -- start start 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 0x7f80e019e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 0x7f80e01a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113e30 con 0x7f80e0076510 2024-03-27T08:34:23.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113cb0 con 0x7f80e00780f0 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80e5600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f80e0113fb0 con 0x7f80e0077750 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33040/0 (socket says 172.21.15.164:33040) 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 -- 172.21.15.164:0/4128795888 learned_addr learned my addr 172.21.15.164:0/4128795888 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80d7e00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 0x7f80e019e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80df400640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 0x7f80e01a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 -- 172.21.15.164:0/4128795888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 msgr2=0x7f80e019e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 0x7f80e019e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 -- 172.21.15.164:0/4128795888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 msgr2=0x7f80e01a59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 0x7f80e01a59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80dea00640 1 -- 172.21.15.164:0/4128795888 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01a6010 con 0x7f80e0076510 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80d7e00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 0x7f80e019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.764+0000 7f80df400640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 0x7f80e01a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80dea00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000c00 tx=0x7f80d0004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:23.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0043020 con 0x7f80e0076510 2024-03-27T08:34:23.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f80d00054d0 con 0x7f80e0076510 2024-03-27T08:34:23.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01a62a0 con 0x7f80e0076510 2024-03-27T08:34:23.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d0003d40 con 0x7f80e0076510 2024-03-27T08:34:23.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.765+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e01a67f0 con 0x7f80e0076510 2024-03-27T08:34:23.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.766+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e0110800 con 0x7f80e0076510 2024-03-27T08:34:23.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.768+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f80d0046020 con 0x7f80e0076510 2024-03-27T08:34:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.769+0000 7f80d7400640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 0x7f80c40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.770+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f80d00f20c0 con 0x7f80e0076510 2024-03-27T08:34:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.770+0000 7f80d7e00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 0x7f80c40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.770+0000 7f80d7e00640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 0x7f80c40a5ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e019f900 tx=0x7f80c8005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:23.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.774+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f80d004d020 con 0x7f80e0076510 2024-03-27T08:34:23.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:23 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3355377254' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T08:34:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:23 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3355377254' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-27T08:34:23.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.976+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80e0062750 con 0x7f80e0076510 2024-03-27T08:34:23.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.978+0000 7f80d7400640 1 -- 172.21.15.164:0/4128795888 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f80d00beca0 con 0x7f80e0076510 2024-03-27T08:34:23.970 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:23.970 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:34:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 msgr2=0x7f80c40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 0x7f80c40a5ad0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f80e019f900 tx=0x7f80c8005e50 comp rx=0 tx=0).stop 2024-03-27T08:34:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 msgr2=0x7f80e019e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:23.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f80d0000c00 tx=0x7f80d0004f10 comp rx=0 tx=0).stop 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 shutdown_connections 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f80c40a3610 0x7f80c40a5ad0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f80e00780f0 0x7f80e01a59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f80e0077750 0x7f80e019e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 --2- 172.21.15.164:0/4128795888 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f80e0076510 0x7f80e019e3f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 >> 172.21.15.164:0/4128795888 conn(0x7f80e00ff300 msgr2=0x7f80e01009d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.980+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 shutdown_connections 2024-03-27T08:34:23.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:23.981+0000 7f80e5600640 1 -- 172.21.15.164:0/4128795888 wait complete. 2024-03-27T08:34:23.992 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:34:23.993 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:34:24.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 -- 172.21.15.164:0/2303015503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 msgr2=0x7f19e01104b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 --2- 172.21.15.164:0/2303015503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01104b0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009ca0 tx=0x7f19d802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 -- 172.21.15.164:0/2303015503 shutdown_connections 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 --2- 172.21.15.164:0/2303015503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01104b0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 --2- 172.21.15.164:0/2303015503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0109260 0x7f19e01096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 --2- 172.21.15.164:0/2303015503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0108070 0x7f19e0108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 -- 172.21.15.164:0/2303015503 >> 172.21.15.164:0/2303015503 conn(0x7f19e0077020 msgr2=0x7f19e0079440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 -- 172.21.15.164:0/2303015503 shutdown_connections 2024-03-27T08:34:24.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.197+0000 7f19df200640 1 -- 172.21.15.164:0/2303015503 wait complete. 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.198+0000 7f19df200640 1 Processor -- start 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.198+0000 7f19df200640 1 -- start start 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0108070 0x7f19e019e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0109260 0x7f19e019e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0113cd0 con 0x7f19e0109c20 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0113b50 con 0x7f19e0108070 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19df200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0113e50 con 0x7f19e0109260 2024-03-27T08:34:24.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33062/0 (socket says 172.21.15.164:33062) 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 -- 172.21.15.164:0/1783252558 learned_addr learned my addr 172.21.15.164:0/1783252558 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19dde00640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0108070 0x7f19e019e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19d7e00640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0109260 0x7f19e019e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 -- 172.21.15.164:0/1783252558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0109260 msgr2=0x7f19e019e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0109260 0x7f19e019e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 -- 172.21.15.164:0/1783252558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0108070 msgr2=0x7f19e019e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0108070 0x7f19e019e2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.199+0000 7f19de800640 1 -- 172.21.15.164:0/1783252558 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e01a5f10 con 0x7f19e0109c20 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19de800640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19d802c630 tx=0x7f19d8032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:24.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8039050 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f19d803a040 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e01a61a0 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d8004790 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.200+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a6640 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.201+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e010f390 con 0x7f19e0109c20 2024-03-27T08:34:24.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.203+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f19d8004040 con 0x7f19e0109c20 2024-03-27T08:34:24.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.205+0000 7f19d6a00640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 0x7f19c40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.206+0000 7f19dde00640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 0x7f19c40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.206+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f19d80f28a0 con 0x7f19e0109c20 2024-03-27T08:34:24.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.206+0000 7f19dde00640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 0x7f19c40a5ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19e01090c0 tx=0x7f19d0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:24.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.210+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f19d8004330 con 0x7f19e0109c20 2024-03-27T08:34:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.410+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f19e0062750 con 0x7f19e0109c20 2024-03-27T08:34:24.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.411+0000 7f19d6a00640 1 -- 172.21.15.164:0/1783252558 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f19d80bf420 con 0x7f19e0109c20 2024-03-27T08:34:24.403 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.413+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 msgr2=0x7f19c40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.413+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 0x7f19c40a5ad0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f19e01090c0 tx=0x7f19d0005f90 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.413+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 msgr2=0x7f19e01a58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.413+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f19d802c630 tx=0x7f19d8032900 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 shutdown_connections 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f19c40a3610 0x7f19c40a5ad0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f19e0109c20 0x7f19e01a58a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f19e0109260 0x7f19e019e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 --2- 172.21.15.164:0/1783252558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f19e0108070 0x7f19e019e2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 >> 172.21.15.164:0/1783252558 conn(0x7f19e0077020 msgr2=0x7f19e010c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:24.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 shutdown_connections 2024-03-27T08:34:24.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.414+0000 7f19df200640 1 -- 172.21.15.164:0/1783252558 wait complete. 2024-03-27T08:34:24.426 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.646+0000 7f02f8a00640 1 -- 172.21.15.164:0/4118804530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4103d90 msgr2=0x7f02f41041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.646+0000 7f02f8a00640 1 --2- 172.21.15.164:0/4118804530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4103d90 0x7f02f41041b0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f02e4009ca0 tx=0x7f02e402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 -- 172.21.15.164:0/4118804530 shutdown_connections 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 --2- 172.21.15.164:0/4118804530 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4105940 0x7f02f410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 --2- 172.21.15.164:0/4118804530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4104f80 0x7f02f4105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 --2- 172.21.15.164:0/4118804530 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4103d90 0x7f02f41041b0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 -- 172.21.15.164:0/4118804530 >> 172.21.15.164:0/4118804530 conn(0x7f02f40ff300 msgr2=0x7f02f4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 -- 172.21.15.164:0/4118804530 shutdown_connections 2024-03-27T08:34:24.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.647+0000 7f02f8a00640 1 -- 172.21.15.164:0/4118804530 wait complete. 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 Processor -- start 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 -- start start 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 0x7f02f419a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4105940 0x7f02f41a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f02f410f9f0 con 0x7f02f4104f80 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f02f410f870 con 0x7f02f4105940 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f8a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f02f410fb70 con 0x7f02f4103d90 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f1400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f1400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33080/0 (socket says 172.21.15.164:33080) 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.648+0000 7f02f1400640 1 -- 172.21.15.164:0/3468041285 learned_addr learned my addr 172.21.15.164:0/3468041285 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1e00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 0x7f02f419a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f2800640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4105940 0x7f02f41a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 -- 172.21.15.164:0/3468041285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 msgr2=0x7f02f419a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 0x7f02f419a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 -- 172.21.15.164:0/3468041285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4105940 msgr2=0x7f02f41a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4105940 0x7f02f41a1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 -- 172.21.15.164:0/3468041285 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02f41a1cf0 con 0x7f02f4104f80 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1e00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 0x7f02f419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:24.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f1400640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d950 tx=0x7f02dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc017070 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f02dc009c30 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02dc00f6b0 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.649+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02f41a1fe0 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.650+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02f41a2450 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.651+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02f410b130 con 0x7f02f4104f80 2024-03-27T08:34:24.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.653+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f02dc010a50 con 0x7f02f4104f80 2024-03-27T08:34:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.654+0000 7f02eaa00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 0x7f02d80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.654+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f02dc0cf990 con 0x7f02f4104f80 2024-03-27T08:34:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.654+0000 7f02f1e00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 0x7f02d80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:24.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.655+0000 7f02f1e00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 0x7f02d80a5b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02e4032460 tx=0x7f02e4000f40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:24.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.658+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f02dc009de0 con 0x7f02f4104f80 2024-03-27T08:34:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:24 smithi164 ceph-mon[31788]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4128795888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:24.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:24 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1783252558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:24 smithi167 ceph-mon[34903]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:24 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4128795888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:24.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:24 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1783252558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:24 smithi173 ceph-mon[35397]: pgmap v413: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:24 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4128795888' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:24 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1783252558' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:24.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.860+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f02f4062850 con 0x7f02f4104f80 2024-03-27T08:34:24.853 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.861+0000 7f02eaa00640 1 -- 172.21.15.164:0/3468041285 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f02dc09c570 con 0x7f02f4104f80 2024-03-27T08:34:24.853 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 msgr2=0x7f02d80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 0x7f02d80a5b50 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f02e4032460 tx=0x7f02e4000f40 comp rx=0 tx=0).stop 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 msgr2=0x7f02f419a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f02dc00d950 tx=0x7f02dc00de10 comp rx=0 tx=0).stop 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 shutdown_connections 2024-03-27T08:34:24.856 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f02d80a3690 0x7f02d80a5b50 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f02f4105940 0x7f02f41a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f02f4104f80 0x7f02f419a610 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 --2- 172.21.15.164:0/3468041285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f02f4103d90 0x7f02f419a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 >> 172.21.15.164:0/3468041285 conn(0x7f02f40ff300 msgr2=0x7f02f4108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 shutdown_connections 2024-03-27T08:34:24.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:24.864+0000 7f02f8a00640 1 -- 172.21.15.164:0/3468041285 wait complete. 2024-03-27T08:34:24.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 -- 172.21.15.164:0/385877566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0077750 msgr2=0x7f9ce0077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 --2- 172.21.15.164:0/385877566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0077750 0x7f9ce0077bb0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc009900 tx=0x7f9ccc02bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 -- 172.21.15.164:0/385877566 shutdown_connections 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 --2- 172.21.15.164:0/385877566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce00780f0 0x7f9ce0078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 --2- 172.21.15.164:0/385877566 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0077750 0x7f9ce0077bb0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 --2- 172.21.15.164:0/385877566 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce0076510 0x7f9ce0076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.094+0000 7f9ce5600640 1 -- 172.21.15.164:0/385877566 >> 172.21.15.164:0/385877566 conn(0x7f9ce00ff300 msgr2=0x7f9ce0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:25.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.095+0000 7f9ce5600640 1 -- 172.21.15.164:0/385877566 shutdown_connections 2024-03-27T08:34:25.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.095+0000 7f9ce5600640 1 -- 172.21.15.164:0/385877566 wait complete. 2024-03-27T08:34:25.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.095+0000 7f9ce5600640 1 Processor -- start 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 -- start start 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 0x7f9ce019eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce00780f0 0x7f9ce01a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0113e30 con 0x7f9ce0076510 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0113cb0 con 0x7f9ce0077750 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9ce5600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9ce0113fb0 con 0x7f9ce00780f0 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33096/0 (socket says 172.21.15.164:33096) 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 -- 172.21.15.164:0/3280933860 learned_addr learned my addr 172.21.15.164:0/3280933860 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cde000640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 0x7f9ce019eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 -- 172.21.15.164:0/3280933860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce00780f0 msgr2=0x7f9ce01a5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce00780f0 0x7f9ce01a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 -- 172.21.15.164:0/3280933860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 msgr2=0x7f9ce019eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.096+0000 7f9cdea00640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 0x7f9ce019eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cdea00640 1 -- 172.21.15.164:0/3280933860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ce01a6130 con 0x7f9ce0076510 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cde000640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 0x7f9ce019eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cdea00640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000d770 tx=0x7f9cd000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0017070 con 0x7f9ce0076510 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9cd00054f0 con 0x7f9ce0076510 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ce01a6420 con 0x7f9ce0076510 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cd0004d60 con 0x7f9ce0076510 2024-03-27T08:34:25.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.097+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ce01a6970 con 0x7f9ce0076510 2024-03-27T08:34:25.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.098+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ce0110700 con 0x7f9ce0076510 2024-03-27T08:34:25.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.100+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f9cd0004f00 con 0x7f9ce0076510 2024-03-27T08:34:25.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.101+0000 7f9cd7400640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 0x7f9cc40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.102+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9cd00cf810 con 0x7f9ce0076510 2024-03-27T08:34:25.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.102+0000 7f9cde000640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 0x7f9cc40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.102+0000 7f9cde000640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 0x7f9cc40a5b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0096c0 tx=0x7f9ccc005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:25.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.106+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9cd009c390 con 0x7f9ce0076510 2024-03-27T08:34:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.304+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9ce00627f0 con 0x7f9ce0076510 2024-03-27T08:34:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.305+0000 7f9cd7400640 1 -- 172.21.15.164:0/3280933860 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f9cd009bc90 con 0x7f9ce0076510 2024-03-27T08:34:25.296 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:34:25.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 msgr2=0x7f9cc40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 0x7f9cc40a5b50 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc0096c0 tx=0x7f9ccc005fd0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 msgr2=0x7f9ce019e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f9cd000d770 tx=0x7f9cd000dc30 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 shutdown_connections 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9cc40a3690 0x7f9cc40a5b50 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9ce00780f0 0x7f9ce01a5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9ce0077750 0x7f9ce019eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 --2- 172.21.15.164:0/3280933860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9ce0076510 0x7f9ce019e560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.307+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 >> 172.21.15.164:0/3280933860 conn(0x7f9ce00ff300 msgr2=0x7f9ce0100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.308+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 shutdown_connections 2024-03-27T08:34:25.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.308+0000 7f9ce5600640 1 -- 172.21.15.164:0/3280933860 wait complete. 2024-03-27T08:34:25.319 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:34:25.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 -- 172.21.15.164:0/3085336605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 msgr2=0x7f10a010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 --2- 172.21.15.164:0/3085336605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a010c1d0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1098009ca0 tx=0x7f109802c100 comp rx=0 tx=0).stop 2024-03-27T08:34:25.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 -- 172.21.15.164:0/3085336605 shutdown_connections 2024-03-27T08:34:25.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 --2- 172.21.15.164:0/3085336605 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a010c1d0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 --2- 172.21.15.164:0/3085336605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 0x7f10a0105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 --2- 172.21.15.164:0/3085336605 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 0x7f10a01041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 -- 172.21.15.164:0/3085336605 >> 172.21.15.164:0/3085336605 conn(0x7f10a00ff300 msgr2=0x7f10a0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 -- 172.21.15.164:0/3085336605 shutdown_connections 2024-03-27T08:34:25.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.539+0000 7f10a7400640 1 -- 172.21.15.164:0/3085336605 wait complete. 2024-03-27T08:34:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.540+0000 7f10a7400640 1 Processor -- start 2024-03-27T08:34:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.540+0000 7f10a7400640 1 -- start start 2024-03-27T08:34:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 0x7f10a0199f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 0x7f10a019a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010f9f0 con 0x7f10a0105940 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010f870 con 0x7f10a0104f80 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a7400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f10a010fb70 con 0x7f10a0103d90 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44712/0 (socket says 172.21.15.164:44712) 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a5400640 1 -- 172.21.15.164:0/721313444 learned_addr learned my addr 172.21.15.164:0/721313444 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f109fe00640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 0x7f10a019a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a4a00640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 0x7f10a0199f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a5400640 1 -- 172.21.15.164:0/721313444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 msgr2=0x7f10a0199f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.541+0000 7f10a5400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 0x7f10a0199f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a5400640 1 -- 172.21.15.164:0/721313444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 msgr2=0x7f10a019a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a5400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 0x7f10a019a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a5400640 1 -- 172.21.15.164:0/721313444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10a01a1ba0 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a5400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1098037040 tx=0x7f1098034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098039050 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f109803a040 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1098040450 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10a01a1e30 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.542+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10a01a22f0 con 0x7f10a0105940 2024-03-27T08:34:25.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.543+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10a010afe0 con 0x7f10a0105940 2024-03-27T08:34:25.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.545+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f10980040d0 con 0x7f10a0105940 2024-03-27T08:34:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.547+0000 7f109d600640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 0x7f10880a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.547+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f10980f3390 con 0x7f10a0105940 2024-03-27T08:34:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.547+0000 7f10a4a00640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 0x7f10880a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:25.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.548+0000 7f10a4a00640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 0x7f10880a5b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10940058c0 tx=0x7f109400a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:25.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.550+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f10980bff10 con 0x7f10a0105940 2024-03-27T08:34:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:25 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3468041285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:25 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3280933860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:25.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.792+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10a002d370 con 0x7f10a0105940 2024-03-27T08:34:25.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.793+0000 7f109d600640 1 -- 172.21.15.164:0/721313444 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7f10980bf810 con 0x7f10a0105940 2024-03-27T08:34:25.786 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:25.786 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:34:25.786 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:34:25.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 msgr2=0x7f10880a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 0x7f10880a5b50 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f10940058c0 tx=0x7f109400a4c0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.788 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 msgr2=0x7f10a01a1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1098037040 tx=0x7f1098034cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 shutdown_connections 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10880a3690 0x7f10880a5b50 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10a0105940 0x7f10a01a1530 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10a0104f80 0x7f10a019a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 --2- 172.21.15.164:0/721313444 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10a0103d90 0x7f10a0199f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.796+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 >> 172.21.15.164:0/721313444 conn(0x7f10a00ff300 msgr2=0x7f10a01081b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.797+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 shutdown_connections 2024-03-27T08:34:25.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:25.797+0000 7f10a7400640 1 -- 172.21.15.164:0/721313444 wait complete. 2024-03-27T08:34:25.808 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:34:25.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:25 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3468041285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:25.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:25 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3280933860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:25.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:25 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3468041285' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:25.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:25 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3280933860' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:26.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.032+0000 7f896aa00640 1 -- 172.21.15.164:0/73710324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 msgr2=0x7f8964105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.032+0000 7f896aa00640 1 --2- 172.21.15.164:0/73710324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f8964105400 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f894c009900 tx=0x7f894c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.032+0000 7f896aa00640 1 -- 172.21.15.164:0/73710324 shutdown_connections 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 --2- 172.21.15.164:0/73710324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 0x7f896410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 --2- 172.21.15.164:0/73710324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f8964105400 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 --2- 172.21.15.164:0/73710324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f89641041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 -- 172.21.15.164:0/73710324 >> 172.21.15.164:0/73710324 conn(0x7f89640ff300 msgr2=0x7f8964101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 -- 172.21.15.164:0/73710324 shutdown_connections 2024-03-27T08:34:26.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.033+0000 7f896aa00640 1 -- 172.21.15.164:0/73710324 wait complete. 2024-03-27T08:34:26.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 Processor -- start 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 -- start start 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f896419a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 0x7f89641a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f896410f9f0 con 0x7f8964104f80 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f896410f870 con 0x7f8964105940 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f896aa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f896410fb70 con 0x7f8964103d90 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f895be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f895be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44732/0 (socket says 172.21.15.164:44732) 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.034+0000 7f895be00640 1 -- 172.21.15.164:0/2871386814 learned_addr learned my addr 172.21.15.164:0/2871386814 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8963e00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f896419a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8968a00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 0x7f89641a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.028 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 -- 172.21.15.164:0/2871386814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 msgr2=0x7f896419a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f896419a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 -- 172.21.15.164:0/2871386814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 msgr2=0x7f89641a15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 0x7f89641a15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 -- 172.21.15.164:0/2871386814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89641a1c60 con 0x7f8964104f80 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8963e00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f896419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f895be00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f894c009230 tx=0x7f894c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c043020 con 0x7f8964104f80 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f894c0054b0 con 0x7f8964104f80 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.035+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f894c003b80 con 0x7f8964104f80 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.036+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89641a1ef0 con 0x7f8964104f80 2024-03-27T08:34:26.029 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.036+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89641a23b0 con 0x7f8964104f80 2024-03-27T08:34:26.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.037+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f896410b0b0 con 0x7f8964104f80 2024-03-27T08:34:26.030 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.039+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f894c046020 con 0x7f8964104f80 2024-03-27T08:34:26.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.040+0000 7f8961600640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 0x7f89480a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.040+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f894c0f1a60 con 0x7f8964104f80 2024-03-27T08:34:26.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.040+0000 7f8963e00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 0x7f89480a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.041+0000 7f8963e00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 0x7f89480a5ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8964104de0 tx=0x7f8954005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.044+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f894c04d070 con 0x7f8964104f80 2024-03-27T08:34:26.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.245+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89640627f0 con 0x7f8964104f80 2024-03-27T08:34:26.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.247+0000 7f8961600640 1 -- 172.21.15.164:0/2871386814 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f894c0be640 con 0x7f8964104f80 2024-03-27T08:34:26.240 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:26.240 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:34:26.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 msgr2=0x7f89480a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 0x7f89480a5ad0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f8964104de0 tx=0x7f8954005f90 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 msgr2=0x7f896419a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f894c009230 tx=0x7f894c005dd0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 shutdown_connections 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3610 0x7f89480a5ad0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105940 0x7f89641a15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104f80 0x7f896419a580 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 --2- 172.21.15.164:0/2871386814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103d90 0x7f896419a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.250+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 >> 172.21.15.164:0/2871386814 conn(0x7f89640ff300 msgr2=0x7f8964108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.251+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 shutdown_connections 2024-03-27T08:34:26.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.251+0000 7f896aa00640 1 -- 172.21.15.164:0/2871386814 wait complete. 2024-03-27T08:34:26.261 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:34:26.261 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 -- 172.21.15.164:0/1147166748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30105940 msgr2=0x7f2d3010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 --2- 172.21.15.164:0/1147166748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30105940 0x7f2d3010c1d0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f2d28009ca0 tx=0x7f2d2802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 -- 172.21.15.164:0/1147166748 shutdown_connections 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 --2- 172.21.15.164:0/1147166748 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30105940 0x7f2d3010c1d0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 --2- 172.21.15.164:0/1147166748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30104f80 0x7f2d30105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 --2- 172.21.15.164:0/1147166748 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 0x7f2d301041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.484+0000 7f2d34e00640 1 -- 172.21.15.164:0/1147166748 >> 172.21.15.164:0/1147166748 conn(0x7f2d300ff300 msgr2=0x7f2d30101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.485+0000 7f2d34e00640 1 -- 172.21.15.164:0/1147166748 shutdown_connections 2024-03-27T08:34:26.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.485+0000 7f2d34e00640 1 -- 172.21.15.164:0/1147166748 wait complete. 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.485+0000 7f2d34e00640 1 Processor -- start 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 -- start start 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 0x7f2d3019a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 0x7f2d301a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3010f9f0 con 0x7f2d30104f80 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3010f870 con 0x7f2d30105940 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d34e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3010fb70 con 0x7f2d30103d90 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d27e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44752/0 (socket says 172.21.15.164:44752) 2024-03-27T08:34:26.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d27e00640 1 -- 172.21.15.164:0/4079979836 learned_addr learned my addr 172.21.15.164:0/4079979836 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d2e800640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 0x7f2d301a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.486+0000 7f2d2de00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 0x7f2d3019a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 -- 172.21.15.164:0/4079979836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 msgr2=0x7f2d3019a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 0x7f2d3019a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 -- 172.21.15.164:0/4079979836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 msgr2=0x7f2d301a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 0x7f2d301a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 -- 172.21.15.164:0/4079979836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d301a1c80 con 0x7f2d30104f80 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d2e800640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 0x7f2d301a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d27e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e9f0 tx=0x7f2d1800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d1800cd80 con 0x7f2d30104f80 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d18010900 con 0x7f2d30104f80 2024-03-27T08:34:26.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d301a1f70 con 0x7f2d30104f80 2024-03-27T08:34:26.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d180189e0 con 0x7f2d30104f80 2024-03-27T08:34:26.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.487+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d301a2480 con 0x7f2d30104f80 2024-03-27T08:34:26.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.488+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d3010b130 con 0x7f2d30104f80 2024-03-27T08:34:26.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.490+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f2d18010ab0 con 0x7f2d30104f80 2024-03-27T08:34:26.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.492+0000 7f2d26a00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 0x7f2d140a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.492+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d180d0100 con 0x7f2d30104f80 2024-03-27T08:34:26.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.492+0000 7f2d2de00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 0x7f2d140a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.493+0000 7f2d2de00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 0x7f2d140a5b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d30104de0 tx=0x7f2d20005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.496+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f2d1809cce0 con 0x7f2d30104f80 2024-03-27T08:34:26.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.696+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d300627f0 con 0x7f2d30104f80 2024-03-27T08:34:26.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.696+0000 7f2d26a00640 1 -- 172.21.15.164:0/4079979836 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f2d1809c5e0 con 0x7f2d30104f80 2024-03-27T08:34:26.688 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:34:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 msgr2=0x7f2d140a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 0x7f2d140a5b50 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2d30104de0 tx=0x7f2d20005f90 comp rx=0 tx=0).stop 2024-03-27T08:34:26.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 msgr2=0x7f2d3019a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f2d1800e9f0 tx=0x7f2d1800eeb0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 shutdown_connections 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d140a3690 0x7f2d140a5b50 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d30105940 0x7f2d301a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d30104f80 0x7f2d3019a5a0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 --2- 172.21.15.164:0/4079979836 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d30103d90 0x7f2d3019a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.699+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 >> 172.21.15.164:0/4079979836 conn(0x7f2d300ff300 msgr2=0x7f2d30108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.700+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 shutdown_connections 2024-03-27T08:34:26.692 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.700+0000 7f2d34e00640 1 -- 172.21.15.164:0/4079979836 wait complete. 2024-03-27T08:34:26.708 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:26 smithi164 ceph-mon[31788]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:26.708 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:26 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/721313444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.708 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:26 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2871386814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.711 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:34:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:26 smithi167 ceph-mon[34903]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:26 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/721313444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:26 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2871386814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:26 smithi173 ceph-mon[35397]: pgmap v414: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:26 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/721313444' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:26 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2871386814' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.934+0000 7efeb8200640 1 -- 172.21.15.164:0/1366309274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0105940 msgr2=0x7efeb010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.934+0000 7efeb8200640 1 --2- 172.21.15.164:0/1366309274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0105940 0x7efeb010c1d0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efea8009ca0 tx=0x7efea802c100 comp rx=0 tx=0).stop 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 -- 172.21.15.164:0/1366309274 shutdown_connections 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 --2- 172.21.15.164:0/1366309274 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0105940 0x7efeb010c1d0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 --2- 172.21.15.164:0/1366309274 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0104f80 0x7efeb0105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 --2- 172.21.15.164:0/1366309274 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0103d90 0x7efeb01041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 -- 172.21.15.164:0/1366309274 >> 172.21.15.164:0/1366309274 conn(0x7efeb00ff300 msgr2=0x7efeb0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 -- 172.21.15.164:0/1366309274 shutdown_connections 2024-03-27T08:34:26.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.935+0000 7efeb8200640 1 -- 172.21.15.164:0/1366309274 wait complete. 2024-03-27T08:34:26.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 Processor -- start 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 -- start start 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 0x7efeb019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0105940 0x7efeb01a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efeb010f9f0 con 0x7efeb0104f80 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efeb010f870 con 0x7efeb0103d90 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb8200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efeb010fb70 con 0x7efeb0105940 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.936+0000 7efeb4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44780/0 (socket says 172.21.15.164:44780) 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 -- 172.21.15.164:0/4052674012 learned_addr learned my addr 172.21.15.164:0/4052674012 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb5800640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 0x7efeb019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb6200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0105940 0x7efeb01a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 -- 172.21.15.164:0/4052674012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0105940 msgr2=0x7efeb01a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0105940 0x7efeb01a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 -- 172.21.15.164:0/4052674012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 msgr2=0x7efeb019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 0x7efeb019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 -- 172.21.15.164:0/4052674012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01a1c90 con 0x7efeb0104f80 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb5800640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 0x7efeb019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeb4e00640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d950 tx=0x7efe9c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.937+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c017070 con 0x7efeb0104f80 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.938+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efe9c009c30 con 0x7efeb0104f80 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.938+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb01a1f80 con 0x7efeb0104f80 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.938+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe9c00f6b0 con 0x7efeb0104f80 2024-03-27T08:34:26.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.938+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb01a2490 con 0x7efeb0104f80 2024-03-27T08:34:26.932 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.939+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb010b180 con 0x7efeb0104f80 2024-03-27T08:34:26.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.942+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7efe9c010a50 con 0x7efeb0104f80 2024-03-27T08:34:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.943+0000 7efeae000640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 0x7efe980a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.943+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7efe9c0cf9f0 con 0x7efeb0104f80 2024-03-27T08:34:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.943+0000 7efeb5800640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 0x7efe980a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:26.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.944+0000 7efeb5800640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 0x7efe980a5b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efeb0104de0 tx=0x7efea4005e70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:26.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:26.948+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7efe9c009de0 con 0x7efeb0104f80 2024-03-27T08:34:27.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.151+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efeb00627f0 con 0x7efeb0104f80 2024-03-27T08:34:27.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.151+0000 7efeae000640 1 -- 172.21.15.164:0/4052674012 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7efe9c09c570 con 0x7efeb0104f80 2024-03-27T08:34:27.143 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:34:27.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.154+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 msgr2=0x7efe980a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.154+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 0x7efe980a5b50 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7efeb0104de0 tx=0x7efea4005e70 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.154+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 msgr2=0x7efeb019a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.154+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efe9c00d950 tx=0x7efe9c00de10 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.154+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 shutdown_connections 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efe980a3690 0x7efe980a5b50 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efeb0105940 0x7efeb01a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efeb0104f80 0x7efeb019a5b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 --2- 172.21.15.164:0/4052674012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeb0103d90 0x7efeb019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 >> 172.21.15.164:0/4052674012 conn(0x7efeb00ff300 msgr2=0x7efeb0108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 shutdown_connections 2024-03-27T08:34:27.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.155+0000 7efeb8200640 1 -- 172.21.15.164:0/4052674012 wait complete. 2024-03-27T08:34:27.167 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:34:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 -- 172.21.15.164:0/844968762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc104f60 msgr2=0x7f23cc1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 --2- 172.21.15.164:0/844968762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc104f60 0x7f23cc1053e0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f23c0009900 tx=0x7f23c002bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 -- 172.21.15.164:0/844968762 shutdown_connections 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 --2- 172.21.15.164:0/844968762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc105920 0x7f23cc10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 --2- 172.21.15.164:0/844968762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc104f60 0x7f23cc1053e0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 --2- 172.21.15.164:0/844968762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 0x7f23cc104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 -- 172.21.15.164:0/844968762 >> 172.21.15.164:0/844968762 conn(0x7f23cc0ff300 msgr2=0x7f23cc101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.397+0000 7f23d3e00640 1 -- 172.21.15.164:0/844968762 shutdown_connections 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.398+0000 7f23d3e00640 1 -- 172.21.15.164:0/844968762 wait complete. 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.398+0000 7f23d3e00640 1 Processor -- start 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 -- start start 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 0x7f23cc19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc104f60 0x7f23cc19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10fa20 con 0x7f23cc105920 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10f8a0 con 0x7f23cc104f60 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d3e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23cc10fba0 con 0x7f23cc103d70 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d1e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d1e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44800/0 (socket says 172.21.15.164:44800) 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d1e00640 1 -- 172.21.15.164:0/310392369 learned_addr learned my addr 172.21.15.164:0/310392369 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d0a00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc104f60 0x7f23cc19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.399+0000 7f23d1400640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 0x7f23cc19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 -- 172.21.15.164:0/310392369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 msgr2=0x7f23cc19a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 0x7f23cc19a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 -- 172.21.15.164:0/310392369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc104f60 msgr2=0x7f23cc19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc104f60 0x7f23cc19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 -- 172.21.15.164:0/310392369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23cc1a1c90 con 0x7f23cc105920 2024-03-27T08:34:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d1e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23c400eb10 tx=0x7f23c400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4004b20 con 0x7f23cc105920 2024-03-27T08:34:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23c4004cc0 con 0x7f23cc105920 2024-03-27T08:34:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23cc1a1f80 con 0x7f23cc105920 2024-03-27T08:34:27.394 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c4010700 con 0x7f23cc105920 2024-03-27T08:34:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.400+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23cc1a2440 con 0x7f23cc105920 2024-03-27T08:34:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.402+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23cc10b090 con 0x7f23cc105920 2024-03-27T08:34:27.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.404+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f23c4004e70 con 0x7f23cc105920 2024-03-27T08:34:27.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.405+0000 7f23ca000640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 0x7f23b40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.405+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23c40d0440 con 0x7f23cc105920 2024-03-27T08:34:27.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.405+0000 7f23d1400640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 0x7f23b40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.406+0000 7f23d1400640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 0x7f23b40a5b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f23bc005fd0 tx=0x7f23bc005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:27.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.408+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f23c4053cb0 con 0x7f23cc105920 2024-03-27T08:34:27.603 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.611+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f23cc02d370 con 0x7f23cc105920 2024-03-27T08:34:27.604 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.612+0000 7f23ca000640 1 -- 172.21.15.164:0/310392369 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f23c409d020 con 0x7f23cc105920 2024-03-27T08:34:27.604 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 msgr2=0x7f23b40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 0x7f23b40a5b50 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f23bc005fd0 tx=0x7f23bc005850 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 msgr2=0x7f23cc1a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f23c400eb10 tx=0x7f23c400c2d0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 shutdown_connections 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23b40a3690 0x7f23b40a5b50 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23cc105920 0x7f23cc1a1620 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23cc104f60 0x7f23cc19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 --2- 172.21.15.164:0/310392369 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23cc103d70 0x7f23cc19a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 >> 172.21.15.164:0/310392369 conn(0x7f23cc0ff300 msgr2=0x7f23cc108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 shutdown_connections 2024-03-27T08:34:27.607 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.615+0000 7f23d3e00640 1 -- 172.21.15.164:0/310392369 wait complete. 2024-03-27T08:34:27.626 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:34:27.701 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:27 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4079979836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.701 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:27 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4052674012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:27 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4079979836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:27 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4052674012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:27 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4079979836' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:27 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4052674012' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:27.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 -- 172.21.15.164:0/600427163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 msgr2=0x7f6a28077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/600427163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a28077bb0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6a14009900 tx=0x7f6a1402bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 -- 172.21.15.164:0/600427163 shutdown_connections 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/600427163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a280780f0 0x7f6a28078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/600427163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a28077bb0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/600427163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a28076510 0x7f6a28076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.841+0000 7f6a2ee00640 1 -- 172.21.15.164:0/600427163 >> 172.21.15.164:0/600427163 conn(0x7f6a280ff300 msgr2=0x7f6a28101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.842+0000 7f6a2ee00640 1 -- 172.21.15.164:0/600427163 shutdown_connections 2024-03-27T08:34:27.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.842+0000 7f6a2ee00640 1 -- 172.21.15.164:0/600427163 wait complete. 2024-03-27T08:34:27.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.842+0000 7f6a2ee00640 1 Processor -- start 2024-03-27T08:34:27.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 -- start start 2024-03-27T08:34:27.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a28076510 0x7f6a2819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a280780f0 0x7f6a281a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28113e30 con 0x7f6a28077750 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28113cb0 con 0x7f6a280780f0 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ee00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28113fb0 con 0x7f6a28076510 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a27400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a27400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44830/0 (socket says 172.21.15.164:44830) 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a27400640 1 -- 172.21.15.164:0/2952339536 learned_addr learned my addr 172.21.15.164:0/2952339536 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.843+0000 7f6a2ce00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a280780f0 0x7f6a281a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27e00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a28076510 0x7f6a2819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 -- 172.21.15.164:0/2952339536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a28076510 msgr2=0x7f6a2819e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a28076510 0x7f6a2819e470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 -- 172.21.15.164:0/2952339536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a280780f0 msgr2=0x7f6a281a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a280780f0 0x7f6a281a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 -- 172.21.15.164:0/2952339536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a281a6090 con 0x7f6a28077750 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a27400640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000c00 tx=0x7f6a14004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:27.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14043020 con 0x7f6a28077750 2024-03-27T08:34:27.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6a140054d0 con 0x7f6a28077750 2024-03-27T08:34:27.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a281a6320 con 0x7f6a28077750 2024-03-27T08:34:27.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a14003d40 con 0x7f6a28077750 2024-03-27T08:34:27.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.844+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a281a6870 con 0x7f6a28077750 2024-03-27T08:34:27.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.846+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a28110890 con 0x7f6a28077750 2024-03-27T08:34:27.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.847+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f6a14046020 con 0x7f6a28077750 2024-03-27T08:34:27.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.849+0000 7f6a24c00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 0x7f6a0c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:27.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.849+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f6a140f20e0 con 0x7f6a28077750 2024-03-27T08:34:27.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.849+0000 7f6a27e00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 0x7f6a0c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:27.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.850+0000 7f6a27e00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 0x7f6a0c0a5ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005fd0 tx=0x7f6a18005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:27.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:27.853+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f6a1404d020 con 0x7f6a28077750 2024-03-27T08:34:28.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.097+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a2802d370 con 0x7f6a28077750 2024-03-27T08:34:28.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.099+0000 7f6a24c00640 1 -- 172.21.15.164:0/2952339536 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7f6a140beca0 con 0x7f6a28077750 2024-03-27T08:34:28.091 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:28.091 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:34:28.091 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 msgr2=0x7f6a0c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 0x7f6a0c0a5ad0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6a18005fd0 tx=0x7f6a18005850 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 msgr2=0x7f6a2819e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f6a14000c00 tx=0x7f6a14004f10 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 shutdown_connections 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6a0c0a3610 0x7f6a0c0a5ad0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a280780f0 0x7f6a281a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6a28077750 0x7f6a2819e9b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 --2- 172.21.15.164:0/2952339536 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6a28076510 0x7f6a2819e470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 >> 172.21.15.164:0/2952339536 conn(0x7f6a280ff300 msgr2=0x7f6a28100a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:28.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 shutdown_connections 2024-03-27T08:34:28.095 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.102+0000 7f6a2ee00640 1 -- 172.21.15.164:0/2952339536 wait complete. 2024-03-27T08:34:28.112 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:34:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 -- 172.21.15.164:0/4163633307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c103710 msgr2=0x7f1e4c109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 --2- 172.21.15.164:0/4163633307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c103710 0x7f1e4c109fa0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f1e44009ca0 tx=0x7f1e4402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 -- 172.21.15.164:0/4163633307 shutdown_connections 2024-03-27T08:34:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 --2- 172.21.15.164:0/4163633307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c103710 0x7f1e4c109fa0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.320 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 --2- 172.21.15.164:0/4163633307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e4c102d50 0x7f1e4c1031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 --2- 172.21.15.164:0/4163633307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c101b60 0x7f1e4c101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 -- 172.21.15.164:0/4163633307 >> 172.21.15.164:0/4163633307 conn(0x7f1e4c0fd0f0 msgr2=0x7f1e4c0ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 -- 172.21.15.164:0/4163633307 shutdown_connections 2024-03-27T08:34:28.321 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.328+0000 7f1e50e00640 1 -- 172.21.15.164:0/4163633307 wait complete. 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.329+0000 7f1e50e00640 1 Processor -- start 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.329+0000 7f1e50e00640 1 -- start start 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c102d50 0x7f1e4c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e4c103710 0x7f1e4c074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10d7c0 con 0x7f1e4c101b60 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10d640 con 0x7f1e4c102d50 2024-03-27T08:34:28.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e50e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1e4c10d940 con 0x7f1e4c103710 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44850/0 (socket says 172.21.15.164:44850) 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 -- 172.21.15.164:0/2803639462 learned_addr learned my addr 172.21.15.164:0/2803639462 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e41400640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c102d50 0x7f1e4c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 -- 172.21.15.164:0/2803639462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e4c103710 msgr2=0x7f1e4c074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e4c103710 0x7f1e4c074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 -- 172.21.15.164:0/2803639462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c102d50 msgr2=0x7f1e4c073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c102d50 0x7f1e4c073f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.330+0000 7f1e49e00640 1 -- 172.21.15.164:0/2803639462 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e4c074d10 con 0x7f1e4c101b60 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e49e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00e9c0 tx=0x7f1e3c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c00cd80 con 0x7f1e4c101b60 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e3c0035f0 con 0x7f1e4c101b60 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e4c1a1ef0 con 0x7f1e4c101b60 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e3c010690 con 0x7f1e4c101b60 2024-03-27T08:34:28.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.331+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e4c1a2350 con 0x7f1e4c101b60 2024-03-27T08:34:28.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.332+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e4c108e80 con 0x7f1e4c101b60 2024-03-27T08:34:28.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.334+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f1e3c0037a0 con 0x7f1e4c101b60 2024-03-27T08:34:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.335+0000 7f1e43400640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 0x7f1e300a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.335+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f1e3c0d02f0 con 0x7f1e4c101b60 2024-03-27T08:34:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.335+0000 7f1e41400640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 0x7f1e300a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.336+0000 7f1e41400640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 0x7f1e300a5ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e34005fd0 tx=0x7f1e34005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:28.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.339+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1e3c09ce70 con 0x7f1e4c101b60 2024-03-27T08:34:28.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.536+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e4c0627f0 con 0x7f1e4c101b60 2024-03-27T08:34:28.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.538+0000 7f1e43400640 1 -- 172.21.15.164:0/2803639462 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f1e3c09c770 con 0x7f1e4c101b60 2024-03-27T08:34:28.531 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:28.531 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 msgr2=0x7f1e300a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 0x7f1e300a5ad0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1e34005fd0 tx=0x7f1e34005850 comp rx=0 tx=0).stop 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 msgr2=0x7f1e4c075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f1e3c00e9c0 tx=0x7f1e3c00ee80 comp rx=0 tx=0).stop 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 shutdown_connections 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1e300a3610 0x7f1e300a5ad0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1e4c103710 0x7f1e4c074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e4c102d50 0x7f1e4c073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 --2- 172.21.15.164:0/2803639462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1e4c101b60 0x7f1e4c075900 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 >> 172.21.15.164:0/2803639462 conn(0x7f1e4c0fd0f0 msgr2=0x7f1e4c106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:28.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 shutdown_connections 2024-03-27T08:34:28.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.541+0000 7f1e50e00640 1 -- 172.21.15.164:0/2803639462 wait complete. 2024-03-27T08:34:28.550 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:34:28.673 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:28 smithi164 ceph-mon[31788]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:34:28.673 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:28 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/310392369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:28.673 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:28 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2952339536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:28.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 -- 172.21.15.164:0/2719060719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0104f60 msgr2=0x7fbac01053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 --2- 172.21.15.164:0/2719060719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0104f60 0x7fbac01053e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fbaac009900 tx=0x7fbaac02bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:28.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 -- 172.21.15.164:0/2719060719 shutdown_connections 2024-03-27T08:34:28.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 --2- 172.21.15.164:0/2719060719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0105920 0x7fbac010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 --2- 172.21.15.164:0/2719060719 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0104f60 0x7fbac01053e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 --2- 172.21.15.164:0/2719060719 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0103d70 0x7fbac0104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 -- 172.21.15.164:0/2719060719 >> 172.21.15.164:0/2719060719 conn(0x7fbac00ff300 msgr2=0x7fbac0101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:28.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 -- 172.21.15.164:0/2719060719 shutdown_connections 2024-03-27T08:34:28.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.744+0000 7fbac6600640 1 -- 172.21.15.164:0/2719060719 wait complete. 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.745+0000 7fbac6600640 1 Processor -- start 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.745+0000 7fbac6600640 1 -- start start 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 0x7fbac019a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0104f60 0x7fbac019a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010fa20 con 0x7fbac0105920 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010f8a0 con 0x7fbac0103d70 2024-03-27T08:34:28.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbac6600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbac010fba0 con 0x7fbac0104f60 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbabfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbabfe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44860/0 (socket says 172.21.15.164:44860) 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbabfe00640 1 -- 172.21.15.164:0/608962941 learned_addr learned my addr 172.21.15.164:0/608962941 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbabf400640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 0x7fbac019a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.746+0000 7fbabea00640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0104f60 0x7fbac019a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 -- 172.21.15.164:0/608962941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0104f60 msgr2=0x7fbac019a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0104f60 0x7fbac019a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 -- 172.21.15.164:0/608962941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 msgr2=0x7fbac019a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 0x7fbac019a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 -- 172.21.15.164:0/608962941 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbac01a1c90 con 0x7fbac0105920 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabf400640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 0x7fbac019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbabfe00640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab8017070 con 0x7fbac0105920 2024-03-27T08:34:28.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbab8003e40 con 0x7fbac0105920 2024-03-27T08:34:28.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbac01a1f80 con 0x7fbac0105920 2024-03-27T08:34:28.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbab80106c0 con 0x7fbac0105920 2024-03-27T08:34:28.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.747+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbac01a2440 con 0x7fbac0105920 2024-03-27T08:34:28.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.749+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbac010b090 con 0x7fbac0105920 2024-03-27T08:34:28.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.752+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fbab8003970 con 0x7fbac0105920 2024-03-27T08:34:28.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.753+0000 7fbab7e00640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 0x7fbaa40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:28.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.753+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbab80cfb30 con 0x7fbac0105920 2024-03-27T08:34:28.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.754+0000 7fbabf400640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 0x7fbaa40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:28.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.754+0000 7fbabf400640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 0x7fbaa40a5b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbab00058c0 tx=0x7fbab0005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:28.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:28.758+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fbab8003c60 con 0x7fbac0105920 2024-03-27T08:34:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:28 smithi167 ceph-mon[34903]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:34:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:28 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/310392369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:28 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2952339536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:28 smithi173 ceph-mon[35397]: pgmap v415: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 426 B/s wr, 7 op/s 2024-03-27T08:34:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:28 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/310392369' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:28 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2952339536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:28.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.000+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbac0062780 con 0x7fbac0105920 2024-03-27T08:34:28.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.001+0000 7fbab7e00640 1 -- 172.21.15.164:0/608962941 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7fbab809c6b0 con 0x7fbac0105920 2024-03-27T08:34:28.993 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:28.994 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:34:28.994 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:34:28.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 msgr2=0x7fbaa40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 0x7fbaa40a5b50 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fbab00058c0 tx=0x7fbab0005850 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 msgr2=0x7fbac01a1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbab8009fd0 tx=0x7fbab800b260 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 shutdown_connections 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbaa40a3690 0x7fbaa40a5b50 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbac0105920 0x7fbac01a1620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbac0104f60 0x7fbac019a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 --2- 172.21.15.164:0/608962941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbac0103d70 0x7fbac019a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 >> 172.21.15.164:0/608962941 conn(0x7fbac00ff300 msgr2=0x7fbac0108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 shutdown_connections 2024-03-27T08:34:28.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.004+0000 7fbac6600640 1 -- 172.21.15.164:0/608962941 wait complete. 2024-03-27T08:34:29.014 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-27T08:32:46.030344+0000', 'modified': '2024-03-27T08:32:51.674097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34502, 'mds_1': 34463, 'mds_2': 34430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6837/3514225451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3514225451}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3514225451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6839/2691398042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2691398042}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2691398042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34403': {'gid': 34403, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6833/2990296948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 2990296948}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 2990296948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34430': {'gid': 34430, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.167:6835/2127625535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 2127625535}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 2127625535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34463': {'gid': 34463, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6837/3651037274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 3651037274}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 3651037274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34502': {'gid': 34502, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6839/2821873023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 2821873023}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 2821873023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34502, 'qdb_cluster': [34430, 34463, 34502]} 2024-03-27T08:34:29.014 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-27T08:34:29.014 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 -- 172.21.15.164:0/3328051460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8102b50 msgr2=0x7f1ef8102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 --2- 172.21.15.164:0/3328051460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8102b50 0x7f1ef8102fd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4009900 tx=0x7f1ee402bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 -- 172.21.15.164:0/3328051460 shutdown_connections 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 --2- 172.21.15.164:0/3328051460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8103510 0x7f1ef8109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 --2- 172.21.15.164:0/3328051460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8102b50 0x7f1ef8102fd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 --2- 172.21.15.164:0/3328051460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 0x7f1ef8101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 -- 172.21.15.164:0/3328051460 >> 172.21.15.164:0/3328051460 conn(0x7f1ef80fceb0 msgr2=0x7f1ef80ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 -- 172.21.15.164:0/3328051460 shutdown_connections 2024-03-27T08:34:29.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.214+0000 7f1efde00640 1 -- 172.21.15.164:0/3328051460 wait complete. 2024-03-27T08:34:29.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 Processor -- start 2024-03-27T08:34:29.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 -- start start 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 0x7f1ef8197bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8102b50 0x7f1ef8198100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef810d5c0 con 0x7f1ef8103510 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef810d440 con 0x7f1ef8102b50 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.215+0000 7f1efde00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef810d740 con 0x7f1ef8101960 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44878/0 (socket says 172.21.15.164:44878) 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 -- 172.21.15.164:0/1527794353 learned_addr learned my addr 172.21.15.164:0/1527794353 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8102b50 0x7f1ef8198100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efca00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 0x7f1ef8197bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 -- 172.21.15.164:0/1527794353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 msgr2=0x7f1ef8197bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 0x7f1ef8197bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 -- 172.21.15.164:0/1527794353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8102b50 msgr2=0x7f1ef8198100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8102b50 0x7f1ef8198100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 -- 172.21.15.164:0/1527794353 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef819f7e0 con 0x7f1ef8103510 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.216+0000 7f1efd400640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000eaa0 tx=0x7f1ef000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.217+0000 7f1ef5600640 1 -- 172.21.15.164:0/1527794353 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef000cdb0 con 0x7f1ef8103510 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.217+0000 7f1ef5600640 1 -- 172.21.15.164:0/1527794353 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ef0005020 con 0x7f1ef8103510 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.217+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef819fad0 con 0x7f1ef8103510 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.217+0000 7f1ef5600640 1 -- 172.21.15.164:0/1527794353 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00116b0 con 0x7f1ef8103510 2024-03-27T08:34:29.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.217+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef819ffa0 con 0x7f1ef8103510 2024-03-27T08:34:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.220+0000 7f1f02026740 1 Processor -- start 2024-03-27T08:34:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.220+0000 7f1ef5600640 1 -- 172.21.15.164:0/1527794353 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f1ef00051d0 con 0x7f1ef8103510 2024-03-27T08:34:29.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.220+0000 7f1f02026740 1 -- start start 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.220+0000 7f1f02026740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.220+0000 7f1f02026740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eaea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1f02026740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6eb1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1f02026740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5597d6e67920 con 0x5597d6ea9530 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1f02026740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597d6db7fa0 con 0x5597d6ea9f20 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1f02026740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597d6e09f90 con 0x5597d6eaf090 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44892/0 (socket says 172.21.15.164:44892) 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1efca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eaea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 -- 172.21.15.164:0/2075535960 learned_addr learned my addr 172.21.15.164:0/2075535960 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 -- 172.21.15.164:0/2075535960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 msgr2=0x5597d6eb1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6eb1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 -- 172.21.15.164:0/2075535960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 msgr2=0x5597d6eaea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eaea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.221+0000 7f1ef7e00640 1 -- 172.21.15.164:0/2075535960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d6b1e2d0 con 0x5597d6ea9530 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4036040 tx=0x7f1ee402c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e6c9c91bf9dabe server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ef5600640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 0x7f1ee00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ee9c00640 1 -- 172.21.15.164:0/2075535960 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee402ca90 con 0x5597d6ea9530 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ef5600640 1 -- 172.21.15.164:0/1527794353 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f1ef00cff70 con 0x7f1ef8103510 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ee9c00640 1 -- 172.21.15.164:0/2075535960 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ee402cc30 con 0x5597d6ea9530 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1ee9c00640 1 -- 172.21.15.164:0/2075535960 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4004a40 con 0x5597d6ea9530 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.222+0000 7f1efca00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 0x7f1ee00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 -- 172.21.15.164:0/2075535960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 msgr2=0x5597d6ea9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1efca00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 0x7f1ee00a5ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5597d6eaa320 tx=0x7f1eec00c4b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4036040 tx=0x7f1ee402c920 comp rx=0 tx=0).stop 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 -- 172.21.15.164:0/2075535960 shutdown_connections 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6eb1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eaea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 --2- 172.21.15.164:0/2075535960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6ea9950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 -- 172.21.15.164:0/2075535960 >> 172.21.15.164:0/2075535960 conn(0x5597d6ea0690 msgr2=0x5597d6ea0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 -- 172.21.15.164:0/2075535960 shutdown_connections 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.223+0000 7f1f02026740 1 -- 172.21.15.164:0/2075535960 wait complete. 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 -- start start 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 Processor -- start 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 0x5597d6eb37d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5597d6e05f40 con 0x5597d6ea9f20 2024-03-27T08:34:29.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597d6db2650 con 0x5597d6ea9530 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597d6dc5a10 con 0x5597d6eaf090 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1f02026740 10 client.0 _ll_register_callbacks cb 0x5597d6e04ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1ef7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44894/0 (socket says 172.21.15.164:44894) 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.224+0000 7f1ef7e00640 1 -- 172.21.15.164:0/3160063108 learned_addr learned my addr 172.21.15.164:0/3160063108 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1efca00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 0x5597d6eb37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1efd400640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 -- 172.21.15.164:0/3160063108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 msgr2=0x5597d6ebad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 -- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 msgr2=0x5597d6eb37d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 0x5597d6eb37d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 -- 172.21.15.164:0/3160063108 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d6be86b0 con 0x5597d6ea9f20 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1efca00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 0x5597d6eb37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4000c00 tx=0x7f1ee40346e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e65372bd485eb8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ede000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee4034d20 con 0x5597d6ea9f20 2024-03-27T08:34:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ee402cc30 con 0x5597d6ea9f20 2024-03-27T08:34:29.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.225+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f1ee4040400 con 0x5597d6ea9f20 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1ee4040600 con 0x5597d6ea9f20 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 10 client.15069 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5597d6ebe0c0 con 0x5597d6ea9f20 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ee402cc30 con 0x5597d6ea9f20 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f1ee4048800 con 0x5597d6ea9f20 2024-03-27T08:34:29.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 10 client.15069 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 10 client.15069 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 20 client.15069 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6ec0330 0x5597d6ec17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 4 client.15069 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.226+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5597d6e174d0 con 0x5597d6ec0330 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.227+0000 7f1efca00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6ec0330 0x5597d6ec17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.228+0000 7f1efca00640 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6ec0330 0x5597d6ec17a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8352eb4a646133a3 server_cookie=4ff1457e124ee905 in_seq=0 out_seq=0 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.228+0000 7f1ede000640 10 client.15069 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.229+0000 7f1ede000640 1 -- 172.21.15.164:0/3160063108 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5597d6e174d0 con 0x5597d6ec0330 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.229+0000 7f1ede000640 10 client.15069 handle_command_reply: tid=0 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.229+0000 7f1f02026740 1 client.15069 shutdown 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 msgr2=0x5597d6eb3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f1ee4000c00 tx=0x7f1ee40346e0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 shutdown_connections 2024-03-27T08:34:29.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6ec0330 0x5597d6ec17a0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9f20 0x5597d6eb3d10 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 --2- 172.21.15.164:0/3160063108 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9530 0x5597d6eb37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1ede000640 0 client.15069 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 >> 172.21.15.164:0/3160063108 conn(0x5597d6ea0690 msgr2=0x5597d6e9f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 shutdown_connections 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 1 -- 172.21.15.164:0/3160063108 wait complete. 2024-03-27T08:34:29.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.230+0000 7f1f02026740 20 client.15069 trim_cache size 0 max 16384 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.249+0000 7f1f02026740 1 Processor -- start 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.249+0000 7f1f02026740 1 -- start start 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.249+0000 7f1f02026740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.249+0000 7f1f02026740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb27a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1f02026740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1f02026740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ebfae0 con 0x5597d6ea9530 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1f02026740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ec01b0 con 0x5597d6ea9f20 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1f02026740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ec0880 con 0x5597d6eaf090 2024-03-27T08:34:29.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44900/0 (socket says 172.21.15.164:44900) 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 -- 172.21.15.164:0/1262163820 learned_addr learned my addr 172.21.15.164:0/1262163820 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb27a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 -- 172.21.15.164:0/1262163820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 msgr2=0x5597d6ebad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 -- 172.21.15.164:0/1262163820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 msgr2=0x5597d6eb27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb27a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 -- 172.21.15.164:0/1262163820 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5597d6ea1400 con 0x5597d6ea9530 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:29.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.250+0000 7f1efca00640 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5597d6e06030 tx=0x7f1eec014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fb9ff5a39713cfc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1ee9200640 1 -- 172.21.15.164:0/1262163820 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec029e50 con 0x5597d6ea9530 2024-03-27T08:34:29.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1ee9200640 1 -- 172.21.15.164:0/1262163820 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1eec02f070 con 0x5597d6ea9530 2024-03-27T08:34:29.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1ee9200640 1 -- 172.21.15.164:0/1262163820 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1eec01adf0 con 0x5597d6ea9530 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 -- 172.21.15.164:0/1262163820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 msgr2=0x5597d6eb2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x5597d6e06030 tx=0x7f1eec014000 comp rx=0 tx=0).stop 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 -- 172.21.15.164:0/1262163820 shutdown_connections 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6eaf090 0x5597d6ebad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb27a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 --2- 172.21.15.164:0/1262163820 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6ea9530 0x5597d6eb2260 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.251+0000 7f1f02026740 1 -- 172.21.15.164:0/1262163820 >> 172.21.15.164:0/1262163820 conn(0x5597d6ea0690 msgr2=0x5597d6ea0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.252+0000 7f1f02026740 1 -- 172.21.15.164:0/1262163820 shutdown_connections 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.252+0000 7f1f02026740 1 -- 172.21.15.164:0/1262163820 wait complete. 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.252+0000 7f1f02026740 1 -- start start 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.252+0000 7f1f02026740 1 Processor -- start 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6ea9530 0x5597d6eb6880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ec1620 con 0x5597d6eaf090 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ec0f50 con 0x5597d6ea9f20 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5597d6ec1cf0 con 0x5597d6ea9530 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1f02026740 10 client.0 _ll_register_callbacks cb 0x7f1eec00c350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44908/0 (socket says 172.21.15.164:44908) 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 -- 172.21.15.164:0/730964762 learned_addr learned my addr 172.21.15.164:0/730964762 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 -- 172.21.15.164:0/730964762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6ea9530 msgr2=0x5597d6eb6880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6ea9530 0x5597d6eb6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 -- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 msgr2=0x5597d6eb6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 -- 172.21.15.164:0/730964762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5597d6eba3d0 con 0x5597d6eaf090 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1ef7e00640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1efd400640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009270 tx=0x7f1ef009be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1b56b7ed4762540 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.253+0000 7f1ede000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef001f070 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f1ef009baa0 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1eec02f070 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f1ef009c450 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 10 client.15075 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5597d6f26580 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1eec02f070 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f1ef000f040 con 0x5597d6eaf090 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 10 client.15075 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 10 client.15075 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 20 client.15075 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6f2b210 0x5597d6f27650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 4 client.15075 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.254+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "status"}) -- 0x5597d6e11820 con 0x5597d6f2b210 2024-03-27T08:34:29.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.255+0000 7f1efca00640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6f2b210 0x5597d6f27650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.255+0000 7f1efca00640 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6f2b210 0x5597d6f27650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=54ac85c642549c55 server_cookie=491d9483458d4876 in_seq=0 out_seq=0 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.255+0000 7f1ede000640 10 client.15075 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1ede000640 1 -- 172.21.15.164:0/730964762 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5597d6e11820 con 0x5597d6f2b210 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1ede000640 10 client.15075 handle_command_reply: tid=0 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 client.15075 shutdown 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 msgr2=0x5597d6eb9de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f1ef0009270 tx=0x7f1ef009be70 comp rx=0 tx=0).stop 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 shutdown_connections 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5597d6f2b210 0x5597d6f27650 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5597d6eaf090 0x5597d6eb9de0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5597d6ea9f20 0x5597d6eb6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1ede000640 0 client.15075 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 --2- 172.21.15.164:0/730964762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5597d6ea9530 0x5597d6eb6880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 >> 172.21.15.164:0/730964762 conn(0x5597d6ea0690 msgr2=0x5597d6eb2260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 shutdown_connections 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 1 -- 172.21.15.164:0/730964762 wait complete. 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.256+0000 7f1f02026740 20 client.15075 trim_cache size 0 max 16384 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 2, 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34430, 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:34:29.252 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 98.053465105000001, 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 135.774410577 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:34:29.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 msgr2=0x7f1ee00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 0x7f1ee00a5ad0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5597d6eaa320 tx=0x7f1eec00c4b0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 msgr2=0x7f1ef819f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f1ef000eaa0 tx=0x7f1ef000ef60 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 shutdown_connections 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1ee00a3610 0x7f1ee00a5ad0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1ef8103510 0x7f1ef819f170 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ef8102b50 0x7f1ef8198100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 --2- 172.21.15.164:0/1527794353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1ef8101960 0x7f1ef8197bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 >> 172.21.15.164:0/1527794353 conn(0x7f1ef80fceb0 msgr2=0x7f1ef8105e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 shutdown_connections 2024-03-27T08:34:29.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.257+0000 7f1efde00640 1 -- 172.21.15.164:0/1527794353 wait complete. 2024-03-27T08:34:29.264 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 -- 172.21.15.164:0/1349956025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981014c0 msgr2=0x7fac98101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 --2- 172.21.15.164:0/1349956025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981014c0 0x7fac98101940 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fac90009ca0 tx=0x7fac9002c100 comp rx=0 tx=0).stop 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 -- 172.21.15.164:0/1349956025 shutdown_connections 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 --2- 172.21.15.164:0/1349956025 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981014c0 0x7fac98101940 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 --2- 172.21.15.164:0/1349956025 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 0x7fac98100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 --2- 172.21.15.164:0/1349956025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981001c0 0x7fac981005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 -- 172.21.15.164:0/1349956025 >> 172.21.15.164:0/1349956025 conn(0x7fac980fbd80 msgr2=0x7fac980fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 -- 172.21.15.164:0/1349956025 shutdown_connections 2024-03-27T08:34:29.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.463+0000 7fac9e800640 1 -- 172.21.15.164:0/1349956025 wait complete. 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 Processor -- start 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 -- start start 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 0x7fac9819a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981014c0 0x7fac981a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fac9810f7c0 con 0x7fac981001c0 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac9810f640 con 0x7fac981014c0 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.464+0000 7fac9e800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fac9810f940 con 0x7fac98100b20 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44922/0 (socket says 172.21.15.164:44922) 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 -- 172.21.15.164:0/3571690742 learned_addr learned my addr 172.21.15.164:0/3571690742 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9de00640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981014c0 0x7fac981a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 0x7fac9819a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 -- 172.21.15.164:0/3571690742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 msgr2=0x7fac9819a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 0x7fac9819a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 -- 172.21.15.164:0/3571690742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981014c0 msgr2=0x7fac981a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981014c0 0x7fac981a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 -- 172.21.15.164:0/3571690742 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac981a19e0 con 0x7fac981001c0 2024-03-27T08:34:29.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.465+0000 7fac9d400640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00e9f0 tx=0x7fac8c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.466+0000 7fac96000640 1 -- 172.21.15.164:0/3571690742 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c00cd80 con 0x7fac981001c0 2024-03-27T08:34:29.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.466+0000 7fac96000640 1 -- 172.21.15.164:0/3571690742 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac8c010900 con 0x7fac981001c0 2024-03-27T08:34:29.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.466+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac981a1cd0 con 0x7fac981001c0 2024-03-27T08:34:29.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.466+0000 7fac96000640 1 -- 172.21.15.164:0/3571690742 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac8c0189e0 con 0x7fac981001c0 2024-03-27T08:34:29.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.466+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac981a21c0 con 0x7fac981001c0 2024-03-27T08:34:29.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.469+0000 7faca2a38740 1 Processor -- start 2024-03-27T08:34:29.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.469+0000 7fac96000640 1 -- 172.21.15.164:0/3571690742 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fac8c010ab0 con 0x7fac981001c0 2024-03-27T08:34:29.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.469+0000 7faca2a38740 1 -- start start 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 0x55edf54ba610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54bac80 0x55edf54bd110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edf5477920 con 0x55edf54b5120 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edf53c7fa0 con 0x55edf54b5b10 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7faca2a38740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edf5419f90 con 0x55edf54bac80 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44926/0 (socket says 172.21.15.164:44926) 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7fac9de00640 1 -- 172.21.15.164:0/3490591367 learned_addr learned my addr 172.21.15.164:0/3490591367 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54bac80 0x55edf54bd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.470+0000 7fac9d400640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 0x55edf54ba610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 -- 172.21.15.164:0/3490591367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54bac80 msgr2=0x55edf54bd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54bac80 0x55edf54bd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 -- 172.21.15.164:0/3490591367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 msgr2=0x55edf54ba610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 0x55edf54ba610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 -- 172.21.15.164:0/3490591367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf512e2d0 con 0x55edf54b5120 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9d400640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 0x55edf54ba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac96000640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 0x7fac800a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9de00640 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fac90009ca0 tx=0x7fac900323d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e66319ff4f08f44 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac96000640 1 -- 172.21.15.164:0/3571690742 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fac8c0d0160 con 0x7fac981001c0 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.471+0000 7fac9d400640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 0x7fac800a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7fac8a600640 1 -- 172.21.15.164:0/3490591367 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90044070 con 0x55edf54b5120 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7fac8a600640 1 -- 172.21.15.164:0/3490591367 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac90032ca0 con 0x55edf54b5120 2024-03-27T08:34:29.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7fac8a600640 1 -- 172.21.15.164:0/3490591367 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90039040 con 0x55edf54b5120 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7faca2a38740 1 -- 172.21.15.164:0/3490591367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 msgr2=0x55edf54b5540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7fac9d400640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 0x7fac800a5b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac8c09c2e0 tx=0x7fac8c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7faca2a38740 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fac90009ca0 tx=0x7fac900323d0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7faca2a38740 1 -- 172.21.15.164:0/3490591367 shutdown_connections 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.472+0000 7faca2a38740 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54bac80 0x55edf54bd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5b10 0x55edf54ba610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 --2- 172.21.15.164:0/3490591367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54b5540 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 -- 172.21.15.164:0/3490591367 >> 172.21.15.164:0/3490591367 conn(0x55edf54b0690 msgr2=0x55edf54b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 -- 172.21.15.164:0/3490591367 shutdown_connections 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 -- 172.21.15.164:0/3490591367 wait complete. 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 -- start start 2024-03-27T08:34:29.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.473+0000 7faca2a38740 1 Processor -- start 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5120 0x55edf54bf330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edf5415f40 con 0x55edf54bac80 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edf53c2650 con 0x55edf54b5120 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edf53d5a10 con 0x55edf54b5b10 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7faca2a38740 10 client.0 _ll_register_callbacks cb 0x55edf5414ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44940/0 (socket says 172.21.15.164:44940) 2024-03-27T08:34:29.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 -- 172.21.15.164:0/1005868244 learned_addr learned my addr 172.21.15.164:0/1005868244 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5120 0x55edf54bf330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9ca00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 -- 172.21.15.164:0/1005868244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 msgr2=0x55edf54bf870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54bf870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 -- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5120 msgr2=0x55edf54bf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5120 0x55edf54bf330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9de00640 1 -- 172.21.15.164:0/1005868244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf51f86b0 con 0x55edf54bac80 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.474+0000 7fac9ca00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7fac9de00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac90032460 tx=0x7fac900095e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79114832d6f2bc2c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7fac7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90044030 con 0x55edf54bac80 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fac90004140 con 0x55edf54bac80 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac90032ca0 con 0x55edf54bac80 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fac90058050 con 0x55edf54bac80 2024-03-27T08:34:29.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7faca2a38740 10 client.15087 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.475+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55edf54c9c20 con 0x55edf54bac80 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac90032ca0 con 0x55edf54bac80 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fac900498e0 con 0x55edf54bac80 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 10 client.15087 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 10 client.15087 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 20 client.15087 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf54cbee0 0x55edf54cd350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 4 client.15087 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.476+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edf54274d0 con 0x55edf54cbee0 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.477+0000 7fac9ca00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf54cbee0 0x55edf54cd350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.477+0000 7fac9ca00640 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf54cbee0 0x55edf54cd350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=1ef7ba6737ff39d6 server_cookie=8788e8923c998f1 in_seq=0 out_seq=0 2024-03-27T08:34:29.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.477+0000 7fac7ea00640 10 client.15087 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:34:29.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7fac7ea00640 1 -- 172.21.15.164:0/1005868244 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55edf54274d0 con 0x55edf54cbee0 2024-03-27T08:34:29.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7fac7ea00640 10 client.15087 handle_command_reply: tid=0 2024-03-27T08:34:29.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 client.15087 shutdown 2024-03-27T08:34:29.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 msgr2=0x55edf54c68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fac90032460 tx=0x7fac900095e0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 shutdown_connections 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf54cbee0 0x55edf54cd350 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54bac80 0x55edf54c68b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54bf870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 --2- 172.21.15.164:0/1005868244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54b5120 0x55edf54bf330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7fac7ea00640 0 client.15087 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.479+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 >> 172.21.15.164:0/1005868244 conn(0x55edf54b0690 msgr2=0x55edf54af890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.480+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 shutdown_connections 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.480+0000 7faca2a38740 1 -- 172.21.15.164:0/1005868244 wait complete. 2024-03-27T08:34:29.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.480+0000 7faca2a38740 20 client.15087 trim_cache size 0 max 16384 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.499+0000 7faca2a38740 1 Processor -- start 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.499+0000 7faca2a38740 1 -- start start 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5120 0x55edf54af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54af540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edf54cb690 con 0x55edf54b5b10 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edf54cbd60 con 0x55edf54bac80 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7faca2a38740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edf54cc430 con 0x55edf54b5120 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44942/0 (socket says 172.21.15.164:44942) 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 -- 172.21.15.164:0/3802126490 learned_addr learned my addr 172.21.15.164:0/3802126490 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9de00640 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54af540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 -- 172.21.15.164:0/3802126490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5120 msgr2=0x55edf54af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5120 0x55edf54af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 -- 172.21.15.164:0/3802126490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 msgr2=0x55edf54af540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54af540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9ca00640 1 -- 172.21.15.164:0/3802126490 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edf54ba2a0 con 0x55edf54b5b10 2024-03-27T08:34:29.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.500+0000 7fac9de00640 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.501+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55edf54cdec0 tx=0x7fac84005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb7e0a8a91d7af3a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.501+0000 7fac89c00640 1 -- 172.21.15.164:0/3802126490 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac84013cb0 con 0x55edf54b5b10 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.501+0000 7fac89c00640 1 -- 172.21.15.164:0/3802126490 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac84013e50 con 0x55edf54b5b10 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.501+0000 7fac89c00640 1 -- 172.21.15.164:0/3802126490 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac840103d0 con 0x55edf54b5b10 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- 172.21.15.164:0/3802126490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 msgr2=0x55edf54c67d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55edf54cdec0 tx=0x7fac84005f30 comp rx=0 tx=0).stop 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- 172.21.15.164:0/3802126490 shutdown_connections 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54af540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5b10 0x55edf54c67d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 --2- 172.21.15.164:0/3802126490 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5120 0x55edf54af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- 172.21.15.164:0/3802126490 >> 172.21.15.164:0/3802126490 conn(0x55edf54b0690 msgr2=0x55edf54b6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- 172.21.15.164:0/3802126490 shutdown_connections 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- 172.21.15.164:0/3802126490 wait complete. 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 -- start start 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.502+0000 7faca2a38740 1 Processor -- start 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54c2f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54c5f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edf54cd1d0 con 0x55edf54b5120 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edf54ccb00 con 0x55edf54bac80 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edf54cd8a0 con 0x55edf54b5b10 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7faca2a38740 10 client.0 _ll_register_callbacks cb 0x7fac8c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44944/0 (socket says 172.21.15.164:44944) 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 -- 172.21.15.164:0/3034470910 learned_addr learned my addr 172.21.15.164:0/3034470910 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 -- 172.21.15.164:0/3034470910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 msgr2=0x55edf54c2f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54c2f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 -- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 msgr2=0x55edf54c5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54c5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.503+0000 7fac9de00640 1 -- 172.21.15.164:0/3034470910 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edf54c6550 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac9de00640 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac90002230 tx=0x7fac90005dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c13c508dbb6551 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac90061070 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fac90032ca0 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac84013e50 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fac90039040 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7faca2a38740 10 client.15093 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55edf5532580 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.504+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac84013e50 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fac90064020 con 0x55edf54b5120 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 10 client.15093 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 10 client.15093 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 20 client.15093 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf5537170 0x55edf5535e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 4 client.15093 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:34:29.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "status"}) -- 0x55edf5421820 con 0x55edf5537170 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.505+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf5537170 0x55edf5535e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.506+0000 7fac9ca00640 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf5537170 0x55edf5535e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7294ba973a7b3412 server_cookie=28a6473fd686c3d9 in_seq=0 out_seq=0 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.506+0000 7fac7ea00640 10 client.15093 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7fac7ea00640 1 -- 172.21.15.164:0/3034470910 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55edf5421820 con 0x55edf5537170 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7fac7ea00640 10 client.15093 handle_command_reply: tid=0 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 client.15093 shutdown 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 msgr2=0x55edf54c2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fac90002230 tx=0x7fac90005dc0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 shutdown_connections 2024-03-27T08:34:29.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55edf5537170 0x55edf5535e80 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edf54bac80 0x55edf54c5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edf54b5b10 0x55edf54c2f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7fac7ea00640 0 client.15093 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 --2- 172.21.15.164:0/3034470910 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edf54b5120 0x55edf54c2a50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 >> 172.21.15.164:0/3034470910 conn(0x55edf54b0690 msgr2=0x55edf54b38f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 shutdown_connections 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 1 -- 172.21.15.164:0/3034470910 wait complete. 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.507+0000 7faca2a38740 20 client.15093 trim_cache size 0 max 16384 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:34:29.502 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 1, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34463, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 99.317212951000002, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 124.00358036199999 2024-03-27T08:34:29.503 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 msgr2=0x7fac800a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 0x7fac800a5b50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fac8c09c2e0 tx=0x7fac8c000bc0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 msgr2=0x7fac98199e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fac8c00e9f0 tx=0x7fac8c00eeb0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 shutdown_connections 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac800a3690 0x7fac800a5b50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac981014c0 0x7fac981a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac98100b20 0x7fac9819a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 --2- 172.21.15.164:0/3571690742 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac981001c0 0x7fac98199e10 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 >> 172.21.15.164:0/3571690742 conn(0x7fac980fbd80 msgr2=0x7fac980fd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 shutdown_connections 2024-03-27T08:34:29.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.508+0000 7fac9e800640 1 -- 172.21.15.164:0/3571690742 wait complete. 2024-03-27T08:34:29.513 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:29 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2803639462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:29.514 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:29 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/608962941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:29.516 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 -- 172.21.15.164:0/1954818886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 msgr2=0x7f0598105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 --2- 172.21.15.164:0/1954818886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f0598105400 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f0584009900 tx=0x7f058402bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 -- 172.21.15.164:0/1954818886 shutdown_connections 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 --2- 172.21.15.164:0/1954818886 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 0x7f059810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 --2- 172.21.15.164:0/1954818886 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f0598105400 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 --2- 172.21.15.164:0/1954818886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 0x7f05981041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 -- 172.21.15.164:0/1954818886 >> 172.21.15.164:0/1954818886 conn(0x7f05980ff340 msgr2=0x7f0598101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 -- 172.21.15.164:0/1954818886 shutdown_connections 2024-03-27T08:34:29.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.728+0000 7f059d000640 1 -- 172.21.15.164:0/1954818886 wait complete. 2024-03-27T08:34:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 Processor -- start 2024-03-27T08:34:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 -- start start 2024-03-27T08:34:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 0x7f059819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 0x7f05981a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f059810fa30 con 0x7f0598104f80 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f059810f8b0 con 0x7f0598103d90 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f059d000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f059810fbb0 con 0x7f0598105940 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f0595400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f0595400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44958/0 (socket says 172.21.15.164:44958) 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.729+0000 7f0595400640 1 -- 172.21.15.164:0/4127785612 learned_addr learned my addr 172.21.15.164:0/4127785612 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595e00640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 0x7f059819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0596800640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 0x7f05981a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 -- 172.21.15.164:0/4127785612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 msgr2=0x7f05981a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 0x7f05981a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 -- 172.21.15.164:0/4127785612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 msgr2=0x7f059819a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 0x7f059819a070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 -- 172.21.15.164:0/4127785612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05981a1c90 con 0x7f0598104f80 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f0595400640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0584000c00 tx=0x7f0584004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.723 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f058ea00640 1 -- 172.21.15.164:0/4127785612 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584043020 con 0x7f0598104f80 2024-03-27T08:34:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f058ea00640 1 -- 172.21.15.164:0/4127785612 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f05840054d0 con 0x7f0598104f80 2024-03-27T08:34:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f058ea00640 1 -- 172.21.15.164:0/4127785612 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0584003d40 con 0x7f0598104f80 2024-03-27T08:34:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.730+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05981a1f20 con 0x7f0598104f80 2024-03-27T08:34:29.724 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.731+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05981a2430 con 0x7f0598104f80 2024-03-27T08:34:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f058ea00640 1 -- 172.21.15.164:0/4127785612 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f0584046020 con 0x7f0598104f80 2024-03-27T08:34:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 Processor -- start 2024-03-27T08:34:29.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 -- start start 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb4d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 0x5585afb54f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5585afb0f920 con 0x5585afb4d910 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5585afa5ffa0 con 0x5585afb4cf20 2024-03-27T08:34:29.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f059fd8e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585afab1f90 con 0x5585afb52a80 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44972/0 (socket says 172.21.15.164:44972) 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.734+0000 7f0595e00640 1 -- 172.21.15.164:0/1739212002 learned_addr learned my addr 172.21.15.164:0/1739212002 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0596800640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595400640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 0x5585afb54f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 -- 172.21.15.164:0/1739212002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 msgr2=0x5585afb54f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 0x5585afb54f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 -- 172.21.15.164:0/1739212002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 msgr2=0x5585afb4d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb4d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 -- 172.21.15.164:0/1739212002 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585af7c62d0 con 0x5585afb4d910 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595400640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 0x5585afb54f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0595e00640 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f058800bc90 tx=0x7f058800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71bb885856fc6ffd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f058ea00640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 0x7f057c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0583400640 1 -- 172.21.15.164:0/1739212002 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588015070 con 0x5585afb4d910 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0583400640 1 -- 172.21.15.164:0/1739212002 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f05880035f0 con 0x5585afb4d910 2024-03-27T08:34:29.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.735+0000 7f0583400640 1 -- 172.21.15.164:0/1739212002 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588011640 con 0x5585afb4d910 2024-03-27T08:34:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f058ea00640 1 -- 172.21.15.164:0/4127785612 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f05840f2090 con 0x7f0598104f80 2024-03-27T08:34:29.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f0596800640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 0x7f057c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 -- 172.21.15.164:0/1739212002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 msgr2=0x5585afb52410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f058800bc90 tx=0x7f058800f730 comp rx=0 tx=0).stop 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f0596800640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 0x7f057c0a5b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5585afb4e170 tx=0x7f0590008370 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 -- 172.21.15.164:0/1739212002 shutdown_connections 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb52a80 0x5585afb54f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb52410 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1739212002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb4d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 -- 172.21.15.164:0/1739212002 >> 172.21.15.164:0/1739212002 conn(0x5585afb48490 msgr2=0x5585afb48890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 -- 172.21.15.164:0/1739212002 shutdown_connections 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.736+0000 7f059fd8e740 1 -- 172.21.15.164:0/1739212002 wait complete. 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 -- start start 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 Processor -- start 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 0x5585afb5e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5585afaadf40 con 0x5585afb4cf20 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5585afa5a650 con 0x5585afb52a80 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.737+0000 7f059fd8e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585afa6da10 con 0x5585afb4d910 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f059fd8e740 10 client.0 _ll_register_callbacks cb 0x5585afaacff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44988/0 (socket says 172.21.15.164:44988) 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 -- 172.21.15.164:0/1868016158 learned_addr learned my addr 172.21.15.164:0/1868016158 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0596800640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 0x5585afb5e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595400640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 -- 172.21.15.164:0/1868016158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 msgr2=0x5585afb576a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb576a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 -- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 msgr2=0x5585afb5e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 0x5585afb5e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 -- 172.21.15.164:0/1868016158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585af8906b0 con 0x5585afb4cf20 2024-03-27T08:34:29.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595400640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0596800640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 0x5585afb5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0595e00640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0588005fa0 tx=0x7f0588004250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba92218eb57fa6f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.738+0000 7f0577e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588015030 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f05880037a0 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f05880035f0 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f058800b880 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f059fd8e740 10 client.15105 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5585afb619c0 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f05880035f0 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f0588004a60 con 0x5585afb4cf20 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.739+0000 7f059fd8e740 10 client.15105 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f059fd8e740 10 client.15105 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T08:34:29.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f059fd8e740 20 client.15105 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb63df0 0x5585afb65260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f059fd8e740 4 client.15105 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5585afabf4d0 con 0x5585afb63df0 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.740+0000 7f0595400640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb63df0 0x5585afb65260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.741+0000 7f0595400640 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb63df0 0x5585afb65260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f00cbf6e69a8a9cf server_cookie=89b16aa116db8e52 in_seq=0 out_seq=0 2024-03-27T08:34:29.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.741+0000 7f0577e00640 10 client.15105 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.742+0000 7f0577e00640 1 -- 172.21.15.164:0/1868016158 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5585afabf4d0 con 0x5585afb63df0 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.742+0000 7f0577e00640 10 client.15105 handle_command_reply: tid=0 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.742+0000 7f059fd8e740 1 client.15105 shutdown 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 msgr2=0x5585afb57160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f0588005fa0 tx=0x7f0588004250 comp rx=0 tx=0).stop 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 shutdown_connections 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb63df0 0x5585afb65260 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb52a80 0x5585afb5e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb576a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1868016158 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4cf20 0x5585afb57160 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f0577e00640 0 client.15105 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:34:29.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 >> 172.21.15.164:0/1868016158 conn(0x5585afb48490 msgr2=0x5585afb47690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 shutdown_connections 2024-03-27T08:34:29.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 1 -- 172.21.15.164:0/1868016158 wait complete. 2024-03-27T08:34:29.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.743+0000 7f059fd8e740 20 client.15105 trim_cache size 0 max 16384 2024-03-27T08:34:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 Processor -- start 2024-03-27T08:34:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 -- start start 2024-03-27T08:34:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb62d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5585afb635a0 con 0x5585afb48490 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5585afb63c70 con 0x5585afb4cf20 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f059fd8e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585afb64340 con 0x5585afb4d910 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f0595e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44996/0 (socket says 172.21.15.164:44996) 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f0595e00640 1 -- 172.21.15.164:0/328761473 learned_addr learned my addr 172.21.15.164:0/328761473 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.763+0000 7f0595400640 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 -- 172.21.15.164:0/328761473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 msgr2=0x5585afb62d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb62d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 -- 172.21.15.164:0/328761473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 msgr2=0x5585afb5e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 -- 172.21.15.164:0/328761473 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585afb4dcf0 con 0x5585afb48490 2024-03-27T08:34:29.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0595e00640 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0588006010 tx=0x7f058800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f460afc69de92faf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0582a00640 1 -- 172.21.15.164:0/328761473 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588015030 con 0x5585afb48490 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0582a00640 1 -- 172.21.15.164:0/328761473 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f058802a030 con 0x5585afb48490 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.764+0000 7f0582a00640 1 -- 172.21.15.164:0/328761473 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0588004b20 con 0x5585afb48490 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- 172.21.15.164:0/328761473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 msgr2=0x5585afb52430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f0588006010 tx=0x7f058800f730 comp rx=0 tx=0).stop 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- 172.21.15.164:0/328761473 shutdown_connections 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb4d910 0x5585afb62d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 --2- 172.21.15.164:0/328761473 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb48490 0x5585afb52430 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- 172.21.15.164:0/328761473 >> 172.21.15.164:0/328761473 conn(0x5585afb4e6f0 msgr2=0x5585afb4bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- 172.21.15.164:0/328761473 shutdown_connections 2024-03-27T08:34:29.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- 172.21.15.164:0/328761473 wait complete. 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 -- start start 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.765+0000 7f059fd8e740 1 Processor -- start 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb48490 0x5585afb59d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5a240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5585afb650e0 con 0x5585afb4d910 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5585afb64a10 con 0x5585afb4cf20 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5585afb657b0 con 0x5585afb48490 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f059fd8e740 10 client.0 _ll_register_callbacks cb 0x7f058800bae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0595400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45010/0 (socket says 172.21.15.164:45010) 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 -- 172.21.15.164:0/1951224111 learned_addr learned my addr 172.21.15.164:0/1951224111 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0595e00640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb48490 0x5585afb59d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 -- 172.21.15.164:0/1951224111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb48490 msgr2=0x5585afb59d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb48490 0x5585afb59d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 -- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 msgr2=0x5585afb5a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5a240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.766+0000 7f0596800640 1 -- 172.21.15.164:0/1951224111 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5585afb5d850 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f0596800640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0590011e10 tx=0x7f0590004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8896ead6b603541 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f0577e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f059001e420 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f059001e5c0 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f058802a030 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f059001e7c0 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f059fd8e740 10 client.15111 fetch_fsmap learned FSMap version 23 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.767+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5585afbc9b60 con 0x5585afb4d910 2024-03-27T08:34:29.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f058802a030 con 0x5585afb4d910 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7f059001bad0 con 0x5585afb4d910 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 10 client.15111 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 20 client.15111 populate_metadata read hostname 'smithi164' 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb52a80 0x5585afbcd450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 4 client.15111 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "status"}) -- 0x5585afab9820 con 0x5585afb52a80 2024-03-27T08:34:29.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.768+0000 7f0595e00640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb52a80 0x5585afbcd450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f0595e00640 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb52a80 0x5585afbcd450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3f8d440028a2ae22 server_cookie=7eac10ff2a717289 in_seq=0 out_seq=0 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f0577e00640 10 client.15111 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f0577e00640 1 -- 172.21.15.164:0/1951224111 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x5585afab9820 con 0x5585afb52a80 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f0577e00640 10 client.15111 handle_command_reply: tid=0 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f059fd8e740 1 client.15111 shutdown 2024-03-27T08:34:29.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 msgr2=0x5585afb5d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.769+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0590011e10 tx=0x7f0590004ab0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 shutdown_connections 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5585afb52a80 0x5585afbcd450 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5585afb4d910 0x5585afb5d260 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5585afb4cf20 0x5585afb5a240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 --2- 172.21.15.164:0/1951224111 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5585afb48490 0x5585afb59d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f0577e00640 0 client.15111 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 >> 172.21.15.164:0/1951224111 conn(0x5585afb4e6f0 msgr2=0x5585afb48870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 shutdown_connections 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 1 -- 172.21.15.164:0/1951224111 wait complete. 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059fd8e740 20 client.15111 trim_cache size 0 max 16384 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:34:29.765 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 0, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34502, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 102.81631306, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 108.449416262 2024-03-27T08:34:29.766 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 msgr2=0x7f057c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 0x7f057c0a5b50 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x5585afb4e170 tx=0x7f0590008370 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 msgr2=0x7f059819a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.770+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f0584000c00 tx=0x7f0584004f10 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 shutdown_connections 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f057c0a3690 0x7f057c0a5b50 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0598105940 0x7f05981a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0598104f80 0x7f059819a5b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 --2- 172.21.15.164:0/4127785612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0598103d90 0x7f059819a070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:29.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 >> 172.21.15.164:0/4127785612 conn(0x7f05980ff340 msgr2=0x7f0598108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:29.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 shutdown_connections 2024-03-27T08:34:29.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:29.771+0000 7f059d000640 1 -- 172.21.15.164:0/4127785612 wait complete. 2024-03-27T08:34:29.780 INFO:tasks.cephadm:Setup complete, yielding 2024-03-27T08:34:29.780 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-27T08:34:29.789 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:34:29.790 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph orch status' 2024-03-27T08:34:29.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:29 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2803639462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:29.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:29 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/608962941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:29.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:29 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2803639462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:29.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:29 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/608962941' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:30.210 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:30.611 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:30 smithi164 ceph-mon[31788]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:30.726 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:30 smithi173 ceph-mon[35397]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:30 smithi167 ceph-mon[34903]: pgmap v416: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:34:32.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 -- 172.21.15.164:0/3396928533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10108360 msgr2=0x7f8e1010a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 --2- 172.21.15.164:0/3396928533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10108360 0x7f8e1010a7d0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f8e08009990 tx=0x7f8e08009ca0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 -- 172.21.15.164:0/3396928533 shutdown_connections 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 --2- 172.21.15.164:0/3396928533 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10108360 0x7f8e1010a7d0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 --2- 172.21.15.164:0/3396928533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 0x7f8e101054f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 --2- 172.21.15.164:0/3396928533 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10105a30 0x7f8e10107e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 -- 172.21.15.164:0/3396928533 >> 172.21.15.164:0/3396928533 conn(0x7f8e100fcb10 msgr2=0x7f8e100fef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 -- 172.21.15.164:0/3396928533 shutdown_connections 2024-03-27T08:34:32.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.502+0000 7f8e16800700 1 -- 172.21.15.164:0/3396928533 wait complete. 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.503+0000 7f8e16800700 1 Processor -- start 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.503+0000 7f8e16800700 1 -- start start 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 0x7f8e10102a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10108360 0x7f8e101015f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010e280 con 0x7f8e10105a30 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010e100 con 0x7f8e10103100 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e16800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010e400 con 0x7f8e10108360 2024-03-27T08:34:32.497 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e06a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e06a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45022/0 (socket says 172.21.15.164:45022) 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e06a00700 1 -- 172.21.15.164:0/1253491991 learned_addr learned my addr 172.21.15.164:0/1253491991 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e0f400700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 0x7f8e10102a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.504+0000 7f8e0fe00700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10108360 0x7f8e101015f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 -- 172.21.15.164:0/1253491991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10108360 msgr2=0x7f8e101015f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10108360 0x7f8e101015f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 -- 172.21.15.164:0/1253491991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 msgr2=0x7f8e10102a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 0x7f8e10102a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 -- 172.21.15.164:0/1253491991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e10101ea0 con 0x7f8e10105a30 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e06a00700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8df800d980 tx=0x7f8df800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8017070 con 0x7f8e10105a30 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8df8005020 con 0x7f8e10105a30 2024-03-27T08:34:32.498 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e101a2a80 con 0x7f8e10105a30 2024-03-27T08:34:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df8009bd0 con 0x7f8e10105a30 2024-03-27T08:34:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.505+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e101a2f40 con 0x7f8e10105a30 2024-03-27T08:34:32.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.507+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1002dd30 con 0x7f8e10105a30 2024-03-27T08:34:32.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.509+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8df80051d0 con 0x7f8e10105a30 2024-03-27T08:34:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.510+0000 7f8e0cc00700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 0x7f8df40a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.510+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8df80cfc20 con 0x7f8e10105a30 2024-03-27T08:34:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.510+0000 7f8e0f400700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 0x7f8df40a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:32.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.511+0000 7f8e0f400700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 0x7f8df40a5b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009550 tx=0x7f8e000091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:32.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.515+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8df8020020 con 0x7f8e10105a30 2024-03-27T08:34:32.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.760+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f8e10062a80 con 0x7f8df40a36a0 2024-03-27T08:34:32.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:32 smithi164 ceph-mon[31788]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:32.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.764+0000 7f8e0cc00700 1 -- 172.21.15.164:0/1253491991 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f8e10062a80 con 0x7f8df40a36a0 2024-03-27T08:34:32.756 INFO:teuthology.orchestra.run.smithi164.stdout:Backend: cephadm 2024-03-27T08:34:32.756 INFO:teuthology.orchestra.run.smithi164.stdout:Available: Yes 2024-03-27T08:34:32.756 INFO:teuthology.orchestra.run.smithi164.stdout:Paused: No 2024-03-27T08:34:32.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 msgr2=0x7f8df40a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:32.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 0x7f8df40a5b60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8e00009550 tx=0x7f8e000091b0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 msgr2=0x7f8e101010b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:32.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f8df800d980 tx=0x7f8df800dc90 comp rx=0 tx=0).stop 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 shutdown_connections 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8df40a36a0 0x7f8df40a5b60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e10108360 0x7f8e101015f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e10103100 0x7f8e10102a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 --2- 172.21.15.164:0/1253491991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e10105a30 0x7f8e101010b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 >> 172.21.15.164:0/1253491991 conn(0x7f8e100fcb10 msgr2=0x7f8e10103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 shutdown_connections 2024-03-27T08:34:32.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:32.767+0000 7f8e16800700 1 -- 172.21.15.164:0/1253491991 wait complete. 2024-03-27T08:34:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:32 smithi167 ceph-mon[34903]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:32 smithi173 ceph-mon[35397]: pgmap v417: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:33.576 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-27T08:34:34.045 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:34.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:34 smithi164 ceph-mon[31788]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:34.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:34 smithi164 ceph-mon[31788]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:34 smithi167 ceph-mon[34903]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:34 smithi167 ceph-mon[34903]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:34 smithi173 ceph-mon[35397]: from='client.15117 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:34 smithi173 ceph-mon[35397]: pgmap v418: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:34:36.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.209+0000 7f4ad8400700 1 -- 172.21.15.164:0/3335519654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0102680 msgr2=0x7f4ad0102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:36.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.209+0000 7f4ad8400700 1 --2- 172.21.15.164:0/3335519654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0102680 0x7f4ad0102aa0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4ac40099c0 tx=0x7f4ac4009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 -- 172.21.15.164:0/3335519654 shutdown_connections 2024-03-27T08:34:36.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 --2- 172.21.15.164:0/3335519654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0104220 0x7f4ad010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 --2- 172.21.15.164:0/3335519654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0102680 0x7f4ad0102aa0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 --2- 172.21.15.164:0/3335519654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0103880 0x7f4ad0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 -- 172.21.15.164:0/3335519654 >> 172.21.15.164:0/3335519654 conn(0x7f4ad00fdbe0 msgr2=0x7f4ad0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:36.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 -- 172.21.15.164:0/3335519654 shutdown_connections 2024-03-27T08:34:36.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.210+0000 7f4ad8400700 1 -- 172.21.15.164:0/3335519654 wait complete. 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.211+0000 7f4ad8400700 1 Processor -- start 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.211+0000 7f4ad8400700 1 -- start start 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0102680 0x7f4ad019aa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 0x7f4ad01a2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:36.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad010e200 con 0x7f4ad0103880 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad010e080 con 0x7f4ad0104220 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad8400700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4ad010e380 con 0x7f4ad0102680 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad5000700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56876/0 (socket says 172.21.15.164:56876) 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad5000700 1 -- 172.21.15.164:0/1774067298 learned_addr learned my addr 172.21.15.164:0/1774067298 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad5a00700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0102680 0x7f4ad019aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.212+0000 7f4ad6400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 0x7f4ad01a2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 -- 172.21.15.164:0/1774067298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0102680 msgr2=0x7f4ad019aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0102680 0x7f4ad019aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 -- 172.21.15.164:0/1774067298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 msgr2=0x7f4ad01a2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 0x7f4ad01a2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 -- 172.21.15.164:0/1774067298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ad01a26f0 con 0x7f4ad0103880 2024-03-27T08:34:36.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad6400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 0x7f4ad01a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad5000700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00d9b0 tx=0x7f4abc00dd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc016070 con 0x7f4ad0103880 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4abc0044f0 con 0x7f4ad0103880 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ad01a29e0 con 0x7f4ad0103880 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4abc004cc0 con 0x7f4ad0103880 2024-03-27T08:34:36.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.213+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ad01a2f70 con 0x7f4ad0103880 2024-03-27T08:34:36.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.215+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ad0069300 con 0x7f4ad0103880 2024-03-27T08:34:36.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.217+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4abc00bbf0 con 0x7f4ad0103880 2024-03-27T08:34:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.218+0000 7f4ace000700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 0x7f4ab80a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.218+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4abc0cfb70 con 0x7f4ad0103880 2024-03-27T08:34:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.218+0000 7f4ad5a00700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 0x7f4ab80a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:36.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.219+0000 7f4ad5a00700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 0x7f4ab80a5be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4003900 tx=0x7f4ac4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:36.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.223+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4abc01f020 con 0x7f4ad0103880 2024-03-27T08:34:36.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.459+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f4ad0075f90 con 0x7f4ab80a3720 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.477+0000 7f4ace000700 1 -- 172.21.15.164:0/1774067298 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4185 (secure 0 0 0) 0x7f4ad0075f90 con 0x7f4ab80a3720 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:mds.a smithi164 running (119s) 21s ago 119s 12.3M - 19.0.0-2478-g155268c4 b379bbd8da6b a3d429724027 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:mds.b smithi167 running (115s) 43s ago 115s 24.9M - 19.0.0-2478-g155268c4 b379bbd8da6b ed860cc475c3 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:mds.c smithi173 running (2m) 44s ago 2m 15.4M - 19.0.0-2478-g155268c4 b379bbd8da6b 2c5dd4b9c89a 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:mds.d smithi164 running (2m) 21s ago 2m 12.5M - 19.0.0-2478-g155268c4 b379bbd8da6b fc4886783470 2024-03-27T08:34:36.469 INFO:teuthology.orchestra.run.smithi164.stdout:mds.e smithi167 running (2m) 43s ago 2m 16.5M - 19.0.0-2478-g155268c4 b379bbd8da6b d8b0669bc4d1 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.f smithi173 running (2m) 44s ago 2m 12.3M - 19.0.0-2478-g155268c4 b379bbd8da6b 4970fb72a7d4 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.g smithi164 running (2m) 21s ago 2m 12.4M - 19.0.0-2478-g155268c4 b379bbd8da6b af77e2a42797 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.h smithi167 running (2m) 43s ago 2m 16.5M - 19.0.0-2478-g155268c4 b379bbd8da6b 7e95fbb8f20a 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.i smithi173 running (2m) 44s ago 2m 15.5M - 19.0.0-2478-g155268c4 b379bbd8da6b 09f51c7aa57c 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.j smithi164 running (2m) 21s ago 2m 12.5M - 19.0.0-2478-g155268c4 b379bbd8da6b 51d0a7d6c2e2 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.k smithi167 running (2m) 43s ago 2m 16.9M - 19.0.0-2478-g155268c4 b379bbd8da6b dd3cffe24a53 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mds.l smithi173 running (2m) 44s ago 2m 12.4M - 19.0.0-2478-g155268c4 b379bbd8da6b 2c1d09be8df0 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mgr.x smithi164 *:9283,8765 running (12m) 21s ago 12m 514M - 19.0.0-2478-g155268c4 b379bbd8da6b 972155b18fc2 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mgr.y smithi167 *:8443,8765 running (9m) 43s ago 9m 452M - 19.0.0-2478-g155268c4 b379bbd8da6b 366f3fad6f5d 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mgr.z smithi173 *:8443,8765 running (9m) 44s ago 9m 451M - 19.0.0-2478-g155268c4 b379bbd8da6b 7c90d10337de 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mon.a smithi164 running (12m) 21s ago 12m 49.4M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 34f399d1d9b8 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mon.b smithi167 running (10m) 43s ago 10m 39.6M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 9da23267b64f 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:mon.c smithi173 running (10m) 44s ago 10m 38.6M 2048M 19.0.0-2478-g155268c4 b379bbd8da6b 3ece645cc3d4 2024-03-27T08:34:36.470 INFO:teuthology.orchestra.run.smithi164.stdout:osd.0 smithi164 running (9m) 21s ago 9m 53.5M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 232404ccaf0c 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.1 smithi167 running (8m) 43s ago 8m 56.0M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 396ce6346d2a 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.2 smithi173 running (8m) 44s ago 8m 49.1M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b e1de87b41e37 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.3 smithi164 running (7m) 21s ago 7m 54.0M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b a86ce28a7235 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.4 smithi167 running (7m) 43s ago 7m 44.2M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b fc99783e6032 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.5 smithi173 running (6m) 44s ago 6m 45.4M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b afefa272e148 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.6 smithi164 running (5m) 21s ago 5m 44.2M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b e45734974849 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.7 smithi167 running (5m) 43s ago 5m 52.9M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 17f12fb77c31 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.8 smithi173 running (4m) 44s ago 4m 44.9M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b ab82538cca8a 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.9 smithi164 running (4m) 21s ago 4m 46.3M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b a1230e33d1de 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.10 smithi167 running (3m) 43s ago 3m 45.7M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b 4880c0963c16 2024-03-27T08:34:36.471 INFO:teuthology.orchestra.run.smithi164.stdout:osd.11 smithi173 running (3m) 44s ago 3m 43.2M 4272M 19.0.0-2478-g155268c4 b379bbd8da6b b39e8807733c 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 msgr2=0x7f4ab80a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 0x7f4ab80a5be0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f4ac4003900 tx=0x7f4ac4005fb0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 msgr2=0x7f4ad019afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4abc00d9b0 tx=0x7f4abc00dd70 comp rx=0 tx=0).stop 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 shutdown_connections 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4ab80a3720 0x7f4ab80a5be0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ad0104220 0x7f4ad01a2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4ad0102680 0x7f4ad019aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 --2- 172.21.15.164:0/1774067298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4ad0103880 0x7f4ad019afd0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:36.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 >> 172.21.15.164:0/1774067298 conn(0x7f4ad00fdbe0 msgr2=0x7f4ad0074870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:36.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 shutdown_connections 2024-03-27T08:34:36.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:36.480+0000 7f4ad8400700 1 -- 172.21.15.164:0/1774067298 wait complete. 2024-03-27T08:34:36.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:36 smithi164 ceph-mon[31788]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:36 smithi167 ceph-mon[34903]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:36 smithi173 ceph-mon[35397]: pgmap v419: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:37.299 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-27T08:34:37.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:37 smithi164 ceph-mon[31788]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:37.764 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:37.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:37 smithi167 ceph-mon[34903]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:37.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:37 smithi173 ceph-mon[35397]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:38 smithi164 ceph-mon[31788]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:38.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:38 smithi167 ceph-mon[34903]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:38 smithi173 ceph-mon[35397]: pgmap v420: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 -- 172.21.15.164:0/929907768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c075060 msgr2=0x7f797c0754c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 --2- 172.21.15.164:0/929907768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c075060 0x7f797c0754c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f7968009990 tx=0x7f7968009ca0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 -- 172.21.15.164:0/929907768 shutdown_connections 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 --2- 172.21.15.164:0/929907768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c10a580 0x7f797c10ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 --2- 172.21.15.164:0/929907768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 0x7f797c074a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 --2- 172.21.15.164:0/929907768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c075060 0x7f797c0754c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 -- 172.21.15.164:0/929907768 >> 172.21.15.164:0/929907768 conn(0x7f797c0fdc60 msgr2=0x7f797c1000a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 -- 172.21.15.164:0/929907768 shutdown_connections 2024-03-27T08:34:40.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.022+0000 7f7983800700 1 -- 172.21.15.164:0/929907768 wait complete. 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 Processor -- start 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 -- start start 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c075060 0x7f797c19aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 0x7f797c19af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:40.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f797c1104b0 con 0x7f797c10a580 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f797c110330 con 0x7f797c076630 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.024+0000 7f7983800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f797c110630 con 0x7f797c075060 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f797be00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 0x7f797c19af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56900/0 (socket says 172.21.15.164:56900) 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 -- 172.21.15.164:0/2876867166 learned_addr learned my addr 172.21.15.164:0/2876867166 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7980e00700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c075060 0x7f797c19aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 -- 172.21.15.164:0/2876867166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c075060 msgr2=0x7f797c19aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c075060 0x7f797c19aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 -- 172.21.15.164:0/2876867166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 msgr2=0x7f797c19af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 0x7f797c19af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.025+0000 7f7981800700 1 -- 172.21.15.164:0/2876867166 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797c1a2690 con 0x7f797c10a580 2024-03-27T08:34:40.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7981800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f797400c930 tx=0x7f797400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:40.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79740078d0 con 0x7f797c10a580 2024-03-27T08:34:40.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f797c1a2980 con 0x7f797c10a580 2024-03-27T08:34:40.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f797400f450 con 0x7f797c10a580 2024-03-27T08:34:40.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7974018660 con 0x7f797c10a580 2024-03-27T08:34:40.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.026+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f797c1a2ec0 con 0x7f797c10a580 2024-03-27T08:34:40.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.027+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f797c069300 con 0x7f797c10a580 2024-03-27T08:34:40.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.029+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f797400fa20 con 0x7f797c10a580 2024-03-27T08:34:40.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.032+0000 7f7979600700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 0x7f79640a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:40.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.032+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f79740cfb50 con 0x7f797c10a580 2024-03-27T08:34:40.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.032+0000 7f7980e00700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 0x7f79640a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:40.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.032+0000 7f7980e00700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 0x7f79640a5b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7970009550 tx=0x7f79700091b0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:40.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.035+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7974014030 con 0x7f797c10a580 2024-03-27T08:34:40.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.268+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f797c062a80 con 0x7f79640a36a0 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.277+0000 7f7979600700 1 -- 172.21.15.164:0/2876867166 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f797c062a80 con 0x7f79640a36a0 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stdout:mds.all 12/12 47s ago 2m smithi164=a;smithi164=d;smithi164=g;smithi164=j;smithi167=b;smithi167=e;smithi167=h;smithi167=k;smithi173=c;smithi173=f;smithi173=i;smithi173=l;count:12 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stdout:mgr 3/3 47s ago 9m smithi164=x;smithi167=y;smithi173=z;count:3 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stdout:mon 3/3 47s ago 10m smithi164:172.21.15.164=a;smithi167:172.21.15.167=b;smithi173:172.21.15.173=c;count:3 2024-03-27T08:34:40.269 INFO:teuthology.orchestra.run.smithi164.stdout:osd 12 47s ago - 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 msgr2=0x7f79640a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 0x7f79640a5b60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f7970009550 tx=0x7f79700091b0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 msgr2=0x7f797c1a1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f797400c930 tx=0x7f797400cc40 comp rx=0 tx=0).stop 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 shutdown_connections 2024-03-27T08:34:40.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79640a36a0 0x7f79640a5b60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f797c10a580 0x7f797c1a1ff0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f797c075060 0x7f797c19aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 --2- 172.21.15.164:0/2876867166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f797c076630 0x7f797c19af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 >> 172.21.15.164:0/2876867166 conn(0x7f797c0fdc60 msgr2=0x7f797c1064d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 shutdown_connections 2024-03-27T08:34:40.273 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:40.280+0000 7f7983800700 1 -- 172.21.15.164:0/2876867166 wait complete. 2024-03-27T08:34:40.661 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:40 smithi164 ceph-mon[31788]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:40.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:40 smithi167 ceph-mon[34903]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:40 smithi173 ceph-mon[35397]: pgmap v421: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:41.119 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-27T08:34:41.595 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:41.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:41 smithi167 ceph-mon[34903]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:41.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:41 smithi173 ceph-mon[35397]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:41.889 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:41 smithi164 ceph-mon[31788]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:42.768 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:42 smithi164 ceph-mon[31788]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:42 smithi167 ceph-mon[34903]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:42 smithi173 ceph-mon[35397]: pgmap v422: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:43.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 -- 172.21.15.164:0/2970419099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a98105ab0 msgr2=0x7f8a98105f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 --2- 172.21.15.164:0/2970419099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a98105ab0 0x7f8a98105f10 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f8a840099c0 tx=0x7f8a84009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 -- 172.21.15.164:0/2970419099 shutdown_connections 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 --2- 172.21.15.164:0/2970419099 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98106450 0x7f8a9810cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 --2- 172.21.15.164:0/2970419099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a981048b0 0x7f8a98104cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 --2- 172.21.15.164:0/2970419099 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a98105ab0 0x7f8a98105f10 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 -- 172.21.15.164:0/2970419099 >> 172.21.15.164:0/2970419099 conn(0x7f8a980ffe50 msgr2=0x7f8a98102290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 -- 172.21.15.164:0/2970419099 shutdown_connections 2024-03-27T08:34:43.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.763+0000 7f8a9f800700 1 -- 172.21.15.164:0/2970419099 wait complete. 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.764+0000 7f8a9f800700 1 Processor -- start 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.764+0000 7f8a9f800700 1 -- start start 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98105ab0 0x7f8a9819afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a98106450 0x7f8a981a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a98110460 con 0x7f8a981048b0 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981102e0 con 0x7f8a98106450 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9f800700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8a981105e0 con 0x7f8a98105ab0 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9ce00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56912/0 (socket says 172.21.15.164:56912) 2024-03-27T08:34:43.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9ce00700 1 -- 172.21.15.164:0/1713954122 learned_addr learned my addr 172.21.15.164:0/1713954122 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a9d800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a98106450 0x7f8a981a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.765+0000 7f8a97e00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98105ab0 0x7f8a9819afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 -- 172.21.15.164:0/1713954122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98105ab0 msgr2=0x7f8a9819afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98105ab0 0x7f8a9819afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 -- 172.21.15.164:0/1713954122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a98106450 msgr2=0x7f8a981a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a98106450 0x7f8a981a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 -- 172.21.15.164:0/1713954122 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a981a26d0 con 0x7f8a981048b0 2024-03-27T08:34:43.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9ce00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00d9b0 tx=0x7f8a8c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c017030 con 0x7f8a981048b0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a981a29c0 con 0x7f8a981048b0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a8c0044f0 con 0x7f8a981048b0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.766+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a8c0039e0 con 0x7f8a981048b0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.767+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a981a2f50 con 0x7f8a981048b0 2024-03-27T08:34:43.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.768+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a98069300 con 0x7f8a981048b0 2024-03-27T08:34:43.761 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.770+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8a8c01a070 con 0x7f8a981048b0 2024-03-27T08:34:43.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.771+0000 7f8a95600700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 0x7f8a800a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:43.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.771+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8a8c0cf670 con 0x7f8a981048b0 2024-03-27T08:34:43.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.771+0000 7f8a97e00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 0x7f8a800a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:43.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.772+0000 7f8a97e00700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 0x7f8a800a5be0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:43.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:43.776+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8a8c09c1f0 con 0x7f8a981048b0 2024-03-27T08:34:43.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.004+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f8a98062a80 con 0x7f8a800a3720 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.008+0000 7f8a95600700 1 -- 172.21.15.164:0/1713954122 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f8a98062a80 con 0x7f8a800a3720 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stdout:HOST ADDR LABELS STATUS 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164 172.21.15.164 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stdout:smithi167 172.21.15.167 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stdout:smithi173 172.21.15.173 2024-03-27T08:34:44.000 INFO:teuthology.orchestra.run.smithi164.stdout:3 hosts in cluster 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 msgr2=0x7f8a800a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 0x7f8a800a5be0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8a84000c00 tx=0x7f8a84005fb0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 msgr2=0x7f8a9819aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8a8c00d9b0 tx=0x7f8a8c00dcc0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 shutdown_connections 2024-03-27T08:34:44.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a800a3720 0x7f8a800a5be0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a98106450 0x7f8a981a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a981048b0 0x7f8a9819aa70 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 --2- 172.21.15.164:0/1713954122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a98105ab0 0x7f8a9819afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 >> 172.21.15.164:0/1713954122 conn(0x7f8a980ffe50 msgr2=0x7f8a98108db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 shutdown_connections 2024-03-27T08:34:44.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:44.011+0000 7f8a9f800700 1 -- 172.21.15.164:0/1713954122 wait complete. 2024-03-27T08:34:44.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:44 smithi164 ceph-mon[31788]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:44 smithi167 ceph-mon[34903]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:44 smithi173 ceph-mon[35397]: pgmap v423: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:44.833 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-27T08:34:45.292 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:45.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:45 smithi164 ceph-mon[31788]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:45.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:45 smithi167 ceph-mon[34903]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:45.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:45 smithi173 ceph-mon[35397]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:46.679 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:46 smithi164 ceph-mon[31788]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:46.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:46 smithi167 ceph-mon[34903]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:46 smithi173 ceph-mon[35397]: pgmap v424: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.511+0000 7fcad2a00700 1 -- 172.21.15.164:0/3851167072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc109ec0 msgr2=0x7fcacc10a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.511+0000 7fcad2a00700 1 --2- 172.21.15.164:0/3851167072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc109ec0 0x7fcacc10a320 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fcab80099c0 tx=0x7fcab8009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 -- 172.21.15.164:0/3851167072 shutdown_connections 2024-03-27T08:34:47.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 --2- 172.21.15.164:0/3851167072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc10a860 0x7fcacc111110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 --2- 172.21.15.164:0/3851167072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc108cc0 0x7fcacc1090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 --2- 172.21.15.164:0/3851167072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc109ec0 0x7fcacc10a320 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 -- 172.21.15.164:0/3851167072 >> 172.21.15.164:0/3851167072 conn(0x7fcacc077c90 msgr2=0x7fcacc07a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 -- 172.21.15.164:0/3851167072 shutdown_connections 2024-03-27T08:34:47.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.512+0000 7fcad2a00700 1 -- 172.21.15.164:0/3851167072 wait complete. 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 Processor -- start 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 -- start start 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc108cc0 0x7fcacc19ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 0x7fcacc19f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc1148a0 con 0x7fcacc10a860 2024-03-27T08:34:47.508 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc114720 con 0x7fcacc109ec0 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.513+0000 7fcad2a00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcacc114a20 con 0x7fcacc108cc0 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34078/0 (socket says 172.21.15.164:34078) 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 -- 172.21.15.164:0/2144577600 learned_addr learned my addr 172.21.15.164:0/2144577600 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcacbe00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc108cc0 0x7fcacc19ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcacb400700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 0x7fcacc19f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 -- 172.21.15.164:0/2144577600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc108cc0 msgr2=0x7fcacc19ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc108cc0 0x7fcacc19ee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 -- 172.21.15.164:0/2144577600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 msgr2=0x7fcacc19f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 0x7fcacc19f3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 -- 172.21.15.164:0/2144577600 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcacc1a6ae0 con 0x7fcacc10a860 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcacb400700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 0x7fcacc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:47.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.514+0000 7fcad0a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcac4007f10 tx=0x7fcac400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.515+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac4004bb0 con 0x7fcacc10a860 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.515+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcac4004d50 con 0x7fcacc10a860 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.515+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcacc1a6dd0 con 0x7fcacc10a860 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.515+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcac40133f0 con 0x7fcacc10a860 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.515+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcacc1a7280 con 0x7fcacc10a860 2024-03-27T08:34:47.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.516+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcacc069300 con 0x7fcacc10a860 2024-03-27T08:34:47.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.518+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fcac401a020 con 0x7fcacc10a860 2024-03-27T08:34:47.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.519+0000 7fcac8c00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 0x7fcab00a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:47.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.519+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fcac40cfaf0 con 0x7fcacc10a860 2024-03-27T08:34:47.512 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.520+0000 7fcacbe00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 0x7fcab00a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:47.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.520+0000 7fcacbe00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 0x7fcab00a5be0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcacc109d20 tx=0x7fcabc00b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:47.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.522+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcac4010070 con 0x7fcacc10a860 2024-03-27T08:34:47.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.758+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fcacc062a80 con 0x7fcab00a3720 2024-03-27T08:34:47.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.762+0000 7fcac8c00700 1 -- 172.21.15.164:0/2144577600 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fcacc062a80 con 0x7fcab00a3720 2024-03-27T08:34:47.755 INFO:teuthology.orchestra.run.smithi164.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-27T08:34:47.755 INFO:teuthology.orchestra.run.smithi164.stdout:smithi164 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300H0400BGN 372G No 4m ago Has a FileSystem, LVM detected 2024-03-27T08:34:47.755 INFO:teuthology.orchestra.run.smithi164.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-27T08:34:47.755 INFO:teuthology.orchestra.run.smithi164.stdout:smithi173 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204019S400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-03-27T08:34:47.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 msgr2=0x7fcab00a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:47.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 0x7fcab00a5be0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcacc109d20 tx=0x7fcabc00b410 comp rx=0 tx=0).stop 2024-03-27T08:34:47.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 msgr2=0x7fcacc1a6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fcac4007f10 tx=0x7fcac400d3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 shutdown_connections 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcab00a3720 0x7fcab00a5be0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcacc10a860 0x7fcacc1a6440 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcacc108cc0 0x7fcacc19ee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 --2- 172.21.15.164:0/2144577600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcacc109ec0 0x7fcacc19f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.765+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 >> 172.21.15.164:0/2144577600 conn(0x7fcacc077c90 msgr2=0x7fcacc10d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.766+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 shutdown_connections 2024-03-27T08:34:47.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:47.766+0000 7fcad2a00700 1 -- 172.21.15.164:0/2144577600 wait complete. 2024-03-27T08:34:48.572 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-27T08:34:48.581 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:34:48.581 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-27T08:34:48.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:48 smithi164 ceph-mon[31788]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:48.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:48 smithi167 ceph-mon[34903]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:48.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:48 smithi173 ceph-mon[35397]: pgmap v425: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:49.076 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:49.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:49 smithi167 ceph-mon[34903]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:49.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:49 smithi173 ceph-mon[35397]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:49.997 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:49 smithi164 ceph-mon[31788]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-27T08:34:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:50 smithi167 ceph-mon[34903]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:50 smithi173 ceph-mon[35397]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:50.853 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:50 smithi164 ceph-mon[31788]: pgmap v426: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:34:51.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 -- 172.21.15.164:0/3940298166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0102680 msgr2=0x7f0df0102aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:51.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 --2- 172.21.15.164:0/3940298166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0102680 0x7f0df0102aa0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f0de00099c0 tx=0x7f0de0009cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 -- 172.21.15.164:0/3940298166 shutdown_connections 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 --2- 172.21.15.164:0/3940298166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0104220 0x7f0df010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 --2- 172.21.15.164:0/3940298166 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0102680 0x7f0df0102aa0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 --2- 172.21.15.164:0/3940298166 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 0x7f0df0103ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 -- 172.21.15.164:0/3940298166 >> 172.21.15.164:0/3940298166 conn(0x7f0df00fdbe0 msgr2=0x7f0df0100060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 -- 172.21.15.164:0/3940298166 shutdown_connections 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.177+0000 7f0df5e00700 1 -- 172.21.15.164:0/3940298166 wait complete. 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 Processor -- start 2024-03-27T08:34:51.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 -- start start 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0102680 0x7f0df0076390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 0x7f0df0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0df010e230 con 0x7f0df0104220 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0df010e0b0 con 0x7f0df0102680 2024-03-27T08:34:51.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.179+0000 7f0df5e00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0df010e3b0 con 0x7f0df0103880 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0deea00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0102680 0x7f0df0076390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34096/0 (socket says 172.21.15.164:34096) 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 -- 172.21.15.164:0/424481623 learned_addr learned my addr 172.21.15.164:0/424481623 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0dee000700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 0x7f0df0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 -- 172.21.15.164:0/424481623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 msgr2=0x7f0df0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 0x7f0df0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 -- 172.21.15.164:0/424481623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0102680 msgr2=0x7f0df0076390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0102680 0x7f0df0076390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 -- 172.21.15.164:0/424481623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df0075840 con 0x7f0df0104220 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.180+0000 7f0def400700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0de8007ee0 tx=0x7f0de800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.181+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8004bb0 con 0x7f0df0104220 2024-03-27T08:34:51.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.181+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0de8004d50 con 0x7f0df0104220 2024-03-27T08:34:51.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.181+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de8005a00 con 0x7f0df0104220 2024-03-27T08:34:51.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.181+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0df01a2a60 con 0x7f0df0104220 2024-03-27T08:34:51.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.181+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0df01a2f70 con 0x7f0df0104220 2024-03-27T08:34:51.176 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.182+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0df0069300 con 0x7f0df0104220 2024-03-27T08:34:51.177 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.184+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f0de801a020 con 0x7f0df0104220 2024-03-27T08:34:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.185+0000 7f0df4a00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 0x7f0dd40a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:51.178 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.186+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0de80cf3a0 con 0x7f0df0104220 2024-03-27T08:34:51.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.186+0000 7f0deea00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 0x7f0dd40a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:51.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.186+0000 7f0deea00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 0x7f0dd40a5be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b580 tx=0x7f0de0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:51.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.190+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0de8010070 con 0x7f0df0104220 2024-03-27T08:34:51.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.463+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0df0063250 con 0x7f0df0104220 2024-03-27T08:34:51.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.464+0000 7f0df4a00700 1 -- 172.21.15.164:0/424481623 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3061 (secure 0 0 0) 0x7f0de809bf20 con 0x7f0df0104220 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:e23 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:legacy client fscid: 1 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:Filesystem 'cephfs' (1) 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:fs_name cephfs 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:epoch 23 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:created 2024-03-27T08:32:46.030344+0000 2024-03-27T08:34:51.459 INFO:teuthology.orchestra.run.smithi164.stdout:modified 2024-03-27T08:32:51.674097+0000 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:tableserver 0 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:root 0 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:session_timeout 300 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:session_autoclose 300 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:max_file_size 1099511627776 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:max_xattr_size 65536 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:required_client_features {} 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:last_failure 0 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:last_failure_osd_epoch 0 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:max_mds 3 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:in 0,1,2 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:up {0=34502,1=34463,2=34430} 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:failed 2024-03-27T08:34:51.460 INFO:teuthology.orchestra.run.smithi164.stdout:damaged 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:stopped 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:data_pools [3] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:metadata_pool 2 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:inline_data disabled 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:balancer 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:bal_rank_mask -1 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:standby_count_wanted 0 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:qdb_cluster leader: 34502 members: 34430,34463,34502 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.b{0:34502} state up:active seq 3 addr [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.k{0:34403} state up:standby-replay seq 1 addr [v2:172.21.15.167:6832/2990296948,v1:172.21.15.167:6833/2990296948] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.h{1:34463} state up:active seq 8 addr [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.i{1:24469} state up:standby-replay seq 1 addr [v2:172.21.15.173:6838/2691398042,v1:172.21.15.173:6839/2691398042] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.e{2:34430} state up:active seq 11 addr [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.461 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.c{2:24448} state up:standby-replay seq 1 addr [v2:172.21.15.173:6836/3514225451,v1:172.21.15.173:6837/3514225451] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:Standby daemons: 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.j{-1:14538} state up:standby seq 1 addr [v2:172.21.15.164:6834/96681599,v1:172.21.15.164:6835/96681599] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.164:6836/3048161214,v1:172.21.15.164:6837/3048161214] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.g{-1:14640} state up:standby seq 1 addr [v2:172.21.15.164:6838/2287850216,v1:172.21.15.164:6839/2287850216] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.a{-1:14658} state up:standby seq 1 addr [v2:172.21.15.164:6840/429709986,v1:172.21.15.164:6841/429709986] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.l{-1:24391} state up:standby seq 1 addr [v2:172.21.15.173:6832/3929947876,v1:172.21.15.173:6833/3929947876] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.462 INFO:teuthology.orchestra.run.smithi164.stdout:[mds.f{-1:24433} state up:standby seq 1 addr [v2:172.21.15.173:6834/4213841901,v1:172.21.15.173:6835/4213841901] compat {c=[1],r=[1],i=[1fff]}] 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 msgr2=0x7f0dd40a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 0x7f0dd40a5be0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0de000b580 tx=0x7f0de0005fb0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 msgr2=0x7f0df0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0de8007ee0 tx=0x7f0de800d3b0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 shutdown_connections 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0dd40a3720 0x7f0dd40a5be0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0df0104220 0x7f0df0074f70 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0df0102680 0x7f0df0076390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 --2- 172.21.15.164:0/424481623 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0df0103880 0x7f0df0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 >> 172.21.15.164:0/424481623 conn(0x7f0df00fdbe0 msgr2=0x7f0df0106c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.467+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 shutdown_connections 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:51.468+0000 7f0df5e00700 1 -- 172.21.15.164:0/424481623 wait complete. 2024-03-27T08:34:51.464 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:34:51.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/424481623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T08:34:51.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/424481623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T08:34:51.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/424481623' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-27T08:34:52.311 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- bash -c 'ceph osd dump' 2024-03-27T08:34:52.772 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:34:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:52 smithi167 ceph-mon[34903]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:52 smithi173 ceph-mon[35397]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:52.916 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:52 smithi164 ceph-mon[31788]: pgmap v427: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:54 smithi164 ceph-mon[31788]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:54 smithi173 ceph-mon[35397]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 -- 172.21.15.164:0/745879904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41026a0 msgr2=0x7fcdc4102ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 --2- 172.21.15.164:0/745879904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41026a0 0x7fcdc4102ac0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fcdb400b0d0 tx=0x7fcdb400b3e0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 -- 172.21.15.164:0/745879904 shutdown_connections 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 --2- 172.21.15.164:0/745879904 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc410aaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 --2- 172.21.15.164:0/745879904 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41026a0 0x7fcdc4102ac0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 --2- 172.21.15.164:0/745879904 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41038a0 0x7fcdc4103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 -- 172.21.15.164:0/745879904 >> 172.21.15.164:0/745879904 conn(0x7fcdc40fdc40 msgr2=0x7fcdc4100080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 -- 172.21.15.164:0/745879904 shutdown_connections 2024-03-27T08:34:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.009+0000 7fcdcb200700 1 -- 172.21.15.164:0/745879904 wait complete. 2024-03-27T08:34:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 Processor -- start 2024-03-27T08:34:55.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 -- start start 2024-03-27T08:34:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41026a0 0x7fcdc40763e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc410e2c0 con 0x7fcdc41038a0 2024-03-27T08:34:55.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc410e140 con 0x7fcdc4104240 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdcb200700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fcdc410e440 con 0x7fcdc41026a0 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdbb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdbb400700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34124/0 (socket says 172.21.15.164:34124) 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.011+0000 7fcdbb400700 1 -- 172.21.15.164:0/1437761367 learned_addr learned my addr 172.21.15.164:0/1437761367 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdc9200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:55.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdc3e00700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41026a0 0x7fcdc40763e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 -- 172.21.15.164:0/1437761367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41026a0 msgr2=0x7fcdc40763e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41026a0 0x7fcdc40763e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 -- 172.21.15.164:0/1437761367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 msgr2=0x7fcdc4074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc4074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 -- 172.21.15.164:0/1437761367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc4075820 con 0x7fcdc41038a0 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdc9200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdbb400700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00d980 tx=0x7fcdac00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.012+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac017070 con 0x7fcdc41038a0 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.013+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcdac004d00 con 0x7fcdc41038a0 2024-03-27T08:34:55.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.013+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc41a2a70 con 0x7fcdc41038a0 2024-03-27T08:34:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.013+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdac005520 con 0x7fcdc41038a0 2024-03-27T08:34:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.013+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdc41a2f80 con 0x7fcdc41038a0 2024-03-27T08:34:55.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.014+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdc4069300 con 0x7fcdc41038a0 2024-03-27T08:34:55.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.016+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fcdac004750 con 0x7fcdc41038a0 2024-03-27T08:34:55.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.017+0000 7fcdc1600700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 0x7fcda80a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:55.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.017+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fcdac0cfc60 con 0x7fcdc41038a0 2024-03-27T08:34:55.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.017+0000 7fcdc3e00700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 0x7fcda80a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:55.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.018+0000 7fcdc3e00700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 0x7fcda80a5be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009fd0 tx=0x7fcdb400b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:55.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.022+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fcdac020020 con 0x7fcdc41038a0 2024-03-27T08:34:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:54 smithi167 ceph-mon[34903]: pgmap v428: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:55.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.251+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fcdc4063250 con 0x7fcdc41038a0 2024-03-27T08:34:55.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.253+0000 7fcdc1600700 1 -- 172.21.15.164:0/1437761367 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v90) ==== 56+0+5313 (secure 0 0 0) 0x7fcdac09c7e0 con 0x7fcdc41038a0 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:epoch 90 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:created 2024-03-27T08:22:09.434879+0000 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:modified 2024-03-27T08:33:18.434606+0000 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:crush_version 26 2024-03-27T08:34:55.246 INFO:teuthology.orchestra.run.smithi164.stdout:full_ratio 0.95 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:backfillfull_ratio 0.9 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:nearfull_ratio 0.85 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:require_min_compat_client luminous 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:min_compat_client luminous 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:require_osd_release squid 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:stretch_mode_enabled false 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 88 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:max_osd 12 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:osd.0 up in weight 1 up_from 8 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6802/3960470757,v1:172.21.15.164:6803/3960470757] [v2:172.21.15.164:6804/3960470757,v1:172.21.15.164:6805/3960470757] exists,up 3ccf9cf4-4550-4d3e-8413-46b4133cb1c0 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:osd.1 up in weight 1 up_from 13 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/357892090,v1:172.21.15.167:6801/357892090] [v2:172.21.15.167:6802/357892090,v1:172.21.15.167:6803/357892090] exists,up 25fb7622-4173-476f-80d4-897c9b42bf16 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:osd.2 up in weight 1 up_from 18 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6800/765640001,v1:172.21.15.173:6801/765640001] [v2:172.21.15.173:6802/765640001,v1:172.21.15.173:6803/765640001] exists,up c67b96cb-ba02-41dc-a4f6-6887b490de1a 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:osd.3 up in weight 1 up_from 27 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6810/2703443862,v1:172.21.15.164:6811/2703443862] [v2:172.21.15.164:6812/2703443862,v1:172.21.15.164:6813/2703443862] exists,up 1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3 2024-03-27T08:34:55.247 INFO:teuthology.orchestra.run.smithi164.stdout:osd.4 up in weight 1 up_from 35 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/4005700417,v1:172.21.15.167:6809/4005700417] [v2:172.21.15.167:6810/4005700417,v1:172.21.15.167:6811/4005700417] exists,up 59fc75ef-25b1-4b3b-82c5-78d108babbdb 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.5 up in weight 1 up_from 40 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6808/1658864715,v1:172.21.15.173:6809/1658864715] [v2:172.21.15.173:6810/1658864715,v1:172.21.15.173:6811/1658864715] exists,up a66118e3-de31-41fb-becc-152bf0fa6bee 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.6 up in weight 1 up_from 48 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6818/1951126247,v1:172.21.15.164:6819/1951126247] [v2:172.21.15.164:6820/1951126247,v1:172.21.15.164:6821/1951126247] exists,up a6ecbda0-55a0-4633-bfd5-18aff3d6318e 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.7 up in weight 1 up_from 54 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/3522297748,v1:172.21.15.167:6817/3522297748] [v2:172.21.15.167:6818/3522297748,v1:172.21.15.167:6819/3522297748] exists,up 3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.8 up in weight 1 up_from 62 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6816/4192455767,v1:172.21.15.173:6817/4192455767] [v2:172.21.15.173:6818/4192455767,v1:172.21.15.173:6819/4192455767] exists,up 8b5e5331-70d7-48c7-921a-9ee5e820651b 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.9 up in weight 1 up_from 70 up_thru 86 down_at 0 last_clean_interval [0,0) [v2:172.21.15.164:6826/1825702850,v1:172.21.15.164:6827/1825702850] [v2:172.21.15.164:6828/1825702850,v1:172.21.15.164:6829/1825702850] exists,up 654dec9e-fa4b-4083-8f5a-770d7c0c96e6 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.10 up in weight 1 up_from 75 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/1703441209,v1:172.21.15.167:6825/1703441209] [v2:172.21.15.167:6826/1703441209,v1:172.21.15.167:6827/1703441209] exists,up 4083fbc0-a61b-4fbc-b8a4-9ec80308a49c 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:osd.11 up in weight 1 up_from 83 up_thru 89 down_at 0 last_clean_interval [0,0) [v2:172.21.15.173:6824/2517065128,v1:172.21.15.173:6825/2517065128] [v2:172.21.15.173:6826/2517065128,v1:172.21.15.173:6827/2517065128] exists,up 5e276690-d955-4f55-958c-de42c3d3915e 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 2.a [2,11] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 2.10 [8,11] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 2.1d [2,4] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 3.3 [4,9] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 3.6 [4,6] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 3.1a [5,7] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 3.22 [3,9] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:pg_upmap_items 3.36 [4,9] 2024-03-27T08:34:55.248 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/2800925555 expires 2024-03-28T08:23:17.136317+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/2052222492 expires 2024-03-28T08:23:17.136317+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:6801/3452126215 expires 2024-03-28T08:23:17.136317+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/3643701431 expires 2024-03-28T08:22:42.672679+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/3871021713 expires 2024-03-28T08:22:42.672679+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/2354741154 expires 2024-03-28T08:23:17.136317+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:0/2219431867 expires 2024-03-28T08:22:42.672679+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:6800/460797646 expires 2024-03-28T08:22:42.672679+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:6801/460797646 expires 2024-03-28T08:22:42.672679+0000 2024-03-27T08:34:55.249 INFO:teuthology.orchestra.run.smithi164.stdout:blocklist 172.21.15.164:6800/3452126215 expires 2024-03-28T08:23:17.136317+0000 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 msgr2=0x7fcda80a5be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 0x7fcda80a5be0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009fd0 tx=0x7fcdb400b040 comp rx=0 tx=0).stop 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 msgr2=0x7fcdc4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fcdac00d980 tx=0x7fcdac00dd40 comp rx=0 tx=0).stop 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 shutdown_connections 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fcda80a3720 0x7fcda80a5be0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcdc4104240 0x7fcdc4074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fcdc41026a0 0x7fcdc40763e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 --2- 172.21.15.164:0/1437761367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fcdc41038a0 0x7fcdc4074a30 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:55.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.256+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 >> 172.21.15.164:0/1437761367 conn(0x7fcdc40fdc40 msgr2=0x7fcdc4106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:55.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.257+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 shutdown_connections 2024-03-27T08:34:55.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:55.257+0000 7fcdcb200700 1 -- 172.21.15.164:0/1437761367 wait complete. 2024-03-27T08:34:55.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:55 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1437761367' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T08:34:55.979 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:55 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1437761367' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T08:34:56.036 INFO:teuthology.run_tasks:Running task fs.ready... 2024-03-27T08:34:56.047 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:34:56.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:55 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1437761367' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 -- 172.21.15.164:0/4235478007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 msgr2=0x7f870410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 --2- 172.21.15.164:0/4235478007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f870410c1d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009ca0 tx=0x7f86fc02c100 comp rx=0 tx=0).stop 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 -- 172.21.15.164:0/4235478007 shutdown_connections 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 --2- 172.21.15.164:0/4235478007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f870410c1d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 --2- 172.21.15.164:0/4235478007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 0x7f8704105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 --2- 172.21.15.164:0/4235478007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 0x7f87041041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 -- 172.21.15.164:0/4235478007 >> 172.21.15.164:0/4235478007 conn(0x7f87040ff300 msgr2=0x7f8704101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:56.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 -- 172.21.15.164:0/4235478007 shutdown_connections 2024-03-27T08:34:56.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.262+0000 7f870a400640 1 -- 172.21.15.164:0/4235478007 wait complete. 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.263+0000 7f870a400640 1 Processor -- start 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.263+0000 7f870a400640 1 -- start start 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 0x7f870419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 0x7f870419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f870410f9f0 con 0x7f8704105940 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f870410f870 con 0x7f8704104f80 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f870a400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f870410fb70 con 0x7f8704103d90 2024-03-27T08:34:56.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f86fbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 0x7f870419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40042/0 (socket says 172.21.15.164:40042) 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 -- 172.21.15.164:0/1755683109 learned_addr learned my addr 172.21.15.164:0/1755683109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 0x7f870419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 -- 172.21.15.164:0/1755683109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 msgr2=0x7f870419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 0x7f870419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 -- 172.21.15.164:0/1755683109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 msgr2=0x7f870419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 0x7f870419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.264+0000 7f8703e00640 1 -- 172.21.15.164:0/1755683109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87041a1c20 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f8703e00640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009bf0 tx=0x7f86fc034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc039050 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f86fc03a040 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87041a1eb0 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc0046a0 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.265+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87041a2370 con 0x7f8704105940 2024-03-27T08:34:56.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.266+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f870410b0b0 con 0x7f8704105940 2024-03-27T08:34:56.260 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.268+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f86fc003970 con 0x7f8704105940 2024-03-27T08:34:56.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.270+0000 7f8700c00640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 0x7f86e80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.261 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.270+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f86fc0f2560 con 0x7f8704105940 2024-03-27T08:34:56.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.270+0000 7f8703400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 0x7f86e80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.262 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.271+0000 7f8703400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 0x7f86e80a5b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:56.266 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.274+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f86fc0bf140 con 0x7f8704105940 2024-03-27T08:34:56.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.474+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8704062750 con 0x7f8704105940 2024-03-27T08:34:56.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.478+0000 7f8700c00640 1 -- 172.21.15.164:0/1755683109 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f86fc0bea40 con 0x7f8704105940 2024-03-27T08:34:56.471 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:56.471 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 msgr2=0x7f86e80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 0x7f86e80a5b50 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f86f4005fd0 tx=0x7f86f4005850 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 msgr2=0x7f87041a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f86fc009bf0 tx=0x7f86fc034cd0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 shutdown_connections 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86e80a3690 0x7f86e80a5b50 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8704105940 0x7f87041a15b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8704104f80 0x7f870419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 --2- 172.21.15.164:0/1755683109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8704103d90 0x7f870419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 >> 172.21.15.164:0/1755683109 conn(0x7f87040ff300 msgr2=0x7f8704108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:56.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 shutdown_connections 2024-03-27T08:34:56.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.481+0000 7f870a400640 1 -- 172.21.15.164:0/1755683109 wait complete. 2024-03-27T08:34:56.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:34:56.494 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.716+0000 7f9bb7400640 1 -- 172.21.15.164:0/1976897765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 msgr2=0x7f9bb0107300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.716+0000 7f9bb7400640 1 --2- 172.21.15.164:0/1976897765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb0107300 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c009900 tx=0x7f9b9c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.716+0000 7f9bb7400640 1 -- 172.21.15.164:0/1976897765 shutdown_connections 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 --2- 172.21.15.164:0/1976897765 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 0x7f9bb0109c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 --2- 172.21.15.164:0/1976897765 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb0107300 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 --2- 172.21.15.164:0/1976897765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 0x7f9bb00ffbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 -- 172.21.15.164:0/1976897765 >> 172.21.15.164:0/1976897765 conn(0x7f9bb00fb310 msgr2=0x7f9bb00fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 -- 172.21.15.164:0/1976897765 shutdown_connections 2024-03-27T08:34:56.709 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.717+0000 7f9bb7400640 1 -- 172.21.15.164:0/1976897765 wait complete. 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 Processor -- start 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 -- start start 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 0x7f9bb019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 0x7f9bb01a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb010d830 con 0x7f9bb01001b0 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb010d6b0 con 0x7f9bb00ff7c0 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.718+0000 7f9bb7400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9bb010d9b0 con 0x7f9bb0107840 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40072/0 (socket says 172.21.15.164:40072) 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 -- 172.21.15.164:0/339850968 learned_addr learned my addr 172.21.15.164:0/339850968 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bb4a00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 0x7f9bb019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bb5400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 0x7f9bb01a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 -- 172.21.15.164:0/339850968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 msgr2=0x7f9bb01a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 0x7f9bb01a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 -- 172.21.15.164:0/339850968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 msgr2=0x7f9bb019a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 0x7f9bb019a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 -- 172.21.15.164:0/339850968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bb01a1cb0 con 0x7f9bb01001b0 2024-03-27T08:34:56.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.719+0000 7f9bafe00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000c00 tx=0x7f9b9c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.720+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c043020 con 0x7f9bb01001b0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.720+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b9c005460 con 0x7f9bb01001b0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.720+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b9c003d00 con 0x7f9bb01001b0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.720+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bb01a1f40 con 0x7f9bb01001b0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.720+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bb01a2400 con 0x7f9bb01001b0 2024-03-27T08:34:56.713 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.721+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bb01a25d0 con 0x7f9bb01001b0 2024-03-27T08:34:56.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.723+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f9b9c046020 con 0x7f9bb01001b0 2024-03-27T08:34:56.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.724+0000 7f9bad600640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 0x7f9b980a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:56.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.724+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9b9c0f1fe0 con 0x7f9bb01001b0 2024-03-27T08:34:56.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.724+0000 7f9bb4a00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 0x7f9b980a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:56.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.725+0000 7f9bb4a00640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 0x7f9b980a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009bd0 tx=0x7f9ba4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:56.720 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.729+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9b9c04d020 con 0x7f9bb01001b0 2024-03-27T08:34:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:56 smithi164 ceph-mon[31788]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:56 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1755683109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:56.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.928+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f9bb01a2960 con 0x7f9bb01001b0 2024-03-27T08:34:56.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.930+0000 7f9bad600640 1 -- 172.21.15.164:0/339850968 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f9b9c0beb60 con 0x7f9bb01001b0 2024-03-27T08:34:56.921 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:34:56.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 msgr2=0x7f9b980a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 0x7f9b980a5ad0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9ba4009bd0 tx=0x7f9ba4005f90 comp rx=0 tx=0).stop 2024-03-27T08:34:56.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 msgr2=0x7f9bb019a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:56.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f9b9c000c00 tx=0x7f9b9c004e20 comp rx=0 tx=0).stop 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 shutdown_connections 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9b980a3610 0x7f9b980a5ad0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9bb0107840 0x7f9bb01a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9bb01001b0 0x7f9bb019a5d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 --2- 172.21.15.164:0/339850968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9bb00ff7c0 0x7f9bb019a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.932+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 >> 172.21.15.164:0/339850968 conn(0x7f9bb00fb310 msgr2=0x7f9bb00fd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.933+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 shutdown_connections 2024-03-27T08:34:56.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:56.933+0000 7f9bb7400640 1 -- 172.21.15.164:0/339850968 wait complete. 2024-03-27T08:34:56.943 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:34:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:56 smithi167 ceph-mon[34903]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:56 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1755683109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:56 smithi173 ceph-mon[35397]: pgmap v429: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:34:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:56 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1755683109' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 -- 172.21.15.164:0/2086924954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 msgr2=0x7fdc64074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 --2- 172.21.15.164:0/2086924954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc64074a30 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fdc50009900 tx=0x7fdc5002bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 -- 172.21.15.164:0/2086924954 shutdown_connections 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 --2- 172.21.15.164:0/2086924954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64109a20 0x7fdc6410beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 --2- 172.21.15.164:0/2086924954 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc64074a30 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 --2- 172.21.15.164:0/2086924954 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64075b90 0x7fdc64073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 -- 172.21.15.164:0/2086924954 >> 172.21.15.164:0/2086924954 conn(0x7fdc640fd0f0 msgr2=0x7fdc640ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:57.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 -- 172.21.15.164:0/2086924954 shutdown_connections 2024-03-27T08:34:57.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.206+0000 7fdc6b800640 1 -- 172.21.15.164:0/2086924954 wait complete. 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.207+0000 7fdc6b800640 1 Processor -- start 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.207+0000 7fdc6b800640 1 -- start start 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.207+0000 7fdc6b800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.207+0000 7fdc6b800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64075b90 0x7fdc6419a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc6b800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64109a20 0x7fdc641a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc6b800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6410fa00 con 0x7fdc640745b0 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc6b800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6410f880 con 0x7fdc64075b90 2024-03-27T08:34:57.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc6b800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fdc6410fb80 con 0x7fdc64109a20 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40084/0 (socket says 172.21.15.164:40084) 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 -- 172.21.15.164:0/1784122165 learned_addr learned my addr 172.21.15.164:0/1784122165 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc63e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64075b90 0x7fdc6419a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc69800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64109a20 0x7fdc641a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 -- 172.21.15.164:0/1784122165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64109a20 msgr2=0x7fdc641a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64109a20 0x7fdc641a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 -- 172.21.15.164:0/1784122165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64075b90 msgr2=0x7fdc6419a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64075b90 0x7fdc6419a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.208+0000 7fdc68e00640 1 -- 172.21.15.164:0/1784122165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc641a1ce0 con 0x7fdc640745b0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc68e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800d770 tx=0x7fdc5800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58017070 con 0x7fdc640745b0 2024-03-27T08:34:57.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc580054f0 con 0x7fdc640745b0 2024-03-27T08:34:57.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc58004d60 con 0x7fdc640745b0 2024-03-27T08:34:57.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc641a1fd0 con 0x7fdc640745b0 2024-03-27T08:34:57.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.209+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc641a23e0 con 0x7fdc640745b0 2024-03-27T08:34:57.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.210+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc64108750 con 0x7fdc640745b0 2024-03-27T08:34:57.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.212+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fdc58004f00 con 0x7fdc640745b0 2024-03-27T08:34:57.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.214+0000 7fdc61600640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 0x7fdc4c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.214+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fdc580cf7e0 con 0x7fdc640745b0 2024-03-27T08:34:57.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.214+0000 7fdc63e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 0x7fdc4c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.215+0000 7fdc63e00640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 0x7fdc4c0a5ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000c00 tx=0x7fdc5002c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:57.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.218+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fdc5809c360 con 0x7fdc640745b0 2024-03-27T08:34:57.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.421+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdc64062820 con 0x7fdc640745b0 2024-03-27T08:34:57.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.422+0000 7fdc61600640 1 -- 172.21.15.164:0/1784122165 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fdc5809bc60 con 0x7fdc640745b0 2024-03-27T08:34:57.414 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 msgr2=0x7fdc4c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 0x7fdc4c0a5ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fdc50000c00 tx=0x7fdc5002c820 comp rx=0 tx=0).stop 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 msgr2=0x7fdc6419a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fdc5800d770 tx=0x7fdc5800dc30 comp rx=0 tx=0).stop 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 shutdown_connections 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fdc4c0a3610 0x7fdc4c0a5ad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fdc64109a20 0x7fdc641a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc64075b90 0x7fdc6419a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 --2- 172.21.15.164:0/1784122165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fdc640745b0 0x7fdc6419a0c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 >> 172.21.15.164:0/1784122165 conn(0x7fdc640fd0f0 msgr2=0x7fdc64105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:57.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 shutdown_connections 2024-03-27T08:34:57.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.425+0000 7fdc6b800640 1 -- 172.21.15.164:0/1784122165 wait complete. 2024-03-27T08:34:57.437 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 -- 172.21.15.164:0/3848361028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 msgr2=0x7f4314076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 --2- 172.21.15.164:0/3848361028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f4314076930 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4308009900 tx=0x7f430802bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 -- 172.21.15.164:0/3848361028 shutdown_connections 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 --2- 172.21.15.164:0/3848361028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43140780f0 0x7f4314078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 --2- 172.21.15.164:0/3848361028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f4314077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 --2- 172.21.15.164:0/3848361028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f4314076930 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 -- 172.21.15.164:0/3848361028 >> 172.21.15.164:0/3848361028 conn(0x7f43140ff300 msgr2=0x7f4314101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 -- 172.21.15.164:0/3848361028 shutdown_connections 2024-03-27T08:34:57.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.661+0000 7f431be00640 1 -- 172.21.15.164:0/3848361028 wait complete. 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.662+0000 7f431be00640 1 Processor -- start 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.662+0000 7f431be00640 1 -- start start 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f431419ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43140780f0 0x7f43141a5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4314113dd0 con 0x7f4314076510 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4314113c50 con 0x7f4314077750 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f431be00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4314113f50 con 0x7f43140780f0 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40096/0 (socket says 172.21.15.164:40096) 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 -- 172.21.15.164:0/2615491890 learned_addr learned my addr 172.21.15.164:0/2615491890 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4318a00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f431419ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 -- 172.21.15.164:0/2615491890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43140780f0 msgr2=0x7f43141a5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43140780f0 0x7f43141a5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 -- 172.21.15.164:0/2615491890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 msgr2=0x7f431419ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f431419ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4319400640 1 -- 172.21.15.164:0/2615491890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43141a6120 con 0x7f4314076510 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.663+0000 7f4318a00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f431419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f4319400640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4308009230 tx=0x7f4308004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308043020 con 0x7f4314076510 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4308004350 con 0x7f4314076510 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43141a63b0 con 0x7f4314076510 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4308003ca0 con 0x7f4314076510 2024-03-27T08:34:57.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.664+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43141a6900 con 0x7f4314076510 2024-03-27T08:34:57.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.665+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4314110700 con 0x7f4314076510 2024-03-27T08:34:57.659 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.667+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4308046020 con 0x7f4314076510 2024-03-27T08:34:57.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.668+0000 7f4312000640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 0x7f42fc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:57.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.669+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f43080f1be0 con 0x7f4314076510 2024-03-27T08:34:57.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.669+0000 7f4318a00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 0x7f42fc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:57.661 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.669+0000 7f4318a00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 0x7f42fc0a5ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4300005d00 tx=0x7f4300005ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:57.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.672+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f430804d070 con 0x7f4314076510 2024-03-27T08:34:57.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:57 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/339850968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:57.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:57 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1784122165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:57.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.874+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f43140627f0 con 0x7f4314076510 2024-03-27T08:34:57.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.875+0000 7f4312000640 1 -- 172.21.15.164:0/2615491890 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f43080be760 con 0x7f4314076510 2024-03-27T08:34:57.866 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 msgr2=0x7f42fc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 0x7f42fc0a5ad0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f4300005d00 tx=0x7f4300005ed0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 msgr2=0x7f431419e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4308009230 tx=0x7f4308004ea0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 shutdown_connections 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42fc0a3610 0x7f42fc0a5ad0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f43140780f0 0x7f43141a5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4314077750 0x7f431419ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 --2- 172.21.15.164:0/2615491890 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4314076510 0x7f431419e500 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:57.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 >> 172.21.15.164:0/2615491890 conn(0x7f43140ff300 msgr2=0x7f4314100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:57.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 shutdown_connections 2024-03-27T08:34:57.870 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:57.877+0000 7f431be00640 1 -- 172.21.15.164:0/2615491890 wait complete. 2024-03-27T08:34:57.889 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:34:58.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:57 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/339850968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:58.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:57 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1784122165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:57 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/339850968' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:34:58.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:57 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1784122165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:34:58.086 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 -- 172.21.15.164:0/1489620343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90108c30 msgr2=0x7fef90109050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 --2- 172.21.15.164:0/1489620343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90108c30 0x7fef90109050 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fef80009860 tx=0x7fef8002bc00 comp rx=0 tx=0).stop 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 -- 172.21.15.164:0/1489620343 shutdown_connections 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 --2- 172.21.15.164:0/1489620343 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 0x7fef9010a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 --2- 172.21.15.164:0/1489620343 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90109590 0x7fef901099f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 --2- 172.21.15.164:0/1489620343 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90108c30 0x7fef90109050 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.094+0000 7fef96400640 1 -- 172.21.15.164:0/1489620343 >> 172.21.15.164:0/1489620343 conn(0x7fef9006fa00 msgr2=0x7fef90071e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.095+0000 7fef96400640 1 -- 172.21.15.164:0/1489620343 shutdown_connections 2024-03-27T08:34:58.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.095+0000 7fef96400640 1 -- 172.21.15.164:0/1489620343 wait complete. 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.095+0000 7fef96400640 1 Processor -- start 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 -- start start 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90108c30 0x7fef901a2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 0x7fef901a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fef901181a0 con 0x7fef90109590 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef90118020 con 0x7fef90109f30 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef96400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef90118320 con 0x7fef90108c30 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef87e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef87e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40114/0 (socket says 172.21.15.164:40114) 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef87e00640 1 -- 172.21.15.164:0/3526847619 learned_addr learned my addr 172.21.15.164:0/3526847619 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.096+0000 7fef8fe00640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 0x7fef901a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 -- 172.21.15.164:0/3526847619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90108c30 msgr2=0x7fef901a2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90108c30 0x7fef901a2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 -- 172.21.15.164:0/3526847619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 msgr2=0x7fef901a9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 0x7fef901a9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 -- 172.21.15.164:0/3526847619 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef901aa460 con 0x7fef90109590 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef87e00640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d770 tx=0x7fef7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:58.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78017070 con 0x7fef90109590 2024-03-27T08:34:58.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef780054f0 con 0x7fef90109590 2024-03-27T08:34:58.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef901aa750 con 0x7fef90109590 2024-03-27T08:34:58.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef78004d60 con 0x7fef90109590 2024-03-27T08:34:58.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.097+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef901aac50 con 0x7fef90109590 2024-03-27T08:34:58.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.099+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef90113b40 con 0x7fef90109590 2024-03-27T08:34:58.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.101+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fef78004f00 con 0x7fef90109590 2024-03-27T08:34:58.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.102+0000 7fef8cc00640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 0x7fef740a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.102+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fef780cf8c0 con 0x7fef90109590 2024-03-27T08:34:58.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.102+0000 7fef8f400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 0x7fef740a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.094 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.103+0000 7fef8f400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 0x7fef740a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef80037040 tx=0x7fef80009520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:58.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.107+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fef7809c440 con 0x7fef90109590 2024-03-27T08:34:58.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.334+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fef90062780 con 0x7fef90109590 2024-03-27T08:34:58.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.336+0000 7fef8cc00640 1 -- 172.21.15.164:0/3526847619 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7fef7809bd40 con 0x7fef90109590 2024-03-27T08:34:58.328 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:58.328 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:34:58.328 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:34:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 msgr2=0x7fef740a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 0x7fef740a5ad0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fef80037040 tx=0x7fef80009520 comp rx=0 tx=0).stop 2024-03-27T08:34:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 msgr2=0x7fef901a2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fef7800d770 tx=0x7fef7800dc30 comp rx=0 tx=0).stop 2024-03-27T08:34:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 shutdown_connections 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef740a3610 0x7fef740a5ad0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef90109f30 0x7fef901a9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef90109590 0x7fef901a2d80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 --2- 172.21.15.164:0/3526847619 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef90108c30 0x7fef901a2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 >> 172.21.15.164:0/3526847619 conn(0x7fef9006fa00 msgr2=0x7fef90071170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.340+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 shutdown_connections 2024-03-27T08:34:58.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.341+0000 7fef96400640 1 -- 172.21.15.164:0/3526847619 wait complete. 2024-03-27T08:34:58.358 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:34:58.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 -- 172.21.15.164:0/567251810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103d70 msgr2=0x7f0d08104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 --2- 172.21.15.164:0/567251810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103d70 0x7f0d08104190 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f0cf8009900 tx=0x7f0cf802bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:58.560 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 -- 172.21.15.164:0/567251810 shutdown_connections 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 --2- 172.21.15.164:0/567251810 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08105920 0x7f0d0810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 --2- 172.21.15.164:0/567251810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 0x7f0d081053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 --2- 172.21.15.164:0/567251810 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08103d70 0x7f0d08104190 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.568+0000 7f0d0e400640 1 -- 172.21.15.164:0/567251810 >> 172.21.15.164:0/567251810 conn(0x7f0d080ff300 msgr2=0x7f0d08101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.569+0000 7f0d0e400640 1 -- 172.21.15.164:0/567251810 shutdown_connections 2024-03-27T08:34:58.561 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.569+0000 7f0d0e400640 1 -- 172.21.15.164:0/567251810 wait complete. 2024-03-27T08:34:58.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.569+0000 7f0d0e400640 1 Processor -- start 2024-03-27T08:34:58.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 -- start start 2024-03-27T08:34:58.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08103d70 0x7f0d0819a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.563 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 0x7f0d0819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0810fa20 con 0x7f0d08105920 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0810f8a0 con 0x7f0d08104f60 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d0e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d0810fba0 con 0x7f0d08103d70 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d07e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d07e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40122/0 (socket says 172.21.15.164:40122) 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.570+0000 7f0d07e00640 1 -- 172.21.15.164:0/321167195 learned_addr learned my addr 172.21.15.164:0/321167195 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08103d70 0x7f0d0819a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d06a00640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 0x7f0d0819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 -- 172.21.15.164:0/321167195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08103d70 msgr2=0x7f0d0819a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08103d70 0x7f0d0819a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 -- 172.21.15.164:0/321167195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 msgr2=0x7f0d0819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.564 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 0x7f0d0819a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 -- 172.21.15.164:0/321167195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d081a1c80 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d07e00640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000eaa0 tx=0x7f0d0000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000cdb0 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0d00005020 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d081a1f70 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.571+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d000116d0 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.572+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d081a2430 con 0x7f0d08105920 2024-03-27T08:34:58.565 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.573+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d0810b090 con 0x7f0d08105920 2024-03-27T08:34:58.566 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.575+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f0d000051d0 con 0x7f0d08105920 2024-03-27T08:34:58.567 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.576+0000 7f0cffe00640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 0x7f0cec0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:58.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.576+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0d000cffc0 con 0x7f0d08105920 2024-03-27T08:34:58.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.576+0000 7f0d07400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 0x7f0cec0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:58.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.577+0000 7f0d07400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 0x7f0cec0a5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802c170 tx=0x7f0cf8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.584+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0d00016030 con 0x7f0d08105920 2024-03-27T08:34:58.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.780+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d080627f0 con 0x7f0d08105920 2024-03-27T08:34:58.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.784+0000 7f0cffe00640 1 -- 172.21.15.164:0/321167195 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f0d0009cba0 con 0x7f0d08105920 2024-03-27T08:34:58.776 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:34:58.776 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:34:58.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 msgr2=0x7f0cec0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 0x7f0cec0a5ad0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f0cf802c170 tx=0x7f0cf8005fd0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 msgr2=0x7f0d081a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f0d0000eaa0 tx=0x7f0d0000ef60 comp rx=0 tx=0).stop 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 shutdown_connections 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0cec0a3610 0x7f0cec0a5ad0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d08105920 0x7f0d081a1610 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.786+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d08104f60 0x7f0d0819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.787+0000 7f0d0e400640 1 --2- 172.21.15.164:0/321167195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d08103d70 0x7f0d0819a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.787+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 >> 172.21.15.164:0/321167195 conn(0x7f0d080ff300 msgr2=0x7f0d08108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.787+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 shutdown_connections 2024-03-27T08:34:58.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:58.787+0000 7f0d0e400640 1 -- 172.21.15.164:0/321167195 wait complete. 2024-03-27T08:34:58.798 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:34:58.798 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:34:58.869 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:58 smithi164 ceph-mon[31788]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:58.869 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:58 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2615491890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:58.869 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:58 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3526847619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:59.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 -- 172.21.15.164:0/3491154702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10801012a0 msgr2=0x7f1080101720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 --2- 172.21.15.164:0/3491154702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10801012a0 0x7f1080101720 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f106800aa10 tx=0x7f106802cf60 comp rx=0 tx=0).stop 2024-03-27T08:34:59.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 -- 172.21.15.164:0/3491154702 shutdown_connections 2024-03-27T08:34:59.003 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 --2- 172.21.15.164:0/3491154702 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1080101c60 0x7f10801084f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 --2- 172.21.15.164:0/3491154702 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f10801012a0 0x7f1080101720 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 --2- 172.21.15.164:0/3491154702 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f10801004d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 -- 172.21.15.164:0/3491154702 >> 172.21.15.164:0/3491154702 conn(0x7f10800fb640 msgr2=0x7f10800fda60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:59.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 -- 172.21.15.164:0/3491154702 shutdown_connections 2024-03-27T08:34:59.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.011+0000 7f1085400640 1 -- 172.21.15.164:0/3491154702 wait complete. 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.012+0000 7f1085400640 1 Processor -- start 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.012+0000 7f1085400640 1 -- start start 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.012+0000 7f1085400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f1080199e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1085400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10801012a0 0x7f108019a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1085400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1085400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f108010b4e0 con 0x7f1080101c60 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1085400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f108010b360 con 0x7f10801012a0 2024-03-27T08:34:59.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1085400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f108010b660 con 0x7f10801000b0 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40138/0 (socket says 172.21.15.164:40138) 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 -- 172.21.15.164:0/221911039 learned_addr learned my addr 172.21.15.164:0/221911039 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f107f400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10801012a0 0x7f108019a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f107fe00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f1080199e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 -- 172.21.15.164:0/221911039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 msgr2=0x7f1080199e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f1080199e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 -- 172.21.15.164:0/221911039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10801012a0 msgr2=0x7f108019a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10801012a0 0x7f108019a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f1084a00640 1 -- 172.21.15.164:0/221911039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10801a1ab0 con 0x7f1080101c60 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.013+0000 7f107fe00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f1080199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f1084a00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f107800cce0 tx=0x7f107800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f107800f450 con 0x7f1080101c60 2024-03-27T08:34:59.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f107800fac0 con 0x7f1080101c60 2024-03-27T08:34:59.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10801a1da0 con 0x7f1080101c60 2024-03-27T08:34:59.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1078018be0 con 0x7f1080101c60 2024-03-27T08:34:59.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.014+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10801a2210 con 0x7f1080101c60 2024-03-27T08:34:59.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.015+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1080107300 con 0x7f1080101c60 2024-03-27T08:34:59.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.017+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f107800fc70 con 0x7f1080101c60 2024-03-27T08:34:59.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.018+0000 7f107cc00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 0x7f10640a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.019+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f10780d0510 con 0x7f1080101c60 2024-03-27T08:34:59.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.019+0000 7f107fe00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 0x7f10640a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.011 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.019+0000 7f107fe00640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 0x7f10640a5ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1080101100 tx=0x7f1070005db0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.023+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1078014030 con 0x7f1080101c60 2024-03-27T08:34:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:58 smithi167 ceph-mon[34903]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:58 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2615491890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:58 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3526847619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:58 smithi173 ceph-mon[35397]: pgmap v430: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:34:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:58 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2615491890' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:34:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:58 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3526847619' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:34:59.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.221+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1080062750 con 0x7f1080101c60 2024-03-27T08:34:59.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.222+0000 7f107cc00640 1 -- 172.21.15.164:0/221911039 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f107809d090 con 0x7f1080101c60 2024-03-27T08:34:59.214 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:34:59.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 msgr2=0x7f10640a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 0x7f10640a5ad0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1080101100 tx=0x7f1070005db0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 msgr2=0x7f10801a1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f107800cce0 tx=0x7f107800a620 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 shutdown_connections 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f10640a3610 0x7f10640a5ad0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1080101c60 0x7f10801a1440 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f10801012a0 0x7f108019a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 --2- 172.21.15.164:0/221911039 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f10801000b0 0x7f1080199e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.224+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 >> 172.21.15.164:0/221911039 conn(0x7f10800fb640 msgr2=0x7f10801044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.225+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 shutdown_connections 2024-03-27T08:34:59.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.225+0000 7f1085400640 1 -- 172.21.15.164:0/221911039 wait complete. 2024-03-27T08:34:59.233 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.432+0000 7fef65800640 1 -- 172.21.15.164:0/4895285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60103710 msgr2=0x7fef60109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.432+0000 7fef65800640 1 --2- 172.21.15.164:0/4895285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60103710 0x7fef60109fa0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fef58009ca0 tx=0x7fef5802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 -- 172.21.15.164:0/4895285 shutdown_connections 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 --2- 172.21.15.164:0/4895285 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60103710 0x7fef60109fa0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 --2- 172.21.15.164:0/4895285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60102d50 0x7fef601031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 --2- 172.21.15.164:0/4895285 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60101b60 0x7fef60101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 -- 172.21.15.164:0/4895285 >> 172.21.15.164:0/4895285 conn(0x7fef600fd0f0 msgr2=0x7fef600ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 -- 172.21.15.164:0/4895285 shutdown_connections 2024-03-27T08:34:59.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.433+0000 7fef65800640 1 -- 172.21.15.164:0/4895285 wait complete. 2024-03-27T08:34:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 Processor -- start 2024-03-27T08:34:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 -- start start 2024-03-27T08:34:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60101b60 0x7fef60197e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60103710 0x7fef6019f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010d7c0 con 0x7fef60102d50 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010d640 con 0x7fef60101b60 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef65800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fef6010d940 con 0x7fef60103710 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef57e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef57e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40166/0 (socket says 172.21.15.164:40166) 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.434+0000 7fef57e00640 1 -- 172.21.15.164:0/3910969317 learned_addr learned my addr 172.21.15.164:0/3910969317 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef5ea00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60101b60 0x7fef60197e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef5f400640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60103710 0x7fef6019f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 -- 172.21.15.164:0/3910969317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60103710 msgr2=0x7fef6019f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60103710 0x7fef6019f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 -- 172.21.15.164:0/3910969317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60101b60 msgr2=0x7fef60197e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60101b60 0x7fef60197e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 -- 172.21.15.164:0/3910969317 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef6019fa50 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57e00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d950 tx=0x7fef4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48017070 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef6019fd40 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef48009c30 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.435+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4800f6b0 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.436+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef601a0230 con 0x7fef60102d50 2024-03-27T08:34:59.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.437+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef60108e80 con 0x7fef60102d50 2024-03-27T08:34:59.432 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.440+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fef48010a50 con 0x7fef60102d50 2024-03-27T08:34:59.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.441+0000 7fef57400640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 0x7fef440a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.442+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fef480cfa00 con 0x7fef60102d50 2024-03-27T08:34:59.433 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.442+0000 7fef5ea00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 0x7fef440a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.442+0000 7fef5ea00640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 0x7fef440a5ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fef50005fd0 tx=0x7fef50005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.437 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.446+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fef48009de0 con 0x7fef60102d50 2024-03-27T08:34:59.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.647+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fef600627f0 con 0x7fef60102d50 2024-03-27T08:34:59.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.648+0000 7fef57400640 1 -- 172.21.15.164:0/3910969317 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fef4809c5e0 con 0x7fef60102d50 2024-03-27T08:34:59.640 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.650+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 msgr2=0x7fef440a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.650+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 0x7fef440a5ad0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fef50005fd0 tx=0x7fef50005850 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.650+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 msgr2=0x7fef60198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.650+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d950 tx=0x7fef4800de10 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 shutdown_connections 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fef440a3610 0x7fef440a5ad0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fef60103710 0x7fef6019f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fef60102d50 0x7fef60198370 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 --2- 172.21.15.164:0/3910969317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef60101b60 0x7fef60197e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 >> 172.21.15.164:0/3910969317 conn(0x7fef600fd0f0 msgr2=0x7fef60106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:59.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 shutdown_connections 2024-03-27T08:34:59.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.651+0000 7fef65800640 1 -- 172.21.15.164:0/3910969317 wait complete. 2024-03-27T08:34:59.661 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 -- 172.21.15.164:0/4079486588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 msgr2=0x7f75341031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 --2- 172.21.15.164:0/4079486588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f75341031d0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7524009900 tx=0x7f752402bc30 comp rx=0 tx=0).stop 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 -- 172.21.15.164:0/4079486588 shutdown_connections 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 --2- 172.21.15.164:0/4079486588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 0x7f7534109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 --2- 172.21.15.164:0/4079486588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f75341031d0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 --2- 172.21.15.164:0/4079486588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 0x7f7534101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 -- 172.21.15.164:0/4079486588 >> 172.21.15.164:0/4079486588 conn(0x7f75340fd0f0 msgr2=0x7f75340ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 -- 172.21.15.164:0/4079486588 shutdown_connections 2024-03-27T08:34:59.857 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.865+0000 7f753c800640 1 -- 172.21.15.164:0/4079486588 wait complete. 2024-03-27T08:34:59.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 Processor -- start 2024-03-27T08:34:59.859 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 -- start start 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 0x7f7534199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 0x7f75341a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f753410d810 con 0x7f7534102d50 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f753410d690 con 0x7f7534101b60 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.866+0000 7f753c800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f753410d990 con 0x7f7534103710 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40194/0 (socket says 172.21.15.164:40194) 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 -- 172.21.15.164:0/1393272163 learned_addr learned my addr 172.21.15.164:0/1393272163 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539e00640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 0x7f7534199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f753a800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 0x7f75341a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 -- 172.21.15.164:0/1393272163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 msgr2=0x7f75341a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 0x7f75341a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 -- 172.21.15.164:0/1393272163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 msgr2=0x7f7534199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:34:59.860 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 0x7f7534199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 -- 172.21.15.164:0/1393272163 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75341a1c10 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.867+0000 7f7539400640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7524000c00 tx=0x7f7524004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.868+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524043020 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.868+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7524005460 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.868+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7524003d00 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.868+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75341a1ea0 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.868+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75341a2310 con 0x7f7534102d50 2024-03-27T08:34:59.861 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.869+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75341a2600 con 0x7f7534102d50 2024-03-27T08:34:59.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.871+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7524046020 con 0x7f7534102d50 2024-03-27T08:34:59.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.872+0000 7f752ea00640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 0x7f751c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:34:59.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.872+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f75240f1f40 con 0x7f7534102d50 2024-03-27T08:34:59.864 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.872+0000 7f7539e00640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 0x7f751c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:34:59.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.873+0000 7f7539e00640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 0x7f751c0a5b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7534102bb0 tx=0x7f7528005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:34:59.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:34:59.876+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f752404d020 con 0x7f7534102d50 2024-03-27T08:35:00.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:59 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/321167195' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:00.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:59 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/221911039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:34:59 smithi164 ceph-mon[31788]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:35:00.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.062+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f75341a2870 con 0x7f7534102d50 2024-03-27T08:35:00.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.063+0000 7f752ea00640 1 -- 172.21.15.164:0/1393272163 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f75240beac0 con 0x7f7534102d50 2024-03-27T08:35:00.054 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:35:00.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 msgr2=0x7f751c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 0x7f751c0a5b50 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7534102bb0 tx=0x7f7528005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:00.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 msgr2=0x7f753419a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.057 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7524000c00 tx=0x7f7524004e20 comp rx=0 tx=0).stop 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 shutdown_connections 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f751c0a3690 0x7f751c0a5b50 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7534103710 0x7f75341a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7534102d50 0x7f753419a530 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 --2- 172.21.15.164:0/1393272163 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7534101b60 0x7f7534199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 >> 172.21.15.164:0/1393272163 conn(0x7f75340fd0f0 msgr2=0x7f7534073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 shutdown_connections 2024-03-27T08:35:00.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.065+0000 7f753c800640 1 -- 172.21.15.164:0/1393272163 wait complete. 2024-03-27T08:35:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:59 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/321167195' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:59 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/221911039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:34:59 smithi167 ceph-mon[34903]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:35:00.074 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:35:00.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:59 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/321167195' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:00.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:59 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/221911039' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:34:59 smithi173 ceph-mon[35397]: pgmap v431: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:35:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 -- 172.21.15.164:0/3317135784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80103710 msgr2=0x7f0d80109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 --2- 172.21.15.164:0/3317135784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80103710 0x7f0d80109fa0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f0d78009ca0 tx=0x7f0d7802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 -- 172.21.15.164:0/3317135784 shutdown_connections 2024-03-27T08:35:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 --2- 172.21.15.164:0/3317135784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80103710 0x7f0d80109fa0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 --2- 172.21.15.164:0/3317135784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80102d50 0x7f0d801031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 --2- 172.21.15.164:0/3317135784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 0x7f0d80101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 -- 172.21.15.164:0/3317135784 >> 172.21.15.164:0/3317135784 conn(0x7f0d800fd0f0 msgr2=0x7f0d800ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:00.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 -- 172.21.15.164:0/3317135784 shutdown_connections 2024-03-27T08:35:00.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.283+0000 7f0d88400640 1 -- 172.21.15.164:0/3317135784 wait complete. 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 Processor -- start 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 -- start start 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 0x7f0d80199fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80103710 0x7f0d801a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8010d7b0 con 0x7f0d80102d50 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8010d630 con 0x7f0d80101b60 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.284+0000 7f0d88400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0d8010d930 con 0x7f0d80103710 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40216/0 (socket says 172.21.15.164:40216) 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 -- 172.21.15.164:0/3221041467 learned_addr learned my addr 172.21.15.164:0/3221041467 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:00.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85a00640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 0x7f0d80199fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d86400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80103710 0x7f0d801a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 -- 172.21.15.164:0/3221041467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80103710 msgr2=0x7f0d801a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80103710 0x7f0d801a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 -- 172.21.15.164:0/3221041467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 msgr2=0x7f0d80199fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 0x7f0d80199fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 -- 172.21.15.164:0/3221041467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d801a1c00 con 0x7f0d80102d50 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.285+0000 7f0d85000640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.286+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c017070 con 0x7f0d80102d50 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.286+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0d6c009c30 con 0x7f0d80102d50 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.286+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d6c00f6b0 con 0x7f0d80102d50 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.286+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d801a1ef0 con 0x7f0d80102d50 2024-03-27T08:35:00.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.286+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d801a2400 con 0x7f0d80102d50 2024-03-27T08:35:00.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.287+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d801a2630 con 0x7f0d80102d50 2024-03-27T08:35:00.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.290+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f0d6c010a50 con 0x7f0d80102d50 2024-03-27T08:35:00.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.291+0000 7f0d7e000640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 0x7f0d680a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.291+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0d6c0cf9f0 con 0x7f0d80102d50 2024-03-27T08:35:00.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.291+0000 7f0d85a00640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 0x7f0d680a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.292+0000 7f0d85a00640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 0x7f0d680a5b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d80102bb0 tx=0x7f0d74005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:00.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.295+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f0d6c009de0 con 0x7f0d80102d50 2024-03-27T08:35:00.526 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.535+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0d801a2800 con 0x7f0d80102d50 2024-03-27T08:35:00.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.537+0000 7f0d7e000640 1 -- 172.21.15.164:0/3221041467 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11888 (secure 0 0 0) 0x7f0d6c09c570 con 0x7f0d80102d50 2024-03-27T08:35:00.529 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:00.529 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:32:51.674097+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:35:00.529 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 23 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.539+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 msgr2=0x7f0d680a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.539+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 0x7f0d680a5b50 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0d80102bb0 tx=0x7f0d74005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 msgr2=0x7f0d8019a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0d6c00d950 tx=0x7f0d6c00de10 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 shutdown_connections 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0d680a3690 0x7f0d680a5b50 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0d80103710 0x7f0d801a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0d80102d50 0x7f0d8019a520 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 --2- 172.21.15.164:0/3221041467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d80101b60 0x7f0d80199fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 >> 172.21.15.164:0/3221041467 conn(0x7f0d800fd0f0 msgr2=0x7f0d80073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 shutdown_connections 2024-03-27T08:35:00.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.540+0000 7f0d88400640 1 -- 172.21.15.164:0/3221041467 wait complete. 2024-03-27T08:35:00.551 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:35:00.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 -- 172.21.15.164:0/763276625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00103d90 msgr2=0x7f4a001041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 --2- 172.21.15.164:0/763276625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00103d90 0x7f4a001041b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f49f0009900 tx=0x7f49f002bc40 comp rx=0 tx=0).stop 2024-03-27T08:35:00.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 -- 172.21.15.164:0/763276625 shutdown_connections 2024-03-27T08:35:00.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 --2- 172.21.15.164:0/763276625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 0x7f4a0010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.755 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 --2- 172.21.15.164:0/763276625 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00104f80 0x7f4a00105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 --2- 172.21.15.164:0/763276625 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00103d90 0x7f4a001041b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 -- 172.21.15.164:0/763276625 >> 172.21.15.164:0/763276625 conn(0x7f4a000ff300 msgr2=0x7f4a00101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:00.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 -- 172.21.15.164:0/763276625 shutdown_connections 2024-03-27T08:35:00.756 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.763+0000 7f4a05400640 1 -- 172.21.15.164:0/763276625 wait complete. 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 Processor -- start 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 -- start start 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00103d90 0x7f4a0019a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 0x7f4a001a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0010f9f0 con 0x7f4a00104f80 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0010f870 con 0x7f4a00105940 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.764+0000 7f4a05400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4a0010fb70 con 0x7f4a00103d90 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.758 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40226/0 (socket says 172.21.15.164:40226) 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 -- 172.21.15.164:0/4011124298 learned_addr learned my addr 172.21.15.164:0/4011124298 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49ff200640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 0x7f4a001a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49fe800640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00103d90 0x7f4a0019a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 -- 172.21.15.164:0/4011124298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00103d90 msgr2=0x7f4a0019a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00103d90 0x7f4a0019a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 -- 172.21.15.164:0/4011124298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 msgr2=0x7f4a001a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 0x7f4a001a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 -- 172.21.15.164:0/4011124298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a001a1ca0 con 0x7f4a00104f80 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.765+0000 7f49f7e00640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d950 tx=0x7f49e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.766+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e8017070 con 0x7f4a00104f80 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.766+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f49e8009c30 con 0x7f4a00104f80 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.766+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a001a1f90 con 0x7f4a00104f80 2024-03-27T08:35:00.759 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.766+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49e800f6b0 con 0x7f4a00104f80 2024-03-27T08:35:00.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.766+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a001a2450 con 0x7f4a00104f80 2024-03-27T08:35:00.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.767+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a0010b130 con 0x7f4a00104f80 2024-03-27T08:35:00.760 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.769+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f49e8010a50 con 0x7f4a00104f80 2024-03-27T08:35:00.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.770+0000 7f49f7400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 0x7f49e40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:00.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.770+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f49e80cf8c0 con 0x7f4a00104f80 2024-03-27T08:35:00.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.771+0000 7f49fe800640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 0x7f49e40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:00.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.771+0000 7f49fe800640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 0x7f49e40a5ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006010 tx=0x7f49f002df90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:00.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.773+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f49e8009de0 con 0x7f4a00104f80 2024-03-27T08:35:00.951 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.960+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a000627f0 con 0x7f4a00104f80 2024-03-27T08:35:00.956 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.964+0000 7f49f7400640 1 -- 172.21.15.164:0/4011124298 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f49e809c4a0 con 0x7f4a00104f80 2024-03-27T08:35:00.956 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:00.957 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 msgr2=0x7f49e40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 0x7f49e40a5ad0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f49f0006010 tx=0x7f49f002df90 comp rx=0 tx=0).stop 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 msgr2=0x7f4a0019a5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f49e800d950 tx=0x7f49e800de10 comp rx=0 tx=0).stop 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 shutdown_connections 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49e40a3610 0x7f49e40a5ad0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a00105940 0x7f4a001a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4a00104f80 0x7f4a0019a5c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 --2- 172.21.15.164:0/4011124298 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4a00103d90 0x7f4a0019a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:00.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 >> 172.21.15.164:0/4011124298 conn(0x7f4a000ff300 msgr2=0x7f4a00108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:00.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 shutdown_connections 2024-03-27T08:35:00.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:00.967+0000 7f4a05400640 1 -- 172.21.15.164:0/4011124298 wait complete. 2024-03-27T08:35:00.974 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3910969317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.974 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1393272163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.974 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:00 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3221041467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:00.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3910969317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1393272163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:00.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:00 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3221041467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:00.978 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-03-27T08:32:46.030344+0000', 'modified': '2024-03-27T08:32:51.674097+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 34502, 'mds_1': 34463, 'mds_2': 34430}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24448': {'gid': 24448, 'name': 'c', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6837/3514225451', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6836', 'nonce': 3514225451}, {'type': 'v1', 'addr': '172.21.15.173:6837', 'nonce': 3514225451}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.173:6839/2691398042', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.173:6838', 'nonce': 2691398042}, {'type': 'v1', 'addr': '172.21.15.173:6839', 'nonce': 2691398042}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34403': {'gid': 34403, 'name': 'k', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6833/2990296948', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6832', 'nonce': 2990296948}, {'type': 'v1', 'addr': '172.21.15.167:6833', 'nonce': 2990296948}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34430': {'gid': 34430, 'name': 'e', 'rank': 2, 'incarnation': 21, 'state': 'up:active', 'state_seq': 11, 'addr': '172.21.15.167:6835/2127625535', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 2127625535}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 2127625535}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34463': {'gid': 34463, 'name': 'h', 'rank': 1, 'incarnation': 19, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6837/3651037274', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 3651037274}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 3651037274}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34502': {'gid': 34502, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.167:6839/2821873023', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 2821873023}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 2821873023}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34502, 'qdb_cluster': [34430, 34463, 34502]} 2024-03-27T08:35:00.979 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-03-27T08:35:00.979 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-03-27T08:35:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3910969317' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1393272163' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:00 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3221041467' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:01.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 -- 172.21.15.164:0/288678600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 msgr2=0x7fadc410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 --2- 172.21.15.164:0/288678600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc410c1d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009860 tx=0x7fadbc02bb70 comp rx=0 tx=0).stop 2024-03-27T08:35:01.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 -- 172.21.15.164:0/288678600 shutdown_connections 2024-03-27T08:35:01.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 --2- 172.21.15.164:0/288678600 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc410c1d0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 --2- 172.21.15.164:0/288678600 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc4105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 --2- 172.21.15.164:0/288678600 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 0x7fadc41041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 -- 172.21.15.164:0/288678600 >> 172.21.15.164:0/288678600 conn(0x7fadc40ff300 msgr2=0x7fadc4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 -- 172.21.15.164:0/288678600 shutdown_connections 2024-03-27T08:35:01.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.198+0000 7fadcc400640 1 -- 172.21.15.164:0/288678600 wait complete. 2024-03-27T08:35:01.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.199+0000 7fadcc400640 1 Processor -- start 2024-03-27T08:35:01.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 -- start start 2024-03-27T08:35:01.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 0x7fadc419a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410f9f0 con 0x7fadc4105940 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410f870 con 0x7fadc4104f80 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadcc400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410fb70 con 0x7fadc4103d90 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadca400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadca400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40242/0 (socket says 172.21.15.164:40242) 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.200+0000 7fadca400640 1 -- 172.21.15.164:0/112958664 learned_addr learned my addr 172.21.15.164:0/112958664 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc9000640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc9a00640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 0x7fadc419a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 -- 172.21.15.164:0/112958664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 msgr2=0x7fadc419a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 0x7fadc419a060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 -- 172.21.15.164:0/112958664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 msgr2=0x7fadc419a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc419a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 -- 172.21.15.164:0/112958664 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc41a1c80 con 0x7fadc4105940 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc9000640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadca400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02c0b0 tx=0x7fadbc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc2000640 1 -- 172.21.15.164:0/112958664 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc039050 con 0x7fadc4105940 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc2000640 1 -- 172.21.15.164:0/112958664 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadbc03a040 con 0x7fadc4105940 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.201+0000 7fadc2000640 1 -- 172.21.15.164:0/112958664 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0406b0 con 0x7fadc4105940 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.202+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc41a1f10 con 0x7fadc4105940 2024-03-27T08:35:01.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.202+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc41a23d0 con 0x7fadc4105940 2024-03-27T08:35:01.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.205+0000 7fadcf1e4740 1 Processor -- start 2024-03-27T08:35:01.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.205+0000 7fadc2000640 1 -- 172.21.15.164:0/112958664 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fadbc003810 con 0x7fadc4105940 2024-03-27T08:35:01.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.205+0000 7fadcf1e4740 1 -- start start 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb16065410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb16067f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb16022920 con 0x55eb1605ff20 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb15f72fa0 con 0x55eb16065a80 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb15fc4f90 con 0x55eb16060910 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40248/0 (socket says 172.21.15.164:40248) 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 -- 172.21.15.164:0/3319845693 learned_addr learned my addr 172.21.15.164:0/3319845693 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 -- 172.21.15.164:0/3319845693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 msgr2=0x55eb16065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb16065410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.199 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 -- 172.21.15.164:0/3319845693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 msgr2=0x55eb16067f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb16067f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.206+0000 7fadc9000640 1 -- 172.21.15.164:0/3319845693 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb15cd92d0 con 0x55eb1605ff20 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadc9000640 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009d90 tx=0x7fadb00137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13993c1a940d44ea server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadb6a00640 1 -- 172.21.15.164:0/3319845693 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb000f440 con 0x55eb1605ff20 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadb6a00640 1 -- 172.21.15.164:0/3319845693 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadb0017030 con 0x55eb1605ff20 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadc2000640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 0x7fadac0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadb6a00640 1 -- 172.21.15.164:0/3319845693 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb0011800 con 0x55eb1605ff20 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadc2000640 1 -- 172.21.15.164:0/112958664 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fadbc0f1970 con 0x7fadc4105940 2024-03-27T08:35:01.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.207+0000 7fadc9a00640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 0x7fadac0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- 172.21.15.164:0/3319845693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 msgr2=0x55eb16060340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fadb0009d90 tx=0x7fadb00137d0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- 172.21.15.164:0/3319845693 shutdown_connections 2024-03-27T08:35:01.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb16067f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb16065410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/3319845693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16060340 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- 172.21.15.164:0/3319845693 >> 172.21.15.164:0/3319845693 conn(0x55eb1605b490 msgr2=0x55eb1605b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadc9a00640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 0x7fadac0a5b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55eb16060d10 tx=0x7fadb8009c60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- 172.21.15.164:0/3319845693 shutdown_connections 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- 172.21.15.164:0/3319845693 wait complete. 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.208+0000 7fadcf1e4740 1 -- start start 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 Processor -- start 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb1605ff20 0x55eb1606a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb1606a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb15fc0f40 con 0x55eb16065a80 2024-03-27T08:35:01.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb15f6d650 con 0x55eb1605ff20 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb15f80a10 con 0x55eb16060910 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadcf1e4740 10 client.0 _ll_register_callbacks cb 0x55eb15fbfff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadca400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadca400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40250/0 (socket says 172.21.15.164:40250) 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.209+0000 7fadca400640 1 -- 172.21.15.164:0/4216426167 learned_addr learned my addr 172.21.15.164:0/4216426167 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadc9a00640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb1605ff20 0x55eb1606a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadc9000640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb1606a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 -- 172.21.15.164:0/4216426167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 msgr2=0x55eb1606a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb1606a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 -- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb1605ff20 msgr2=0x55eb1606a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb1605ff20 0x55eb1606a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 -- 172.21.15.164:0/4216426167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb15da36b0 con 0x55eb16065a80 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadc9000640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb1606a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:01.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadca400640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0bde10 tx=0x7fadbc0bd8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad4f33e22074644a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadab400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0c6a60 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fadbc0be0e0 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb0017030 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fadbc0be2e0 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadcf1e4740 10 client.15231 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.210+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55eb16074b70 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadb0017030 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fadbc0c4560 con 0x55eb16065a80 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 10 client.15231 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 10 client.15231 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 20 client.15231 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160772c0 0x55eb16078730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 4 client.15231 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:01.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb15fd24d0 con 0x55eb160772c0 2024-03-27T08:35:01.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.211+0000 7fadc9a00640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160772c0 0x55eb16078730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.212+0000 7fadc9a00640 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160772c0 0x55eb16078730 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8b701bb6acd338b server_cookie=1c2e5b265e0b6b30 in_seq=0 out_seq=0 2024-03-27T08:35:01.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.212+0000 7fadab400640 10 client.15231 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadab400640 1 -- 172.21.15.164:0/4216426167 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55eb15fd24d0 con 0x55eb160772c0 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadab400640 10 client.15231 handle_command_reply: tid=0 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 client.15231 shutdown 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 msgr2=0x55eb16071800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0bde10 tx=0x7fadbc0bd8a0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 shutdown_connections 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160772c0 0x55eb16078730 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16065a80 0x55eb16071800 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb1606a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/4216426167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb1605ff20 0x55eb1606a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadab400640 0 client.15231 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:01.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.214+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 >> 172.21.15.164:0/4216426167 conn(0x55eb1605b490 msgr2=0x55eb1605a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.215+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 shutdown_connections 2024-03-27T08:35:01.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.215+0000 7fadcf1e4740 1 -- 172.21.15.164:0/4216426167 wait complete. 2024-03-27T08:35:01.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.215+0000 7fadcf1e4740 20 client.15231 trim_cache size 0 max 16384 2024-03-27T08:35:01.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 Processor -- start 2024-03-27T08:35:01.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 -- start start 2024-03-27T08:35:01.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb160717c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160691c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.234+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb16076a70 con 0x55eb1605ff20 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb16077140 con 0x55eb16065a80 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb16077810 con 0x55eb16060910 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40266/0 (socket says 172.21.15.164:40266) 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 -- 172.21.15.164:0/773824508 learned_addr learned my addr 172.21.15.164:0/773824508 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadca400640 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160691c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9000640 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb160717c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 -- 172.21.15.164:0/773824508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 msgr2=0x55eb160717c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb160717c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 -- 172.21.15.164:0/773824508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 msgr2=0x55eb160691c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160691c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 -- 172.21.15.164:0/773824508 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb1605c200 con 0x55eb1605ff20 2024-03-27T08:35:01.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.235+0000 7fadc9a00640 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fadb8010010 tx=0x7fadb8009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ff2377e6e6b918d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadb6000640 1 -- 172.21.15.164:0/773824508 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb802c030 con 0x55eb1605ff20 2024-03-27T08:35:01.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadb6000640 1 -- 172.21.15.164:0/773824508 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadb80303c0 con 0x55eb1605ff20 2024-03-27T08:35:01.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadb6000640 1 -- 172.21.15.164:0/773824508 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb8027390 con 0x55eb1605ff20 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 -- 172.21.15.164:0/773824508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 msgr2=0x55eb16068c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fadb8010010 tx=0x7fadb8009f90 comp rx=0 tx=0).stop 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 -- 172.21.15.164:0/773824508 shutdown_connections 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160691c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb16060910 0x55eb160717c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/773824508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb1605ff20 0x55eb16068c80 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.236+0000 7fadcf1e4740 1 -- 172.21.15.164:0/773824508 >> 172.21.15.164:0/773824508 conn(0x55eb1605b490 msgr2=0x55eb1605b870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 -- 172.21.15.164:0/773824508 shutdown_connections 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 -- 172.21.15.164:0/773824508 wait complete. 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 -- start start 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 Processor -- start 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 0x55eb1606d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.237+0000 7fadcf1e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160705b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb160785b0 con 0x55eb16060910 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb16077ee0 con 0x55eb16065a80 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadcf1e4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb16078c80 con 0x55eb1605ff20 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadcf1e4740 10 client.0 _ll_register_callbacks cb 0x7fadbc005a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40278/0 (socket says 172.21.15.164:40278) 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 -- 172.21.15.164:0/238968882 learned_addr learned my addr 172.21.15.164:0/238968882 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9a00640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 0x55eb1606d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadca400640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160705b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 -- 172.21.15.164:0/238968882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 msgr2=0x55eb1606d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 0x55eb1606d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 -- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 msgr2=0x55eb160705b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160705b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 -- 172.21.15.164:0/238968882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb16070ba0 con 0x55eb16060910 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9a00640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 0x55eb1606d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadc9000640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55eb16061170 tx=0x7fadb0013380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=789b9bd5fdbb51d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.238+0000 7fadab400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadb00054c0 con 0x55eb16060910 2024-03-27T08:35:01.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadb80303c0 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fadb00035f0 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fadb0009a00 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 10 client.15237 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55eb160e5a80 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadb80303c0 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7fadb00119a0 con 0x55eb16060910 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 10 client.15237 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 10 client.15237 resolve_mds: resolved name 'e' to daemon mds.e 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 20 client.15237 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160ea470 0x55eb160e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 4 client.15237 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:35:01.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.239+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "status"}) -- 0x55eb15fcc820 con 0x55eb160ea470 2024-03-27T08:35:01.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.240+0000 7fadc9a00640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160ea470 0x55eb160e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.241+0000 7fadc9a00640 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160ea470 0x55eb160e68b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9f7ffb071875d5d2 server_cookie=e6b5acb9a7ea98e8 in_seq=0 out_seq=0 2024-03-27T08:35:01.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.241+0000 7fadab400640 10 client.15237 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.241+0000 7fadab400640 1 -- 172.21.15.164:0/238968882 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x55eb15fcc820 con 0x55eb160ea470 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.241+0000 7fadab400640 10 client.15237 handle_command_reply: tid=0 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.241+0000 7fadcf1e4740 1 client.15237 shutdown 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 msgr2=0x55eb1606d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x55eb16061170 tx=0x7fadb0013380 comp rx=0 tx=0).stop 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 shutdown_connections 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb16065a80 0x55eb160705b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.237 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55eb160ea470 0x55eb160e68b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb16060910 0x55eb1606d590 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 --2- 172.21.15.164:0/238968882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb1605ff20 0x55eb1606d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 >> 172.21.15.164:0/238968882 conn(0x55eb1605b490 msgr2=0x55eb16068c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadab400640 0 client.15237 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 shutdown_connections 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 1 -- 172.21.15.164:0/238968882 wait complete. 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcf1e4740 20 client.15237 trim_cache size 0 max 16384 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:35:01.238 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 2, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34430, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 130.03875101, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 167.759704376 2024-03-27T08:35:01.239 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 msgr2=0x7fadac0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 0x7fadac0a5b50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55eb16060d10 tx=0x7fadb8009c60 comp rx=0 tx=0).stop 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 msgr2=0x7fadc41a1610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.242+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fadbc02c0b0 tx=0x7fadbc004270 comp rx=0 tx=0).stop 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 shutdown_connections 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fadac0a3690 0x7fadac0a5b50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fadc4105940 0x7fadc41a1610 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadc4104f80 0x7fadc419a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 --2- 172.21.15.164:0/112958664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fadc4103d90 0x7fadc419a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 >> 172.21.15.164:0/112958664 conn(0x7fadc40ff300 msgr2=0x7fadc4108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 shutdown_connections 2024-03-27T08:35:01.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.243+0000 7fadcc400640 1 -- 172.21.15.164:0/112958664 wait complete. 2024-03-27T08:35:01.251 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.h status 2024-03-27T08:35:01.456 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.464+0000 7fab06400640 1 -- 172.21.15.164:0/620479020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00104f80 msgr2=0x7fab00105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.464+0000 7fab06400640 1 --2- 172.21.15.164:0/620479020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00104f80 0x7fab00105400 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7faaec009900 tx=0x7faaec02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.464+0000 7fab06400640 1 -- 172.21.15.164:0/620479020 shutdown_connections 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 --2- 172.21.15.164:0/620479020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00105940 0x7fab0010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 --2- 172.21.15.164:0/620479020 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00104f80 0x7fab00105400 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 --2- 172.21.15.164:0/620479020 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab001041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 -- 172.21.15.164:0/620479020 >> 172.21.15.164:0/620479020 conn(0x7fab000ff300 msgr2=0x7fab00101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 -- 172.21.15.164:0/620479020 shutdown_connections 2024-03-27T08:35:01.457 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.465+0000 7fab06400640 1 -- 172.21.15.164:0/620479020 wait complete. 2024-03-27T08:35:01.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 Processor -- start 2024-03-27T08:35:01.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 -- start start 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab0019a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 0x7fab0019a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010fa00 con 0x7fab00105940 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010f880 con 0x7fab00104f80 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7fab06400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fab0010fb80 con 0x7fab00103d90 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40296/0 (socket says 172.21.15.164:40296) 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.466+0000 7faaffe00640 1 -- 172.21.15.164:0/523736811 learned_addr learned my addr 172.21.15.164:0/523736811 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faafea00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 0x7fab0019a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaff400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab0019a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 -- 172.21.15.164:0/523736811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 msgr2=0x7fab0019a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab0019a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 -- 172.21.15.164:0/523736811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 msgr2=0x7fab0019a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 0x7fab0019a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 -- 172.21.15.164:0/523736811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab001a1ce0 con 0x7fab00105940 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faafea00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 0x7fab0019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaff400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab0019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaffe00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faaf800eaa0 tx=0x7faaf800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaf7e00640 1 -- 172.21.15.164:0/523736811 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf800cdb0 con 0x7fab00105940 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaf7e00640 1 -- 172.21.15.164:0/523736811 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faaf8005020 con 0x7fab00105940 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7faaf7e00640 1 -- 172.21.15.164:0/523736811 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf80116b0 con 0x7fab00105940 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.467+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab001a1fd0 con 0x7fab00105940 2024-03-27T08:35:01.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.468+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab001a2440 con 0x7fab00105940 2024-03-27T08:35:01.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.471+0000 7faaf7e00640 1 -- 172.21.15.164:0/523736811 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7faaf80051d0 con 0x7fab00105940 2024-03-27T08:35:01.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.471+0000 7fab091c1740 1 Processor -- start 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.471+0000 7fab091c1740 1 -- start start 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f5098340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f509da80 0x55c9f509ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c9f505a920 con 0x55c9f5098910 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c9f4faafa0 con 0x55c9f5097f20 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7fab091c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9f4ffcf90 con 0x55c9f509da80 2024-03-27T08:35:01.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7faaff400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7faaff400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40304/0 (socket says 172.21.15.164:40304) 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7faaff400640 1 -- 172.21.15.164:0/4080596631 learned_addr learned my addr 172.21.15.164:0/4080596631 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.472+0000 7faafea00640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f5098340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faafea00640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f509da80 0x55c9f509ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 -- 172.21.15.164:0/4080596631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f509da80 msgr2=0x55c9f509ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f509da80 0x55c9f509ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 -- 172.21.15.164:0/4080596631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 msgr2=0x55c9f5098340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f5098340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 -- 172.21.15.164:0/4080596631 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f4d112d0 con 0x55c9f5098910 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faafea00640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f5098340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaf7e00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 0x7faae40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaf7e00640 1 -- 172.21.15.164:0/523736811 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7faaf80cffe0 con 0x7fab00105940 2024-03-27T08:35:01.466 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaff400640 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faaf000bd30 tx=0x7faaf000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a783291a8a0b79a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faafea00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 0x7faae40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaf4c00640 1 -- 172.21.15.164:0/4080596631 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0015070 con 0x55c9f5098910 2024-03-27T08:35:01.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaf4c00640 1 -- 172.21.15.164:0/4080596631 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faaf000be20 con 0x55c9f5098910 2024-03-27T08:35:01.467 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.473+0000 7faaf4c00640 1 -- 172.21.15.164:0/4080596631 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0011a70 con 0x55c9f5098910 2024-03-27T08:35:01.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 -- 172.21.15.164:0/4080596631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 msgr2=0x55c9f509d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7faafea00640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 0x7faae40a5b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab0019b5d0 tx=0x7faaec02bc30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7faaf000bd30 tx=0x7faaf000f730 comp rx=0 tx=0).stop 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 -- 172.21.15.164:0/4080596631 shutdown_connections 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f509da80 0x55c9f509ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5098910 0x55c9f509d410 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 --2- 172.21.15.164:0/4080596631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f5098340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 -- 172.21.15.164:0/4080596631 >> 172.21.15.164:0/4080596631 conn(0x55c9f5093490 msgr2=0x55c9f5093890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 -- 172.21.15.164:0/4080596631 shutdown_connections 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.474+0000 7fab091c1740 1 -- 172.21.15.164:0/4080596631 wait complete. 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 -- start start 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 Processor -- start 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5097f20 0x55c9f50a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5098910 0x55c9f50a2610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.471 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.475+0000 7fab091c1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c9f4ff8f40 con 0x55c9f509da80 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7fab091c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c9f4fa5650 con 0x55c9f5098910 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7fab091c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9f4fb8a10 con 0x55c9f5097f20 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7fab091c1740 10 client.0 _ll_register_callbacks cb 0x55c9f4ff7ff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40306/0 (socket says 172.21.15.164:40306) 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 -- 172.21.15.164:0/2201250117 learned_addr learned my addr 172.21.15.164:0/2201250117 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faafea00640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5098910 0x55c9f50a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaff400640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5097f20 0x55c9f50a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 -- 172.21.15.164:0/2201250117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5097f20 msgr2=0x55c9f50a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5097f20 0x55c9f50a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 -- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5098910 msgr2=0x55c9f50a2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5098910 0x55c9f50a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 -- 172.21.15.164:0/2201250117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f4ddb6b0 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faaffe00640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faaf80a4bc0 tx=0x7faaf8005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a72e7f6f23321 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.476+0000 7faae9600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf80b5060 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7faaf809bad0 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf000be20 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faaf801f040 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 10 client.15249 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c9f50aca30 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faaf000be20 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7faaf807c020 con 0x55c9f509da80 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 10 client.15249 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 10 client.15249 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 20 client.15249 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f50af0b0 0x55c9f50b0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 4 client.15249 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:01.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.477+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c9f500a4d0 con 0x55c9f50af0b0 2024-03-27T08:35:01.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.478+0000 7faaff400640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f50af0b0 0x55c9f50b0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.479+0000 7faaff400640 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f50af0b0 0x55c9f50b0520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cbb879b7c99f76ff server_cookie=6aa445b7e32b04d2 in_seq=0 out_seq=0 2024-03-27T08:35:01.474 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.479+0000 7faae9600640 10 client.15249 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7faae9600640 1 -- 172.21.15.164:0/2201250117 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c9f500a4d0 con 0x55c9f50af0b0 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7faae9600640 10 client.15249 handle_command_reply: tid=0 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 client.15249 shutdown 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 msgr2=0x55c9f50a9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7faaf80a4bc0 tx=0x7faaf8005710 comp rx=0 tx=0).stop 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 shutdown_connections 2024-03-27T08:35:01.475 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f50af0b0 0x55c9f50b0520 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a9650 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5098910 0x55c9f50a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 --2- 172.21.15.164:0/2201250117 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5097f20 0x55c9f50a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 >> 172.21.15.164:0/2201250117 conn(0x55c9f5093490 msgr2=0x55c9f5092690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7faae9600640 0 client.15249 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 shutdown_connections 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 1 -- 172.21.15.164:0/2201250117 wait complete. 2024-03-27T08:35:01.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.481+0000 7fab091c1740 20 client.15249 trim_cache size 0 max 16384 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.501+0000 7fab091c1740 1 Processor -- start 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 -- start start 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a9610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 0x55c9f50a2220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50ae860 con 0x55c9f5097f20 2024-03-27T08:35:01.494 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50aef30 con 0x55c9f509da80 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7fab091c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50af600 con 0x55c9f5098910 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40308/0 (socket says 172.21.15.164:40308) 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 -- 172.21.15.164:0/3336244175 learned_addr learned my addr 172.21.15.164:0/3336244175 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaffe00640 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 0x55c9f50a2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 -- 172.21.15.164:0/3336244175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 msgr2=0x55c9f50a9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 -- 172.21.15.164:0/3336244175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 msgr2=0x55c9f50a2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 0x55c9f50a2220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaff400640 1 -- 172.21.15.164:0/3336244175 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c9f50a14e0 con 0x55c9f5097f20 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.502+0000 7faaffe00640 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 0x55c9f50a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:01.495 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.503+0000 7faaff400640 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faaf000fc30 tx=0x7faaf000bfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83101c11210721e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.503+0000 7faaebe00640 1 -- 172.21.15.164:0/3336244175 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf0015040 con 0x55c9f5097f20 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.503+0000 7faaebe00640 1 -- 172.21.15.164:0/3336244175 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faaf0004340 con 0x55c9f5097f20 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.503+0000 7faaebe00640 1 -- 172.21.15.164:0/3336244175 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf00048e0 con 0x55c9f5097f20 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- 172.21.15.164:0/3336244175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 msgr2=0x55c9f50a1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7faaf000fc30 tx=0x7faaf000bfb0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- 172.21.15.164:0/3336244175 shutdown_connections 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f509da80 0x55c9f50a2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 --2- 172.21.15.164:0/3336244175 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f5097f20 0x55c9f50a1ce0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- 172.21.15.164:0/3336244175 >> 172.21.15.164:0/3336244175 conn(0x55c9f5093490 msgr2=0x55c9f5099dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- 172.21.15.164:0/3336244175 shutdown_connections 2024-03-27T08:35:01.499 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- 172.21.15.164:0/3336244175 wait complete. 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 -- start start 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.504+0000 7fab091c1740 1 Processor -- start 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f50a8e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50b03a0 con 0x55c9f509da80 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50afcd0 con 0x55c9f5097f20 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c9f50b0a70 con 0x55c9f5098910 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7fab091c1740 10 client.0 _ll_register_callbacks cb 0x7faaf8098060 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40316/0 (socket says 172.21.15.164:40316) 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 -- 172.21.15.164:0/538134096 learned_addr learned my addr 172.21.15.164:0/538134096 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaff400640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f50a8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 -- 172.21.15.164:0/538134096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 msgr2=0x55c9f50a93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 -- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 msgr2=0x55c9f50a8e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f50a8e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.505+0000 7faaffe00640 1 -- 172.21.15.164:0/538134096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c9f50a5fa0 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faaffe00640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faaf80d0280 tx=0x7faaf80a19c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc7aac04417ed553 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faaf80b5040 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7faaf80981d0 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faaf0004340 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7faaf809bde0 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7fab091c1740 10 client.15255 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55c9f511e180 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7faaf0004340 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7faaf807c050 con 0x55c9f509da80 2024-03-27T08:35:01.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.506+0000 7fab091c1740 10 client.15255 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7fab091c1740 10 client.15255 resolve_mds: resolved name 'h' to daemon mds.h 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7fab091c1740 20 client.15255 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f5122de0 0x55c9f5121af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7fab091c1740 4 client.15255 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "status"}) -- 0x55c9f5004820 con 0x55c9f5122de0 2024-03-27T08:35:01.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.507+0000 7faaff400640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f5122de0 0x55c9f5121af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7faaff400640 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f5122de0 0x55c9f5121af0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dfacefe726c44558 server_cookie=9cfe243b6e035847 in_seq=0 out_seq=0 2024-03-27T08:35:01.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7faae9600640 10 client.15255 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:01.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7faae9600640 1 -- 172.21.15.164:0/538134096 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55c9f5004820 con 0x55c9f5122de0 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7faae9600640 10 client.15255 handle_command_reply: tid=0 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 client.15255 shutdown 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 msgr2=0x55c9f50a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faaf80d0280 tx=0x7faaf80a19c0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 shutdown_connections 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55c9f5122de0 0x55c9f5121af0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c9f509da80 0x55c9f50a5900 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7faae9600640 0 client.15255 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c9f5098910 0x55c9f50a93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 --2- 172.21.15.164:0/538134096 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c9f5097f20 0x55c9f50a8e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 >> 172.21.15.164:0/538134096 conn(0x55c9f5093490 msgr2=0x55c9f50a1ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 shutdown_connections 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 1 -- 172.21.15.164:0/538134096 wait complete. 2024-03-27T08:35:01.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.508+0000 7fab091c1740 20 client.15255 trim_cache size 0 max 16384 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 1, 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34463, 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 131.31853773500001, 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:35:01.505 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 156.00489896900001 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 msgr2=0x7faae40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 0x7faae40a5b50 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab0019b5d0 tx=0x7faaec02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 msgr2=0x7fab001a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.506 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7faaf800eaa0 tx=0x7faaf800ef60 comp rx=0 tx=0).stop 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 shutdown_connections 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7faae40a3690 0x7faae40a5b50 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fab00105940 0x7fab001a1670 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fab00104f80 0x7fab0019a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 --2- 172.21.15.164:0/523736811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fab00103d90 0x7fab0019a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 >> 172.21.15.164:0/523736811 conn(0x7fab000ff300 msgr2=0x7fab00108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 shutdown_connections 2024-03-27T08:35:01.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.509+0000 7fab06400640 1 -- 172.21.15.164:0/523736811 wait complete. 2024-03-27T08:35:01.518 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.734+0000 7efd1b200640 1 -- 172.21.15.164:0/1917666409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c0ff560 msgr2=0x7efd1c0ff960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.734+0000 7efd1b200640 1 --2- 172.21.15.164:0/1917666409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c0ff560 0x7efd1c0ff960 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009ca0 tx=0x7efd0c02c100 comp rx=0 tx=0).stop 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 -- 172.21.15.164:0/1917666409 shutdown_connections 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 --2- 172.21.15.164:0/1917666409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c107670 0x7efd1c109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 --2- 172.21.15.164:0/1917666409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 0x7efd1c107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 --2- 172.21.15.164:0/1917666409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c0ff560 0x7efd1c0ff960 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 -- 172.21.15.164:0/1917666409 >> 172.21.15.164:0/1917666409 conn(0x7efd1c0fb100 msgr2=0x7efd1c0fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 -- 172.21.15.164:0/1917666409 shutdown_connections 2024-03-27T08:35:01.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.735+0000 7efd1b200640 1 -- 172.21.15.164:0/1917666409 wait complete. 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 Processor -- start 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 -- start start 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c0ff560 0x7efd1c199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 0x7efd1c19a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10d610 con 0x7efd1c107670 2024-03-27T08:35:01.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10d490 con 0x7efd1c0fff50 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1b200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7efd1c10d790 con 0x7efd1c0ff560 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1a800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40332/0 (socket says 172.21.15.164:40332) 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd1a800640 1 -- 172.21.15.164:0/695412595 learned_addr learned my addr 172.21.15.164:0/695412595 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.736+0000 7efd11400640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 0x7efd1c19a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd19e00640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c0ff560 0x7efd1c199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 -- 172.21.15.164:0/695412595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c0ff560 msgr2=0x7efd1c199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c0ff560 0x7efd1c199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 -- 172.21.15.164:0/695412595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 msgr2=0x7efd1c19a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 0x7efd1c19a3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 -- 172.21.15.164:0/695412595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd1c1a1ac0 con 0x7efd1c107670 2024-03-27T08:35:01.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1a800640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd14009fd0 tx=0x7efd1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd13400640 1 -- 172.21.15.164:0/695412595 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd14011830 con 0x7efd1c107670 2024-03-27T08:35:01.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd13400640 1 -- 172.21.15.164:0/695412595 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efd14016070 con 0x7efd1c107670 2024-03-27T08:35:01.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd1c1a1db0 con 0x7efd1c107670 2024-03-27T08:35:01.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd13400640 1 -- 172.21.15.164:0/695412595 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd1400f2e0 con 0x7efd1c107670 2024-03-27T08:35:01.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.737+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd1c1a22f0 con 0x7efd1c107670 2024-03-27T08:35:01.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.740+0000 7efd23def740 1 Processor -- start 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd13400640 1 -- 172.21.15.164:0/695412595 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7efd140119d0 con 0x7efd1c107670 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 -- start start 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad4334c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad43354110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad4330e920 con 0x55ad4334cb10 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad4325efa0 con 0x55ad4334c120 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.741+0000 7efd23def740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad432b0f90 con 0x55ad43351c80 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40342/0 (socket says 172.21.15.164:40342) 2024-03-27T08:35:01.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 -- 172.21.15.164:0/588429134 learned_addr learned my addr 172.21.15.164:0/588429134 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd11400640 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad4334c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 -- 172.21.15.164:0/588429134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 msgr2=0x55ad43354110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad43354110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 -- 172.21.15.164:0/588429134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 msgr2=0x55ad4334c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad4334c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 -- 172.21.15.164:0/588429134 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad42fc52d0 con 0x55ad4334cb10 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd11400640 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad4334c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd13400640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 0x7efd000a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd19e00640 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd0c037040 tx=0x7efd0c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1d8d981404936 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd13400640 1 -- 172.21.15.164:0/695412595 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7efd140cf4f0 con 0x7efd1c107670 2024-03-27T08:35:01.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.742+0000 7efd11400640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 0x7efd000a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd0b400640 1 -- 172.21.15.164:0/588429134 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c044020 con 0x55ad4334cb10 2024-03-27T08:35:01.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd0b400640 1 -- 172.21.15.164:0/588429134 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efd0c003970 con 0x55ad4334cb10 2024-03-27T08:35:01.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd0b400640 1 -- 172.21.15.164:0/588429134 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c039040 con 0x55ad4334cb10 2024-03-27T08:35:01.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd23def740 1 -- 172.21.15.164:0/588429134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 msgr2=0x55ad43351610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd23def740 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efd0c037040 tx=0x7efd0c009880 comp rx=0 tx=0).stop 2024-03-27T08:35:01.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.743+0000 7efd11400640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 0x7efd000a5ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd04005fd0 tx=0x7efd04005f60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 -- 172.21.15.164:0/588429134 shutdown_connections 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad43354110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad43351610 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 --2- 172.21.15.164:0/588429134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad4334c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 -- 172.21.15.164:0/588429134 >> 172.21.15.164:0/588429134 conn(0x55ad43347690 msgr2=0x55ad43347a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 -- 172.21.15.164:0/588429134 shutdown_connections 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 -- 172.21.15.164:0/588429134 wait complete. 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 -- start start 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.744+0000 7efd23def740 1 Processor -- start 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334cb10 0x55ad433567e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad432acf40 con 0x55ad4334c120 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad43259650 con 0x55ad4334cb10 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad4326ca10 con 0x55ad43351c80 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd23def740 10 client.0 _ll_register_callbacks cb 0x55ad432abff0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40354/0 (socket says 172.21.15.164:40354) 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 -- 172.21.15.164:0/1780180543 learned_addr learned my addr 172.21.15.164:0/1780180543 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd11400640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334cb10 0x55ad433567e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 -- 172.21.15.164:0/1780180543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 msgr2=0x55ad4335d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.742 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 -- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334cb10 msgr2=0x55ad433567e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334cb10 0x55ad433567e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.745+0000 7efd19e00640 1 -- 172.21.15.164:0/1780180543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4308f6b0 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efd19e00640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000f80 tx=0x7efd0c02c100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad1189ea00d99d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efcffe00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0c04f070 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7efd0c004290 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd0c003970 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efd0c05a050 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efd23def740 10 client.15267 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.746+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ad43360b00 con 0x55ad4334c120 2024-03-27T08:35:01.743 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efd0c003970 con 0x55ad4334c120 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7efd0c04bc00 con 0x55ad4334c120 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 10 client.15267 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 10 client.15267 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 20 client.15267 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad43362db0 0x55ad43364220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 4 client.15267 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.747+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad432be4d0 con 0x55ad43362db0 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.748+0000 7efd11400640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad43362db0 0x55ad43364220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.748+0000 7efd11400640 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad43362db0 0x55ad43364220 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f28673a8e8324cc server_cookie=836c947e0d61b8c6 in_seq=0 out_seq=0 2024-03-27T08:35:01.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.748+0000 7efcffe00640 10 client.15267 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:01.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efcffe00640 1 -- 172.21.15.164:0/1780180543 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ad432be4d0 con 0x55ad43362db0 2024-03-27T08:35:01.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efcffe00640 10 client.15267 handle_command_reply: tid=0 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 client.15267 shutdown 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 msgr2=0x55ad433562a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efd0c000f80 tx=0x7efd0c02c100 comp rx=0 tx=0).stop 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 shutdown_connections 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad43362db0 0x55ad43364220 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334cb10 0x55ad433567e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 --2- 172.21.15.164:0/1780180543 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334c120 0x55ad433562a0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efcffe00640 0 client.15267 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:01.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.750+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 >> 172.21.15.164:0/1780180543 conn(0x55ad43347690 msgr2=0x55ad43346890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.751+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 shutdown_connections 2024-03-27T08:35:01.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.751+0000 7efd23def740 1 -- 172.21.15.164:0/1780180543 wait complete. 2024-03-27T08:35:01.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.751+0000 7efd23def740 20 client.15267 trim_cache size 0 max 16384 2024-03-27T08:35:01.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.770+0000 7efd23def740 1 Processor -- start 2024-03-27T08:35:01.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 -- start start 2024-03-27T08:35:01.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4334c120 0x55ad43342500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad43351c80 0x55ad4334b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad43362560 con 0x55ad4334cb10 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad43362c30 con 0x55ad43351c80 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd23def740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad43363300 con 0x55ad4334c120 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40368/0 (socket says 172.21.15.164:40368) 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 -- 172.21.15.164:0/435490325 learned_addr learned my addr 172.21.15.164:0/435490325 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd1a800640 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad43351c80 0x55ad4334b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 -- 172.21.15.164:0/435490325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4334c120 msgr2=0x55ad43342500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4334c120 0x55ad43342500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 -- 172.21.15.164:0/435490325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad43351c80 msgr2=0x55ad4334b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad43351c80 0x55ad4334b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.771+0000 7efd11400640 1 -- 172.21.15.164:0/435490325 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad4334cef0 con 0x55ad4334cb10 2024-03-27T08:35:01.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.772+0000 7efd11400640 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efd04005780 tx=0x7efd04012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9247f5969b7b6298 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.772+0000 7efd0aa00640 1 -- 172.21.15.164:0/435490325 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd04010cd0 con 0x55ad4334cb10 2024-03-27T08:35:01.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.772+0000 7efd0aa00640 1 -- 172.21.15.164:0/435490325 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efd0402c070 con 0x55ad4334cb10 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.772+0000 7efd0aa00640 1 -- 172.21.15.164:0/435490325 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd0401dc40 con 0x55ad4334cb10 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- 172.21.15.164:0/435490325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 msgr2=0x55ad4335d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7efd04005780 tx=0x7efd04012000 comp rx=0 tx=0).stop 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- 172.21.15.164:0/435490325 shutdown_connections 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad43351c80 0x55ad4334b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad4335d7e0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 --2- 172.21.15.164:0/435490325 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad4334c120 0x55ad43342500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- 172.21.15.164:0/435490325 >> 172.21.15.164:0/435490325 conn(0x55ad43347690 msgr2=0x55ad43361e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- 172.21.15.164:0/435490325 shutdown_connections 2024-03-27T08:35:01.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- 172.21.15.164:0/435490325 wait complete. 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 -- start start 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.773+0000 7efd23def740 1 Processor -- start 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad43359370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad433640a0 con 0x55ad4334cb10 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad433639d0 con 0x55ad4334c120 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad43364770 con 0x55ad43351c80 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd23def740 10 client.0 _ll_register_callbacks cb 0x7efd0c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:01.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40382/0 (socket says 172.21.15.164:40382) 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 -- 172.21.15.164:0/2196416631 learned_addr learned my addr 172.21.15.164:0/2196416631 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd1a800640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd19e00640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad43359370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 -- 172.21.15.164:0/2196416631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 msgr2=0x55ad4335c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 -- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 msgr2=0x55ad43359370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad43359370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd11400640 1 -- 172.21.15.164:0/2196416631 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad4335cec0 con 0x55ad4334cb10 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.774+0000 7efd19e00640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad43359370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efd11400640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efd0401d530 tx=0x7efd0401d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9009769e7aa614f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efcffe00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd040265a0 con 0x55ad4334cb10 2024-03-27T08:35:01.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7efd04026740 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efd0402c070 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7efd0401d940 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efd23def740 10 client.15273 fetch_fsmap learned FSMap version 23 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55ad433d1800 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.775+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efd0402c070 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 23) ==== 8338+0+0 (secure 0 0 0) 0x7efd04004950 con 0x55ad4334cb10 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 10 client.15273 fetch_fsmap finished waiting for FSMap version 23 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 10 client.15273 resolve_mds: resolved name 'b' to daemon mds.b 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 20 client.15273 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad433d6070 0x55ad433d2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:01.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 4 client.15273 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "status"}) -- 0x55ad432b8820 con 0x55ad433d6070 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.776+0000 7efd19e00640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad433d6070 0x55ad433d2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.777+0000 7efd19e00640 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad433d6070 0x55ad433d2b80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c824bf68a8952b7e server_cookie=b6b169d7187465bc in_seq=0 out_seq=0 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.777+0000 7efcffe00640 10 client.15273 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efcffe00640 1 -- 172.21.15.164:0/2196416631 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55ad432b8820 con 0x55ad433d6070 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efcffe00640 10 client.15273 handle_command_reply: tid=0 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 client.15273 shutdown 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 msgr2=0x55ad433598b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7efd0401d530 tx=0x7efd0401d560 comp rx=0 tx=0).stop 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 shutdown_connections 2024-03-27T08:35:01.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad433d6070 0x55ad433d2b80 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad43351c80 0x55ad4335c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad4334cb10 0x55ad433598b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 --2- 172.21.15.164:0/2196416631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad4334c120 0x55ad43359370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efcffe00640 0 client.15273 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 >> 172.21.15.164:0/2196416631 conn(0x55ad43347690 msgr2=0x55ad4334b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 shutdown_connections 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 1 -- 172.21.15.164:0/2196416631 wait complete. 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.778+0000 7efd23def740 20 client.15273 trim_cache size 0 max 16384 2024-03-27T08:35:01.776 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "cluster_fsid": "f2a81f2e-ec12-11ee-95d0-87774f69a715", 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "whoami": 0, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 34502, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "want_state": "up:active", 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "state": "up:active", 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs", 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "rank_uptime": 134.82471068800001, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "mdsmap_epoch": 23, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch": 90, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_epoch_barrier": 88, 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout: "uptime": 140.45781248700001 2024-03-27T08:35:01.777 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:01.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 msgr2=0x7efd000a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 0x7efd000a5ad0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7efd04005fd0 tx=0x7efd04005f60 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 msgr2=0x7efd1c1a1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efd14009fd0 tx=0x7efd1400b8e0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 shutdown_connections 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7efd000a3610 0x7efd000a5ad0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7efd1c107670 0x7efd1c1a1450 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efd1c0fff50 0x7efd1c19a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 --2- 172.21.15.164:0/695412595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7efd1c0ff560 0x7efd1c199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 >> 172.21.15.164:0/695412595 conn(0x7efd1c0fb100 msgr2=0x7efd1c0fb4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 shutdown_connections 2024-03-27T08:35:01.779 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:01.779+0000 7efd1b200640 1 -- 172.21.15.164:0/695412595 wait complete. 2024-03-27T08:35:01.785 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:01 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4011124298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:01.785 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:01 smithi164 ceph-mon[31788]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:01.788 INFO:teuthology.run_tasks:Running task sequential... 2024-03-27T08:35:01.797 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-03-27T08:35:01.797 INFO:teuthology.task.sequential:In sequential, running task print... 2024-03-27T08:35:01.798 INFO:teuthology.task.print:Enabling mgr modules 2024-03-27T08:35:01.798 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-27T08:35:01.821 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-27T08:35:01.821 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-03-27T08:35:01.822 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-03-27T08:35:01.822 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-27T08:35:01.822 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:01.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:01.822 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-03-27T08:35:01.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:01.876 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-03-27T08:35:01.967 INFO:teuthology.orchestra.run.smithi164.stderr:Cannot find device "ceph-brx" 2024-03-27T08:35:01.970 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:35:01.971 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-27T08:35:01.971 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph fs ls 2024-03-27T08:35:02.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:01 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4011124298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:02.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:01 smithi167 ceph-mon[34903]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:02.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:01 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4011124298' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:02.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:01 smithi173 ceph-mon[35397]: pgmap v432: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:02.426 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:35:04.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:04 smithi164 ceph-mon[31788]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.705+0000 7f65fec00700 1 -- 172.21.15.164:0/3386563961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 msgr2=0x7f65f810ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.705+0000 7f65fec00700 1 --2- 172.21.15.164:0/3386563961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f810ac70 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009990 tx=0x7f65e8009ca0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 -- 172.21.15.164:0/3386563961 shutdown_connections 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 --2- 172.21.15.164:0/3386563961 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8105250 0x7f65f8111760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 --2- 172.21.15.164:0/3386563961 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f810ac70 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 --2- 172.21.15.164:0/3386563961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8104890 0x7f65f8104d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 -- 172.21.15.164:0/3386563961 >> 172.21.15.164:0/3386563961 conn(0x7f65f81003e0 msgr2=0x7f65f8102800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 -- 172.21.15.164:0/3386563961 shutdown_connections 2024-03-27T08:35:04.698 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.706+0000 7f65fec00700 1 -- 172.21.15.164:0/3386563961 wait complete. 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 Processor -- start 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 -- start start 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8104890 0x7f65f819b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8105250 0x7f65f819b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8114c10 con 0x7f65f810a890 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8114a90 con 0x7f65f8105250 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.707+0000 7f65fec00700 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f65f8114d90 con 0x7f65f8104890 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40402/0 (socket says 172.21.15.164:40402) 2024-03-27T08:35:04.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 -- 172.21.15.164:0/707466413 learned_addr learned my addr 172.21.15.164:0/707466413 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65f7e00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8104890 0x7f65f819b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65f7400700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8105250 0x7f65f819b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 -- 172.21.15.164:0/707466413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8104890 msgr2=0x7f65f819b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8104890 0x7f65f819b100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 -- 172.21.15.164:0/707466413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8105250 msgr2=0x7f65f819b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8105250 0x7f65f819b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.701 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 -- 172.21.15.164:0/707466413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f81a00c0 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.708+0000 7f65fcc00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007ee0 tx=0x7f65f000d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.709+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000dbd0 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.709+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65f000dd70 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.709+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f81a03b0 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.709+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00133f0 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.709+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f81a7c30 con 0x7f65f810a890 2024-03-27T08:35:04.702 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.710+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f8069300 con 0x7f65f810a890 2024-03-27T08:35:04.703 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.712+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f65f001a020 con 0x7f65f810a890 2024-03-27T08:35:04.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.714+0000 7f65f4c00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 0x7f65dc0a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:04.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.714+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f65f00cf4a0 con 0x7f65f810a890 2024-03-27T08:35:04.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.714+0000 7f65f7e00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 0x7f65dc0a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:04.706 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.715+0000 7f65f7e00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 0x7f65dc0a5b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f65e800b2e0 tx=0x7f65e801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:04.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.719+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f65f0010070 con 0x7f65f810a890 2024-03-27T08:35:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:04 smithi167 ceph-mon[34903]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:04 smithi173 ceph-mon[35397]: pgmap v433: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:04.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.997+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f65f802dd30 con 0x7f65f810a890 2024-03-27T08:35:04.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:04.998+0000 7f65f4c00700 1 -- 172.21.15.164:0/707466413 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f65f009c020 con 0x7f65f810a890 2024-03-27T08:35:04.990 INFO:teuthology.orchestra.run.smithi164.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-27T08:35:04.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 msgr2=0x7f65dc0a5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:04.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 0x7f65dc0a5b60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f65e800b2e0 tx=0x7f65e801a040 comp rx=0 tx=0).stop 2024-03-27T08:35:04.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 msgr2=0x7f65f819f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:04.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007ee0 tx=0x7f65f000d3b0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 shutdown_connections 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f65dc0a36a0 0x7f65dc0a5b60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f65f810a890 0x7f65f819f980 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f65f8104890 0x7f65f819b100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 --2- 172.21.15.164:0/707466413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65f8105250 0x7f65f819b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 >> 172.21.15.164:0/707466413 conn(0x7f65f81003e0 msgr2=0x7f65f8100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 shutdown_connections 2024-03-27T08:35:04.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:05.002+0000 7f65fec00700 1 -- 172.21.15.164:0/707466413 wait complete. 2024-03-27T08:35:05.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:05 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/707466413' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T08:35:05.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:05 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/707466413' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T08:35:05.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:05 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/707466413' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi164.front.sepia.ceph.com 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-27T08:35:05.871 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-27T08:35:05.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:05.872 DEBUG:teuthology.orchestra.run.smithi164:> ip addr 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: inet 127.0.0.1/8 scope host lo 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 ::1/128 scope host 2024-03-27T08:35:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f4 brd ff:ff:ff:ff:ff:ff 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f0 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:d9:34:f5 brd ff:ff:ff:ff:ff:ff 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: altname enp7s0f1 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f2 brd ff:ff:ff:ff:ff:ff 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: link/ether 0c:c4:7a:88:73:f3 brd ff:ff:ff:ff:ff:ff 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: inet 172.21.15.164/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft 41782sec preferred_lft 41782sec 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: inet6 fe80::ec4:7aff:fe88:73f3/64 scope link 2024-03-27T08:35:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: valid_lft forever preferred_lft forever 2024-03-27T08:35:05.934 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add name ceph-brx type bridge 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr flush dev ceph-brx 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set ceph-brx up 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-27T08:35:05.935 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-03-27T08:35:06.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T08:35:06.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:06.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:06.456 DEBUG:teuthology.orchestra.run.smithi164:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-27T08:35:06.533 INFO:teuthology.orchestra.run.smithi164.stdout:1 2024-03-27T08:35:06.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:06.537 DEBUG:teuthology.orchestra.run.smithi164:> route 2024-03-27T08:35:06.591 INFO:teuthology.orchestra.run.smithi164.stdout:Kernel IP routing table 2024-03-27T08:35:06.591 INFO:teuthology.orchestra.run.smithi164.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-27T08:35:06.591 INFO:teuthology.orchestra.run.smithi164.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-27T08:35:06.591 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-27T08:35:06.591 INFO:teuthology.orchestra.run.smithi164.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-27T08:35:06.592 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T08:35:06.592 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-03-27T08:35:06.592 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-27T08:35:06.592 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-27T08:35:06.593 DEBUG:teuthology.orchestra.run.smithi164:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-27T08:35:06.593 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-03-27T08:35:06.700 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T08:35:06.734 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:06 smithi164 ceph-mon[31788]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:06 smithi167 ceph-mon[34903]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:06 smithi173 ceph-mon[35397]: pgmap v434: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-03-27T08:35:07.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:07.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:07.452 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-03-27T08:35:07.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:07.506 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list-id 2024-03-27T08:35:07.555 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T08:35:07.555 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-03-27T08:35:07.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:07.555 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-27T08:35:07.555 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-03-27T08:35:07.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T08:35:07.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:07.763 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-27T08:35:07.763 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-27T08:35:07.764 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-03-27T08:35:07.862 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T08:35:08.081 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:08.090 DEBUG:teuthology.orchestra.run.smithi164:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-27T08:35:08.090 DEBUG:teuthology.orchestra.run.smithi164:> set -e 2024-03-27T08:35:08.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set brx.0 up 2024-03-27T08:35:08.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link set dev brx.0 master ceph-brx 2024-03-27T08:35:08.091 DEBUG:teuthology.orchestra.run.smithi164:> ') 2024-03-27T08:35:08.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-27T08:35:08.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:08.316 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-03-27T08:35:08.316 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T08:35:08.316 DEBUG:teuthology.orchestra.run.smithi164:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:08.361 INFO:teuthology.orchestra.run.smithi164.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-27T08:35:08.361 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-27T08:35:08.361 DEBUG:teuthology.orchestra.run.smithi164:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:08.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-03-27T08:35:08.503 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:08 smithi164 ceph-mon[31788]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:08.535 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T08:35:08.583 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-03-27T08:35:08.583 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-03-27T08:35:08.584 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/28129e7a8dd09e0c1658f4dc3fe875f0ae2b0ae6e0651e37d8214258f156c516/merged 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/9a41214470c4c1c67361d5d01c42eeace3ba829a1c05c356d1b115c8aa06a6ca/merged 2024-03-27T08:35:08.585 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3054b313c5f6b22c49ea63a586aaf0227dc624746ed47356d6ed5fa02af8b44e/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/df0307938abe6d5df6c2c17e9e79911b02d838bce6d1917b4854c6b221b404d5/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/8fb01eb41b4dd3b9fb7b65b4c29e360df2f2fe61acfe841daa7763cb5b9ff6f5/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/6018048239bd8b64714d120ab6299dfac5e988284c445d940f164be9dd121454/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/0e0e123a19063d283b665cbce7443f06a2bb10ef1e0b95715f8bb926fa569254/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/b94e33176391ef8dba0d353b493fd1d8de387e7acb2da966f6bd5037740d279c/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3ea844b85a7282c5c5eaa85984f8bd50d70cfc9af2bfb7a9374491fdc055edb5/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/2fbc87abf3e4fc42628cb9bb697b40dff60c2003bcadd25aff9ed0fe3dcb6f06/merged 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:08.586 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:08.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:08.587 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-03-27T08:35:08.634 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-27T08:35:08.634 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253 --client_fs=cephfs) 2024-03-27T08:35:08.639 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-03-27T08:35:08.716 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T08:35:08.760 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-03-27T08:35:08.760 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-03-27T08:35:08.760 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-03-27T08:35:08.760 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-03-27T08:35:08.760 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-03-27T08:35:08.761 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/28129e7a8dd09e0c1658f4dc3fe875f0ae2b0ae6e0651e37d8214258f156c516/merged 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/9a41214470c4c1c67361d5d01c42eeace3ba829a1c05c356d1b115c8aa06a6ca/merged 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-03-27T08:35:08.762 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3054b313c5f6b22c49ea63a586aaf0227dc624746ed47356d6ed5fa02af8b44e/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/df0307938abe6d5df6c2c17e9e79911b02d838bce6d1917b4854c6b221b404d5/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/8fb01eb41b4dd3b9fb7b65b4c29e360df2f2fe61acfe841daa7763cb5b9ff6f5/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/6018048239bd8b64714d120ab6299dfac5e988284c445d940f164be9dd121454/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/0e0e123a19063d283b665cbce7443f06a2bb10ef1e0b95715f8bb926fa569254/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/b94e33176391ef8dba0d353b493fd1d8de387e7acb2da966f6bd5037740d279c/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3ea844b85a7282c5c5eaa85984f8bd50d70cfc9af2bfb7a9374491fdc055edb5/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/2fbc87abf3e4fc42628cb9bb697b40dff60c2003bcadd25aff9ed0fe3dcb6f06/merged 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:08.763 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:08.764 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:08.764 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-03-27T08:35:08.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:08 smithi167 ceph-mon[34903]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:08.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:08 smithi173 ceph-mon[35397]: pgmap v435: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:35:08.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:2024-03-27T08:35:08.859+0000 7f9c0fe38480 -1 init, newargv = 0x562628072420 newargc=15 2024-03-27T08:35:08.851 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[84909]: starting ceph client 2024-03-27T08:35:08.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[84909]: starting fuse 2024-03-27T08:35:09.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo modprobe fuse 2024-03-27T08:35:10.056 DEBUG:teuthology.orchestra.run.smithi164:> cat /proc/self/mounts | awk '{print $2}' 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/proc 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/sys 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/dev 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/security 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/shm 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/pts 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/run 2024-03-27T08:35:10.111 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/cgroup 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/pstore 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/bpf 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/ 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/selinux 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/hugepages 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/dev/mqueue 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/debug 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/tracing 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/fs/fuse/connections 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/sys/kernel/config 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-sysctl.service 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-03-27T08:35:10.112 INFO:teuthology.orchestra.run.smithi164.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/nfs/rpc_pipefs 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/1000 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/ceph 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/28129e7a8dd09e0c1658f4dc3fe875f0ae2b0ae6e0651e37d8214258f156c516/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/9a41214470c4c1c67361d5d01c42eeace3ba829a1c05c356d1b115c8aa06a6ca/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/run/user/0 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/proc/sys/fs/binfmt_misc 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3054b313c5f6b22c49ea63a586aaf0227dc624746ed47356d6ed5fa02af8b44e/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/df0307938abe6d5df6c2c17e9e79911b02d838bce6d1917b4854c6b221b404d5/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/8fb01eb41b4dd3b9fb7b65b4c29e360df2f2fe61acfe841daa7763cb5b9ff6f5/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/6018048239bd8b64714d120ab6299dfac5e988284c445d940f164be9dd121454/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/0e0e123a19063d283b665cbce7443f06a2bb10ef1e0b95715f8bb926fa569254/merged 2024-03-27T08:35:10.113 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/b94e33176391ef8dba0d353b493fd1d8de387e7acb2da966f6bd5037740d279c/merged 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/3ea844b85a7282c5c5eaa85984f8bd50d70cfc9af2bfb7a9374491fdc055edb5/merged 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/var/lib/containers/storage/overlay/2fbc87abf3e4fc42628cb9bb697b40dff60c2003bcadd25aff9ed0fe3dcb6f06/merged 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:35:10.114 INFO:teuthology.orchestra.run.smithi164.stdout:/home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:10.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:10.115 DEBUG:teuthology.orchestra.run.smithi164:> ls /sys/fs/fuse/connections 2024-03-27T08:35:10.165 INFO:teuthology.orchestra.run.smithi164.stdout:118 2024-03-27T08:35:10.165 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [118] 2024-03-27T08:35:10.166 DEBUG:teuthology.orchestra.run.smithi164:> sudo stdin-killer -- python3 -c ' 2024-03-27T08:35:10.166 DEBUG:teuthology.orchestra.run.smithi164:> import glob 2024-03-27T08:35:10.166 DEBUG:teuthology.orchestra.run.smithi164:> import re 2024-03-27T08:35:10.166 DEBUG:teuthology.orchestra.run.smithi164:> import os 2024-03-27T08:35:10.166 DEBUG:teuthology.orchestra.run.smithi164:> import subprocess 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> def _find_admin_socket(client_name): 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> files = glob.glob(asok_path) 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> # Given a non-glob path, it better be there 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> if "*" not in asok_path: 2024-03-27T08:35:10.167 DEBUG:teuthology.orchestra.run.smithi164:> assert(len(files) == 1) 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> return files[0] 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> for f in files: 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> contents = proc_f.read() 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> if mountpoint in contents: 2024-03-27T08:35:10.168 DEBUG:teuthology.orchestra.run.smithi164:> return f 2024-03-27T08:35:10.169 DEBUG:teuthology.orchestra.run.smithi164:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-27T08:35:10.169 DEBUG:teuthology.orchestra.run.smithi164:> 2024-03-27T08:35:10.169 DEBUG:teuthology.orchestra.run.smithi164:> print(_find_admin_socket("client.0")) 2024-03-27T08:35:10.169 DEBUG:teuthology.orchestra.run.smithi164:> ' 2024-03-27T08:35:10.340 INFO:teuthology.orchestra.run.smithi164.stdout:/var/run/ceph/ceph-client.0.84909.asok 2024-03-27T08:35:10.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-27T08:35:10.358 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.84909.asok 2024-03-27T08:35:10.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:10.358 DEBUG:teuthology.orchestra.run.smithi164:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.84909.asok status 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "metadata": { 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_sha1": "155268c4e432a12433aa833f174f9fe3b1016ae0", 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_version": "ceph version 19.0.0-2478-g155268c4 (155268c4e432a12433aa833f174f9fe3b1016ae0) squid (dev)", 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "entity_id": "0", 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": "smithi164", 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-27T08:35:10.593 INFO:teuthology.orchestra.run.smithi164.stdout: "pid": "84909", 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "root": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253" 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_count": 0, 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "dentry_pinned_count": 0, 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 15285, 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "inst": { 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "name": { 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "client", 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "num": 15285 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-03-27T08:35:10.594 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2830763388 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": { 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "192.168.0.1:0", 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2830763388 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "inst_str": "client.15285 192.168.0.1:0/2830763388", 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "addr_str": "192.168.0.1:0/2830763388", 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "inode_count": 5, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_epoch": 23, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch": 90, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_epoch_barrier": 0, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "blocklisted": false, 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout: "fs_name": "cephfs" 2024-03-27T08:35:10.595 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:10.607 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:10 smithi164 ceph-mon[31788]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:35:10.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:10.612 DEBUG:teuthology.orchestra.run.smithi164:> stat --file-system '--printf=%T 2024-03-27T08:35:10.612 DEBUG:teuthology.orchestra.run.smithi164:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:10.663 INFO:teuthology.orchestra.run.smithi164.stdout:fuseblk 2024-03-27T08:35:10.663 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:10.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:10.663 DEBUG:teuthology.orchestra.run.smithi164:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:10.751 INFO:teuthology.run_tasks:Running task exec... 2024-03-27T08:35:10.761 INFO:teuthology.task.exec:Executing custom commands... 2024-03-27T08:35:10.762 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:35:10.762 DEBUG:teuthology.orchestra.run.smithi164:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-03-27T08:35:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:10 smithi167 ceph-mon[34903]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:35:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:10 smithi173 ceph-mon[35397]: pgmap v436: 97 pgs: 97 active+clean; 641 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 -- 172.21.15.164:0/3475546882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806ee50 msgr2=0x7f971806f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 --2- 172.21.15.164:0/3475546882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806ee50 0x7f971806f2b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f9704009900 tx=0x7f970402bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 -- 172.21.15.164:0/3475546882 shutdown_connections 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 --2- 172.21.15.164:0/3475546882 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806f7f0 0x7f9718070090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 --2- 172.21.15.164:0/3475546882 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806ee50 0x7f971806f2b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 --2- 172.21.15.164:0/3475546882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806dc10 0x7f971806e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 -- 172.21.15.164:0/3475546882 >> 172.21.15.164:0/3475546882 conn(0x7f971806c760 msgr2=0x7f971806cb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:10.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 -- 172.21.15.164:0/3475546882 shutdown_connections 2024-03-27T08:35:10.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.980+0000 7f971ea00640 1 -- 172.21.15.164:0/3475546882 wait complete. 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 Processor -- start 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 -- start start 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806ee50 0x7f97181a70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806f7f0 0x7f97181ae140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f971811c640 con 0x7f971806dc10 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f971811c4c0 con 0x7f971806f7f0 2024-03-27T08:35:10.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.981+0000 7f971ea00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f971811c7c0 con 0x7f971806ee50 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45700/0 (socket says 172.21.15.164:45700) 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 -- 172.21.15.164:0/1192136549 learned_addr learned my addr 172.21.15.164:0/1192136549 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f971ca00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806f7f0 0x7f97181ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717400640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806ee50 0x7f97181a70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 -- 172.21.15.164:0/1192136549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806ee50 msgr2=0x7f97181a70d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806ee50 0x7f97181a70d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 -- 172.21.15.164:0/1192136549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806f7f0 msgr2=0x7f97181ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806f7f0 0x7f97181ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 -- 172.21.15.164:0/1192136549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97181ae7b0 con 0x7f971806dc10 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.982+0000 7f9717e00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f970800d950 tx=0x7f970800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.983+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9708017070 con 0x7f971806dc10 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.983+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9708009c30 con 0x7f971806dc10 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.983+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97181aeaa0 con 0x7f971806dc10 2024-03-27T08:35:10.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.983+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f970800f6b0 con 0x7f971806dc10 2024-03-27T08:35:10.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.983+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97181af010 con 0x7f971806dc10 2024-03-27T08:35:10.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.984+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9718118f10 con 0x7f971806dc10 2024-03-27T08:35:10.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.986+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f9708010a50 con 0x7f971806dc10 2024-03-27T08:35:10.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.987+0000 7f9714c00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 0x7f96fc0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:10.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.987+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f97080cf9f0 con 0x7f971806dc10 2024-03-27T08:35:10.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.988+0000 7f9717400640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 0x7f96fc0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:10.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.988+0000 7f9717400640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 0x7f96fc0a5bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f9704000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:10.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:10.992+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9708009de0 con 0x7f971806dc10 2024-03-27T08:35:11.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.238+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f971802d370 con 0x7f971806dc10 2024-03-27T08:35:11.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.456+0000 7f9714c00640 1 -- 172.21.15.164:0/1192136549 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v24) ==== 117+0+0 (secure 0 0 0) 0x7f970809c570 con 0x7f971806dc10 2024-03-27T08:35:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.459+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 msgr2=0x7f96fc0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.459+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 0x7f96fc0a5bf0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f9704006010 tx=0x7f9704000bc0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.459+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 msgr2=0x7f97181a6b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.459+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f970800d950 tx=0x7f970800de10 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 shutdown_connections 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96fc0a3730 0x7f96fc0a5bf0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f971806f7f0 0x7f97181ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f971806ee50 0x7f97181a70d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 --2- 172.21.15.164:0/1192136549 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f971806dc10 0x7f97181a6b90 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 >> 172.21.15.164:0/1192136549 conn(0x7f971806c760 msgr2=0x7f971810a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 shutdown_connections 2024-03-27T08:35:11.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.460+0000 7f971ea00640 1 -- 172.21.15.164:0/1192136549 wait complete. 2024-03-27T08:35:11.473 INFO:teuthology.run_tasks:Running task check-counter... 2024-03-27T08:35:11.484 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-03-27T08:35:11.493 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:35:11.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 -- 172.21.15.164:0/2523485915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78105940 msgr2=0x7f1d7810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/2523485915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78105940 0x7f1d7810c1d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f1d70009ca0 tx=0x7f1d7002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 -- 172.21.15.164:0/2523485915 shutdown_connections 2024-03-27T08:35:11.711 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/2523485915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78105940 0x7f1d7810c1d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/2523485915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 0x7f1d78105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/2523485915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d78103d90 0x7f1d781041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 -- 172.21.15.164:0/2523485915 >> 172.21.15.164:0/2523485915 conn(0x7f1d780ff300 msgr2=0x7f1d78101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:11.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 -- 172.21.15.164:0/2523485915 shutdown_connections 2024-03-27T08:35:11.712 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.719+0000 7f1d7ec00640 1 -- 172.21.15.164:0/2523485915 wait complete. 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.720+0000 7f1d7ec00640 1 Processor -- start 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.720+0000 7f1d7ec00640 1 -- start start 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 0x7f1d7819a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d78105940 0x7f1d781a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7810f9f0 con 0x7f1d78103d90 2024-03-27T08:35:11.714 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7810f870 con 0x7f1d78104f80 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d7ec00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1d7810fb70 con 0x7f1d78105940 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45718/0 (socket says 172.21.15.164:45718) 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 -- 172.21.15.164:0/548462406 learned_addr learned my addr 172.21.15.164:0/548462406 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77400640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 0x7f1d7819a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 -- 172.21.15.164:0/548462406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d78105940 msgr2=0x7f1d781a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d78105940 0x7f1d781a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 -- 172.21.15.164:0/548462406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 msgr2=0x7f1d7819a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 0x7f1d7819a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.721+0000 7f1d77e00640 1 -- 172.21.15.164:0/548462406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d781a1c20 con 0x7f1d78103d90 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d77e00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800d950 tx=0x7f1d6800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:11.715 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d68017070 con 0x7f1d78103d90 2024-03-27T08:35:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1d68009c30 con 0x7f1d78103d90 2024-03-27T08:35:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d781a1f10 con 0x7f1d78103d90 2024-03-27T08:35:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d6800f620 con 0x7f1d78103d90 2024-03-27T08:35:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.722+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d781a2380 con 0x7f1d78103d90 2024-03-27T08:35:11.716 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.723+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d7810b0b0 con 0x7f1d78103d90 2024-03-27T08:35:11.717 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.725+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f1d6801a070 con 0x7f1d78103d90 2024-03-27T08:35:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.726+0000 7f1d74c00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 0x7f1d5c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:11.718 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.727+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f1d680cf8b0 con 0x7f1d78103d90 2024-03-27T08:35:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.727+0000 7f1d77400640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 0x7f1d5c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:11.719 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.728+0000 7f1d77400640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 0x7f1d5c0a5ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005fd0 tx=0x7f1d64005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:11.722 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.731+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1d68009de0 con 0x7f1d78103d90 2024-03-27T08:35:11.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:11 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T08:35:11.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:11 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T08:35:11.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:11 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-03-27T08:35:11.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.931+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d78062850 con 0x7f1d78103d90 2024-03-27T08:35:11.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.935+0000 7f1d74c00640 1 -- 172.21.15.164:0/548462406 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f1d6809c430 con 0x7f1d78103d90 2024-03-27T08:35:11.927 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:11.927 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.937+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 msgr2=0x7f1d5c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.937+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 0x7f1d5c0a5ad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1d64005fd0 tx=0x7f1d64005850 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.937+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 msgr2=0x7f1d7819a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.937+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1d6800d950 tx=0x7f1d6800de10 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 shutdown_connections 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f1d5c0a3610 0x7f1d5c0a5ad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1d78105940 0x7f1d781a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d78104f80 0x7f1d7819a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 --2- 172.21.15.164:0/548462406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1d78103d90 0x7f1d7819a000 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 >> 172.21.15.164:0/548462406 conn(0x7f1d780ff300 msgr2=0x7f1d78108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:11.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 shutdown_connections 2024-03-27T08:35:11.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:11.938+0000 7f1d7ec00640 1 -- 172.21.15.164:0/548462406 wait complete. 2024-03-27T08:35:11.947 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:35:11.948 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 -- 172.21.15.164:0/268259183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c077750 msgr2=0x7f815c077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 --2- 172.21.15.164:0/268259183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c077750 0x7f815c077bb0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f8148009900 tx=0x7f814802bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 -- 172.21.15.164:0/268259183 shutdown_connections 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 --2- 172.21.15.164:0/268259183 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c0780f0 0x7f815c078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 --2- 172.21.15.164:0/268259183 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c077750 0x7f815c077bb0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 --2- 172.21.15.164:0/268259183 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c076510 0x7f815c076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.170+0000 7f8162000640 1 -- 172.21.15.164:0/268259183 >> 172.21.15.164:0/268259183 conn(0x7f815c0ff300 msgr2=0x7f815c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.171+0000 7f8162000640 1 -- 172.21.15.164:0/268259183 shutdown_connections 2024-03-27T08:35:12.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.171+0000 7f8162000640 1 -- 172.21.15.164:0/268259183 wait complete. 2024-03-27T08:35:12.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.171+0000 7f8162000640 1 Processor -- start 2024-03-27T08:35:12.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 -- start start 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 0x7f815c19e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 0x7f815c19ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f815c113e00 con 0x7f815c0780f0 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f815c113c80 con 0x7f815c076510 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f8162000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f815c113f80 con 0x7f815c077750 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f815be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f815be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45730/0 (socket says 172.21.15.164:45730) 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.172+0000 7f815be00640 1 -- 172.21.15.164:0/1865861460 learned_addr learned my addr 172.21.15.164:0/1865861460 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815aa00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 0x7f815c19ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815b400640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 0x7f815c19e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 -- 172.21.15.164:0/1865861460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 msgr2=0x7f815c19ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 0x7f815c19ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 -- 172.21.15.164:0/1865861460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 msgr2=0x7f815c19e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 0x7f815c19e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 -- 172.21.15.164:0/1865861460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815c1a6100 con 0x7f815c0780f0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815aa00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 0x7f815c19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815b400640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 0x7f815c19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f815be00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f815400e970 tx=0x7f815400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f815400ccc0 con 0x7f815c0780f0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f815c1a63f0 con 0x7f815c0780f0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f815400ce60 con 0x7f815c0780f0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8154018430 con 0x7f815c0780f0 2024-03-27T08:35:12.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.173+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f815c1a68f0 con 0x7f815c0780f0 2024-03-27T08:35:12.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.174+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f815c110700 con 0x7f815c0780f0 2024-03-27T08:35:12.168 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.177+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8154005000 con 0x7f815c0780f0 2024-03-27T08:35:12.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.178+0000 7f8153e00640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 0x7f81400a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.178+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f81540d09f0 con 0x7f815c0780f0 2024-03-27T08:35:12.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.178+0000 7f815b400640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 0x7f81400a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.179+0000 7f815b400640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 0x7f81400a5ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f814c005fd0 tx=0x7f814c0093e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:12.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.180+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f815401f340 con 0x7f815c0780f0 2024-03-27T08:35:12.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.380+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f815c062750 con 0x7f815c0780f0 2024-03-27T08:35:12.496 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.381+0000 7f8153e00640 1 -- 172.21.15.164:0/1865861460 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f815409d570 con 0x7f815c0780f0 2024-03-27T08:35:12.497 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:35:12.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 msgr2=0x7f81400a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 0x7f81400a5ad0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f814c005fd0 tx=0x7f814c0093e0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 msgr2=0x7f815c1a5a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f815400e970 tx=0x7f815400ed70 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 shutdown_connections 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f81400a3610 0x7f81400a5ad0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f815c0780f0 0x7f815c1a5a90 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f815c077750 0x7f815c19ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.383+0000 7f8162000640 1 --2- 172.21.15.164:0/1865861460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f815c076510 0x7f815c19e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.384+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 >> 172.21.15.164:0/1865861460 conn(0x7f815c0ff300 msgr2=0x7f815c100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:12.502 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.384+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 shutdown_connections 2024-03-27T08:35:12.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.384+0000 7f8162000640 1 -- 172.21.15.164:0/1865861460 wait complete. 2024-03-27T08:35:12.503 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 -- 172.21.15.164:0/3036707673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 msgr2=0x7f61f8105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 --2- 172.21.15.164:0/3036707673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f8105400 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009900 tx=0x7f61e002bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 -- 172.21.15.164:0/3036707673 shutdown_connections 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 --2- 172.21.15.164:0/3036707673 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8105940 0x7f61f810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 --2- 172.21.15.164:0/3036707673 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f8105400 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 --2- 172.21.15.164:0/3036707673 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8103d90 0x7f61f81041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 -- 172.21.15.164:0/3036707673 >> 172.21.15.164:0/3036707673 conn(0x7f61f80ff300 msgr2=0x7f61f8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:12.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 -- 172.21.15.164:0/3036707673 shutdown_connections 2024-03-27T08:35:12.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.737+0000 7f61fce00640 1 -- 172.21.15.164:0/3036707673 wait complete. 2024-03-27T08:35:12.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 Processor -- start 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 -- start start 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8103d90 0x7f61f819a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8105940 0x7f61f81a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f61f810f9f0 con 0x7f61f8104f80 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61f810f870 con 0x7f61f8103d90 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.738+0000 7f61fce00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f61f810fb70 con 0x7f61f8105940 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45742/0 (socket says 172.21.15.164:45742) 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 -- 172.21.15.164:0/3488484165 learned_addr learned my addr 172.21.15.164:0/3488484165 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61f5e00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8103d90 0x7f61f819a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61f6800640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8105940 0x7f61f81a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 -- 172.21.15.164:0/3488484165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8105940 msgr2=0x7f61f81a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8105940 0x7f61f81a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 -- 172.21.15.164:0/3488484165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8103d90 msgr2=0x7f61f819a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8103d90 0x7f61f819a0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.739+0000 7f61efe00640 1 -- 172.21.15.164:0/3488484165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f81a1cf0 con 0x7f61f8104f80 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61efe00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009230 tx=0x7f61e0004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0043020 con 0x7f61f8104f80 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f61e0005460 con 0x7f61f8104f80 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f81a1f80 con 0x7f61f8104f80 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e0003c60 con 0x7f61f8104f80 2024-03-27T08:35:12.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.740+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f81a2440 con 0x7f61f8104f80 2024-03-27T08:35:12.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.741+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f810b0d0 con 0x7f61f8104f80 2024-03-27T08:35:12.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.743+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f61e0046020 con 0x7f61f8104f80 2024-03-27T08:35:12.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.744+0000 7f61eea00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 0x7f61dc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:12.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.745+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f61e00f1a60 con 0x7f61f8104f80 2024-03-27T08:35:12.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.745+0000 7f61f5e00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 0x7f61dc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:12.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.745+0000 7f61f5e00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 0x7f61dc0a5ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61e80058c0 tx=0x7f61e800a2d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:12.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.749+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f61e004d070 con 0x7f61f8104f80 2024-03-27T08:35:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:12 smithi164 ceph-mon[31788]: pgmap v437: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:12 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T08:35:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:12 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:35:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:12 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/548462406' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:12 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1865861460' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:12 smithi167 ceph-mon[34903]: pgmap v437: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:12 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T08:35:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:12 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:35:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:12 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/548462406' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:12 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1865861460' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:12 smithi173 ceph-mon[35397]: pgmap v437: 97 pgs: 97 active+clean; 642 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:12 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1192136549' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-03-27T08:35:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:12 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:35:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:12 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/548462406' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:12 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1865861460' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:12.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.951+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f61f80627f0 con 0x7f61f8104f80 2024-03-27T08:35:12.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.952+0000 7f61eea00640 1 -- 172.21.15.164:0/3488484165 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f61e00be5e0 con 0x7f61f8104f80 2024-03-27T08:35:12.944 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:35:12.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 msgr2=0x7f61dc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 0x7f61dc0a5ad0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f61e80058c0 tx=0x7f61e800a2d0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 msgr2=0x7f61f819a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009230 tx=0x7f61e0004e20 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 shutdown_connections 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f61dc0a3610 0x7f61dc0a5ad0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f61f8105940 0x7f61f81a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f61f8104f80 0x7f61f819a610 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 --2- 172.21.15.164:0/3488484165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61f8103d90 0x7f61f819a0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:12.947 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 >> 172.21.15.164:0/3488484165 conn(0x7f61f80ff300 msgr2=0x7f61f81082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:12.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 shutdown_connections 2024-03-27T08:35:12.948 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:12.955+0000 7f61fce00640 1 -- 172.21.15.164:0/3488484165 wait complete. 2024-03-27T08:35:12.965 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 -- 172.21.15.164:0/2326263469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8102d50 msgr2=0x7f8be81031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 --2- 172.21.15.164:0/2326263469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8102d50 0x7f8be81031d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009900 tx=0x7f8bd402bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 -- 172.21.15.164:0/2326263469 shutdown_connections 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 --2- 172.21.15.164:0/2326263469 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8103710 0x7f8be8109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 --2- 172.21.15.164:0/2326263469 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8102d50 0x7f8be81031d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 --2- 172.21.15.164:0/2326263469 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8101b60 0x7f8be8101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 -- 172.21.15.164:0/2326263469 >> 172.21.15.164:0/2326263469 conn(0x7f8be80fd0f0 msgr2=0x7f8be80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:13.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 -- 172.21.15.164:0/2326263469 shutdown_connections 2024-03-27T08:35:13.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.189+0000 7f8bf0600640 1 -- 172.21.15.164:0/2326263469 wait complete. 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 Processor -- start 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 -- start start 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 0x7f8be8198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 0x7f8be819f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8be810d7c0 con 0x7f8be8101b60 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8be810d640 con 0x7f8be8103710 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bf0600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8be810d940 con 0x7f8be8102d50 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.190+0000 7f8bedc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45758/0 (socket says 172.21.15.164:45758) 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 -- 172.21.15.164:0/3110044811 learned_addr learned my addr 172.21.15.164:0/3110044811 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bed200640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 0x7f8be8198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bee600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 0x7f8be819f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 -- 172.21.15.164:0/3110044811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 msgr2=0x7f8be8198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 0x7f8be8198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 -- 172.21.15.164:0/3110044811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 msgr2=0x7f8be819f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 0x7f8be819f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 -- 172.21.15.164:0/3110044811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be819fa70 con 0x7f8be8101b60 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bed200640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 0x7f8be8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bee600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 0x7f8be819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.191+0000 7f8bedc00640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c970 tx=0x7f8bdc00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.192+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc004220 con 0x7f8be8101b60 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.192+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8bdc0043c0 con 0x7f8be8101b60 2024-03-27T08:35:13.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.192+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be819fd60 con 0x7f8be8101b60 2024-03-27T08:35:13.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.192+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc00f450 con 0x7f8be8101b60 2024-03-27T08:35:13.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.192+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be81a01f0 con 0x7f8be8101b60 2024-03-27T08:35:13.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.193+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be8108f50 con 0x7f8be8101b60 2024-03-27T08:35:13.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.195+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8bdc0079b0 con 0x7f8be8101b60 2024-03-27T08:35:13.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.196+0000 7f8be6000640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 0x7f8bd00a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.196+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8bdc0cfb40 con 0x7f8be8101b60 2024-03-27T08:35:13.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.197+0000 7f8bed200640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 0x7f8bd00a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.197+0000 7f8bed200640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 0x7f8bd00a5ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005c40 tx=0x7f8bd4005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:13.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.200+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8bdc014030 con 0x7f8be8101b60 2024-03-27T08:35:13.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.400+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8be8062890 con 0x7f8be8101b60 2024-03-27T08:35:13.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.401+0000 7f8be6000640 1 -- 172.21.15.164:0/3110044811 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f8bdc09c720 con 0x7f8be8101b60 2024-03-27T08:35:13.392 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 msgr2=0x7f8bd00a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 0x7f8bd00a5ad0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4005c40 tx=0x7f8bd4005fd0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 msgr2=0x7f8be8197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc00c970 tx=0x7f8bdc00ce30 comp rx=0 tx=0).stop 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 shutdown_connections 2024-03-27T08:35:13.395 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8bd00a3610 0x7f8bd00a5ad0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8be8103710 0x7f8be819f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8be8102d50 0x7f8be8198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 --2- 172.21.15.164:0/3110044811 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8be8101b60 0x7f8be8197e50 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 >> 172.21.15.164:0/3110044811 conn(0x7f8be80fd0f0 msgr2=0x7f8be8106120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.403+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 shutdown_connections 2024-03-27T08:35:13.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.404+0000 7f8bf0600640 1 -- 172.21.15.164:0/3110044811 wait complete. 2024-03-27T08:35:13.414 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:35:13.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 -- 172.21.15.164:0/3743037852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109180 msgr2=0x7f7724109600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 --2- 172.21.15.164:0/3743037852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109180 0x7f7724109600 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f770c009900 tx=0x7f770c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 -- 172.21.15.164:0/3743037852 shutdown_connections 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 --2- 172.21.15.164:0/3743037852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109b40 0x7f77241103d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 --2- 172.21.15.164:0/3743037852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109180 0x7f7724109600 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 --2- 172.21.15.164:0/3743037852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 0x7f77241083b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 -- 172.21.15.164:0/3743037852 >> 172.21.15.164:0/3743037852 conn(0x7f7724076f20 msgr2=0x7f7724079360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 -- 172.21.15.164:0/3743037852 shutdown_connections 2024-03-27T08:35:13.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.630+0000 7f7723e00640 1 -- 172.21.15.164:0/3743037852 wait complete. 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.631+0000 7f7723e00640 1 Processor -- start 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 -- start start 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 0x7f772419e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109180 0x7f772419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7724113bf0 con 0x7f7724109b40 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7724113a70 con 0x7f7724109180 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7724113d70 con 0x7f7724107f90 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45778/0 (socket says 172.21.15.164:45778) 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.632+0000 7f7723400640 1 -- 172.21.15.164:0/1845607248 learned_addr learned my addr 172.21.15.164:0/1845607248 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7722a00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 0x7f772419e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f771a000640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109180 0x7f772419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 -- 172.21.15.164:0/1845607248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 msgr2=0x7f772419e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 0x7f772419e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 -- 172.21.15.164:0/1845607248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109180 msgr2=0x7f772419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109180 0x7f772419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 -- 172.21.15.164:0/1845607248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77241a5e80 con 0x7f7724109b40 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723400640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f771c00eaa0 tx=0x7f771c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c00cdb0 con 0x7f7724109b40 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77241a6170 con 0x7f7724109b40 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f771c005020 con 0x7f7724109b40 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f771c0116b0 con 0x7f7724109b40 2024-03-27T08:35:13.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.633+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77241a66c0 con 0x7f7724109b40 2024-03-27T08:35:13.627 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.635+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f772410f300 con 0x7f7724109b40 2024-03-27T08:35:13.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.636+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f771c0051d0 con 0x7f7724109b40 2024-03-27T08:35:13.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.638+0000 7f771be00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 0x7f77080a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:13.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.638+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f771c0d0030 con 0x7f7724109b40 2024-03-27T08:35:13.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.638+0000 7f7722a00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 0x7f77080a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:13.630 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.639+0000 7f7722a00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 0x7f77080a5ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7714005fd0 tx=0x7f7714005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:13.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.642+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f771c016030 con 0x7f7724109b40 2024-03-27T08:35:13.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:13 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3488484165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:13 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3110044811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:13 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3488484165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:13 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3110044811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.831+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7724062750 con 0x7f7724109b40 2024-03-27T08:35:13.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:13 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3488484165' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:13 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3110044811' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:13.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.834+0000 7f771be00640 1 -- 172.21.15.164:0/1845607248 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f771c09cc10 con 0x7f7724109b40 2024-03-27T08:35:13.826 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:13.826 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:35:13.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 msgr2=0x7f77080a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 0x7f77080a5ad0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f7714005fd0 tx=0x7f7714005850 comp rx=0 tx=0).stop 2024-03-27T08:35:13.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 msgr2=0x7f77241a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:13.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f771c00eaa0 tx=0x7f771c00ef60 comp rx=0 tx=0).stop 2024-03-27T08:35:13.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 shutdown_connections 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f77080a3610 0x7f77080a5ad0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7724109b40 0x7f77241a5810 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7724109180 0x7f772419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 --2- 172.21.15.164:0/1845607248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7724107f90 0x7f772419e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 >> 172.21.15.164:0/1845607248 conn(0x7f7724076f20 msgr2=0x7f772410c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 shutdown_connections 2024-03-27T08:35:13.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:13.836+0000 7f7723e00640 1 -- 172.21.15.164:0/1845607248 wait complete. 2024-03-27T08:35:13.846 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:35:13.846 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 -- 172.21.15.164:0/1895295898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8104f80 msgr2=0x7f48d8105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 --2- 172.21.15.164:0/1895295898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8104f80 0x7f48d8105400 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f48c0009ca0 tx=0x7f48c002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 -- 172.21.15.164:0/1895295898 shutdown_connections 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 --2- 172.21.15.164:0/1895295898 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8105940 0x7f48d810c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 --2- 172.21.15.164:0/1895295898 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8104f80 0x7f48d8105400 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 --2- 172.21.15.164:0/1895295898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d81041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 -- 172.21.15.164:0/1895295898 >> 172.21.15.164:0/1895295898 conn(0x7f48d80ff300 msgr2=0x7f48d8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:14.059 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 -- 172.21.15.164:0/1895295898 shutdown_connections 2024-03-27T08:35:14.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.067+0000 7f48dcc00640 1 -- 172.21.15.164:0/1895295898 wait complete. 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 Processor -- start 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 -- start start 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d819a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8104f80 0x7f48d819a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 0x7f48d81a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810f9f0 con 0x7f48d8105940 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810f870 con 0x7f48d8103d90 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.068+0000 7f48dcc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f48d810fb70 con 0x7f48d8104f80 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 0x7f48d81a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d819a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.062 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d5e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d819a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:58406/0 (socket says 172.21.15.164:58406) 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d5e00640 1 -- 172.21.15.164:0/4137569203 learned_addr learned my addr 172.21.15.164:0/4137569203 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d5400640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8104f80 0x7f48d819a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 -- 172.21.15.164:0/4137569203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8104f80 msgr2=0x7f48d819a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8104f80 0x7f48d819a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 -- 172.21.15.164:0/4137569203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 msgr2=0x7f48d819a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d819a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 -- 172.21.15.164:0/4137569203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48d81a1cd0 con 0x7f48d8105940 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48d6800640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 0x7f48d81a1660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f48d000d680 tx=0x7f48d000db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.069+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0017070 con 0x7f48d8105940 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.070+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48d0009820 con 0x7f48d8105940 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.070+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48d81a1fc0 con 0x7f48d8105940 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.070+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d0004d10 con 0x7f48d8105940 2024-03-27T08:35:14.063 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.070+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48d81a2480 con 0x7f48d8105940 2024-03-27T08:35:14.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.071+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d810b120 con 0x7f48d8105940 2024-03-27T08:35:14.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.073+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f48d00099d0 con 0x7f48d8105940 2024-03-27T08:35:14.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.074+0000 7f48cea00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 0x7f48b80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.074+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f48d00cf5e0 con 0x7f48d8105940 2024-03-27T08:35:14.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.074+0000 7f48d5e00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 0x7f48b80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.075+0000 7f48d5e00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 0x7f48b80a5b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48c80058c0 tx=0x7f48c8005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.079+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f48d009c160 con 0x7f48d8105940 2024-03-27T08:35:14.271 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.280+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f48d80627f0 con 0x7f48d8105940 2024-03-27T08:35:14.272 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.280+0000 7f48cea00640 1 -- 172.21.15.164:0/4137569203 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f48d009ba60 con 0x7f48d8105940 2024-03-27T08:35:14.272 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:35:14.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 msgr2=0x7f48b80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 0x7f48b80a5b50 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f48c80058c0 tx=0x7f48c8005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:14.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 msgr2=0x7f48d81a1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.275 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 0x7f48d81a1660 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f48d000d680 tx=0x7f48d000db40 comp rx=0 tx=0).stop 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 shutdown_connections 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f48b80a3690 0x7f48b80a5b50 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f48d8105940 0x7f48d81a1660 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f48d8104f80 0x7f48d819a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 --2- 172.21.15.164:0/4137569203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48d8103d90 0x7f48d819a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 >> 172.21.15.164:0/4137569203 conn(0x7f48d80ff300 msgr2=0x7f48d81082f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.283+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 shutdown_connections 2024-03-27T08:35:14.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.284+0000 7f48dcc00640 1 -- 172.21.15.164:0/4137569203 wait complete. 2024-03-27T08:35:14.293 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.526+0000 7f4437600640 1 -- 172.21.15.164:0/1800431411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44300ff750 msgr2=0x7f44300ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.526+0000 7f4437600640 1 --2- 172.21.15.164:0/1800431411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44300ff750 0x7f44300ffb70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f4420009900 tx=0x7f442002bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 -- 172.21.15.164:0/1800431411 shutdown_connections 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 --2- 172.21.15.164:0/1800431411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4430107860 0x7f4430109c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 --2- 172.21.15.164:0/1800431411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 0x7f4430107320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 --2- 172.21.15.164:0/1800431411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f44300ff750 0x7f44300ffb70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 -- 172.21.15.164:0/1800431411 >> 172.21.15.164:0/1800431411 conn(0x7f44300fb310 msgr2=0x7f44300fd750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 -- 172.21.15.164:0/1800431411 shutdown_connections 2024-03-27T08:35:14.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.527+0000 7f4437600640 1 -- 172.21.15.164:0/1800431411 wait complete. 2024-03-27T08:35:14.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.528+0000 7f4437600640 1 Processor -- start 2024-03-27T08:35:14.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 -- start start 2024-03-27T08:35:14.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300ff750 0x7f4430197ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 0x7f4430198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.522 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f443010d820 con 0x7f4430107860 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f443010d6a0 con 0x7f44301000b0 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4437600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f443010d9a0 con 0x7f44300ff750 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.529+0000 7f4435600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45804/0 (socket says 172.21.15.164:45804) 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 -- 172.21.15.164:0/186948654 learned_addr learned my addr 172.21.15.164:0/186948654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4427e00640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 0x7f4430198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4434c00640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300ff750 0x7f4430197ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 -- 172.21.15.164:0/186948654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300ff750 msgr2=0x7f4430197ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300ff750 0x7f4430197ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 -- 172.21.15.164:0/186948654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 msgr2=0x7f4430198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 0x7f4430198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.523 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 -- 172.21.15.164:0/186948654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f443019fac0 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.530+0000 7f4435600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f442800eaa0 tx=0x7f442800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.531+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442800cdb0 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.531+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f443019fdb0 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.531+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4428005020 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.531+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f442801f060 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.531+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44301a0280 con 0x7f4430107860 2024-03-27T08:35:14.524 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.532+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44301a0510 con 0x7f4430107860 2024-03-27T08:35:14.525 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.534+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f44280051d0 con 0x7f4430107860 2024-03-27T08:35:14.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.535+0000 7f442e000640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 0x7f44140a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.535+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f44280d0000 con 0x7f4430107860 2024-03-27T08:35:14.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.536+0000 7f4434c00640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 0x7f44140a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.528 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.536+0000 7f4434c00640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 0x7f44140a5ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4420006010 tx=0x7f4420000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.540+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4428016030 con 0x7f4430107860 2024-03-27T08:35:14.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.742+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f44301a06e0 con 0x7f4430107860 2024-03-27T08:35:14.734 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.743+0000 7f442e000640 1 -- 172.21.15.164:0/186948654 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f442809cbe0 con 0x7f4430107860 2024-03-27T08:35:14.734 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.745+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 msgr2=0x7f44140a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.745+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 0x7f44140a5ad0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4420006010 tx=0x7f4420000bc0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.745+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 msgr2=0x7f443019f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.745+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f442800eaa0 tx=0x7f442800ef60 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 shutdown_connections 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f44140a3610 0x7f44140a5ad0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4430107860 0x7f443019f450 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f44301000b0 0x7f4430198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 --2- 172.21.15.164:0/186948654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44300ff750 0x7f4430197ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 >> 172.21.15.164:0/186948654 conn(0x7f44300fb310 msgr2=0x7f44300fbf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:14.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 shutdown_connections 2024-03-27T08:35:14.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.746+0000 7f4437600640 1 -- 172.21.15.164:0/186948654 wait complete. 2024-03-27T08:35:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:14 smithi164 ceph-mon[31788]: pgmap v438: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:35:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:14 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1845607248' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:14 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4137569203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:14.757 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:35:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:14 smithi167 ceph-mon[34903]: pgmap v438: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:35:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:14 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1845607248' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:14 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4137569203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:14 smithi173 ceph-mon[35397]: pgmap v438: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:35:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:14 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1845607248' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:14 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4137569203' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:14.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 -- 172.21.15.164:0/3217073843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b80780f0 msgr2=0x7f11b8078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 --2- 172.21.15.164:0/3217073843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b80780f0 0x7f11b8078990 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009ca0 tx=0x7f11b002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 -- 172.21.15.164:0/3217073843 shutdown_connections 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 --2- 172.21.15.164:0/3217073843 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b80780f0 0x7f11b8078990 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 --2- 172.21.15.164:0/3217073843 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11b8077750 0x7f11b8077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 --2- 172.21.15.164:0/3217073843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b8076510 0x7f11b8076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 -- 172.21.15.164:0/3217073843 >> 172.21.15.164:0/3217073843 conn(0x7f11b80ff300 msgr2=0x7f11b8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 -- 172.21.15.164:0/3217073843 shutdown_connections 2024-03-27T08:35:14.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.979+0000 7f11be600640 1 -- 172.21.15.164:0/3217073843 wait complete. 2024-03-27T08:35:14.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.980+0000 7f11be600640 1 Processor -- start 2024-03-27T08:35:14.974 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 -- start start 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11b8076510 0x7f11b819e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 0x7f11b81a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8113df0 con 0x7f11b8077750 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8113c70 con 0x7f11b80780f0 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11be600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8113f70 con 0x7f11b8076510 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45826/0 (socket says 172.21.15.164:45826) 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 -- 172.21.15.164:0/2906769862 learned_addr learned my addr 172.21.15.164:0/2906769862 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b7e00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 0x7f11b81a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 -- 172.21.15.164:0/2906769862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11b8076510 msgr2=0x7f11b819e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11b8076510 0x7f11b819e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.975 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 -- 172.21.15.164:0/2906769862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 msgr2=0x7f11b81a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 0x7f11b81a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b6a00640 1 -- 172.21.15.164:0/2906769862 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b81a60e0 con 0x7f11b8077750 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.981+0000 7f11b7e00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 0x7f11b81a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11b6a00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e9f0 tx=0x7f11a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a000cd80 con 0x7f11b8077750 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f11a00054f0 con 0x7f11b8077750 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a0010690 con 0x7f11b8077750 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81a63d0 con 0x7f11b8077750 2024-03-27T08:35:14.976 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.982+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81a68d0 con 0x7f11b8077750 2024-03-27T08:35:14.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.983+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11b8110700 con 0x7f11b8077750 2024-03-27T08:35:14.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.985+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f11a0004f20 con 0x7f11b8077750 2024-03-27T08:35:14.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.987+0000 7f11afe00640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 0x7f119c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:14.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.988+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f11a00d02d0 con 0x7f11b8077750 2024-03-27T08:35:14.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.988+0000 7f11b7400640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 0x7f119c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:14.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.988+0000 7f11b7400640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 0x7f119c0a5ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11a80058c0 tx=0x7f11a8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:14.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:14.992+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f11a009ce50 con 0x7f11b8077750 2024-03-27T08:35:15.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.191+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f11b8062780 con 0x7f11b8077750 2024-03-27T08:35:15.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.192+0000 7f11afe00640 1 -- 172.21.15.164:0/2906769862 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f11a009c750 con 0x7f11b8077750 2024-03-27T08:35:15.184 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:35:15.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.194+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 msgr2=0x7f119c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.194+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 0x7f119c0a5ad0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f11a80058c0 tx=0x7f11a8005850 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.194+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 msgr2=0x7f11b819ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.194+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11a000e9f0 tx=0x7f11a000edf0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 shutdown_connections 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f119c0a3610 0x7f119c0a5ad0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f11b80780f0 0x7f11b81a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f11b8077750 0x7f11b819ea00 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 --2- 172.21.15.164:0/2906769862 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f11b8076510 0x7f11b819e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 >> 172.21.15.164:0/2906769862 conn(0x7f11b80ff300 msgr2=0x7f11b8100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 shutdown_connections 2024-03-27T08:35:15.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.195+0000 7f11be600640 1 -- 172.21.15.164:0/2906769862 wait complete. 2024-03-27T08:35:15.205 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-03-27T08:35:15.205 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:35:15.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 -- 172.21.15.164:0/1066853354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 msgr2=0x7f335410c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 --2- 172.21.15.164:0/1066853354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f335410c1d0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f334c009ca0 tx=0x7f334c02c100 comp rx=0 tx=0).stop 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 -- 172.21.15.164:0/1066853354 shutdown_connections 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 --2- 172.21.15.164:0/1066853354 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f335410c1d0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 --2- 172.21.15.164:0/1066853354 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354104f80 0x7f3354105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 --2- 172.21.15.164:0/1066853354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354103d90 0x7f33541041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.431+0000 7f335b400640 1 -- 172.21.15.164:0/1066853354 >> 172.21.15.164:0/1066853354 conn(0x7f33540ff300 msgr2=0x7f3354101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.432+0000 7f335b400640 1 -- 172.21.15.164:0/1066853354 shutdown_connections 2024-03-27T08:35:15.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.432+0000 7f335b400640 1 -- 172.21.15.164:0/1066853354 wait complete. 2024-03-27T08:35:15.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.432+0000 7f335b400640 1 Processor -- start 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 -- start start 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354103d90 0x7f3354199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354104f80 0x7f335419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f335410f9e0 con 0x7f3354105940 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f335410f860 con 0x7f3354104f80 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f335b400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f335410fb60 con 0x7f3354103d90 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f3359400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f3359400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49222/0 (socket says 172.21.15.164:49222) 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f3359400640 1 -- 172.21.15.164:0/3807083064 learned_addr learned my addr 172.21.15.164:0/3807083064 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f3353e00640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354104f80 0x7f335419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.433+0000 7f3358a00640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354103d90 0x7f3354199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 -- 172.21.15.164:0/3807083064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354103d90 msgr2=0x7f3354199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354103d90 0x7f3354199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 -- 172.21.15.164:0/3807083064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354104f80 msgr2=0x7f335419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354104f80 0x7f335419a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 -- 172.21.15.164:0/3807083064 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33541a1c10 con 0x7f3354105940 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3359400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f334c005e30 tx=0x7f334c034cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c039050 con 0x7f3354105940 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f334c03a040 con 0x7f3354105940 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33541a1ea0 con 0x7f3354105940 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f334c0046e0 con 0x7f3354105940 2024-03-27T08:35:15.428 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.434+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33541a2300 con 0x7f3354105940 2024-03-27T08:35:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.436+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f335410b050 con 0x7f3354105940 2024-03-27T08:35:15.429 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.437+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f334c003970 con 0x7f3354105940 2024-03-27T08:35:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.439+0000 7f3351600640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 0x7f333c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.439+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f334c0f2570 con 0x7f3354105940 2024-03-27T08:35:15.430 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.439+0000 7f3358a00640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 0x7f333c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.440+0000 7f3358a00640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 0x7f333c0a5ad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3344005d00 tx=0x7f3344005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:15.434 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.443+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f334c0bf150 con 0x7f3354105940 2024-03-27T08:35:15.671 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.679+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3354062750 con 0x7f3354105940 2024-03-27T08:35:15.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.680+0000 7f3351600640 1 -- 172.21.15.164:0/3807083064 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11888 (secure 0 0 0) 0x7f334c0bea50 con 0x7f3354105940 2024-03-27T08:35:15.673 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:15.673 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:35:11.240118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34502,34430,34463]},"id":1}]} 2024-03-27T08:35:15.673 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 msgr2=0x7f333c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 0x7f333c0a5ad0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3344005d00 tx=0x7f3344005c50 comp rx=0 tx=0).stop 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 msgr2=0x7f33541a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f334c005e30 tx=0x7f334c034cf0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 shutdown_connections 2024-03-27T08:35:15.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f333c0a3610 0x7f333c0a5ad0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3354105940 0x7f33541a15a0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3354104f80 0x7f335419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 --2- 172.21.15.164:0/3807083064 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3354103d90 0x7f3354199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.683+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 >> 172.21.15.164:0/3807083064 conn(0x7f33540ff300 msgr2=0x7f3354108220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.684+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 shutdown_connections 2024-03-27T08:35:15.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.684+0000 7f335b400640 1 -- 172.21.15.164:0/3807083064 wait complete. 2024-03-27T08:35:15.694 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-03-27T08:35:15.695 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-03-27T08:35:15.695 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T08:35:15.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:15 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/186948654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:15 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2906769862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:15 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/186948654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:15 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2906769862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:15 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/186948654' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:15 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2906769862' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 -- 172.21.15.164:0/3807559915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109d20 msgr2=0x7f35881105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 --2- 172.21.15.164:0/3807559915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109d20 0x7f35881105b0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f3580009ca0 tx=0x7f358002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 -- 172.21.15.164:0/3807559915 shutdown_connections 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 --2- 172.21.15.164:0/3807559915 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109d20 0x7f35881105b0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 --2- 172.21.15.164:0/3807559915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588109360 0x7f35881097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 --2- 172.21.15.164:0/3807559915 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588108170 0x7f3588108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 -- 172.21.15.164:0/3807559915 >> 172.21.15.164:0/3807559915 conn(0x7f3588077130 msgr2=0x7f3588079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 -- 172.21.15.164:0/3807559915 shutdown_connections 2024-03-27T08:35:15.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.916+0000 7f358dc00640 1 -- 172.21.15.164:0/3807559915 wait complete. 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 Processor -- start 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 -- start start 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588108170 0x7f358819e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588109d20 0x7f35881a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3588113dd0 con 0x7f3588109360 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3588113c50 con 0x7f3588108170 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f358dc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3588113f50 con 0x7f3588109d20 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.917+0000 7f357fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49250/0 (socket says 172.21.15.164:49250) 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 -- 172.21.15.164:0/2182677688 learned_addr learned my addr 172.21.15.164:0/2182677688 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f3586a00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588108170 0x7f358819e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f3587400640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588109d20 0x7f35881a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 -- 172.21.15.164:0/2182677688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588109d20 msgr2=0x7f35881a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588109d20 0x7f35881a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 -- 172.21.15.164:0/2182677688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588108170 msgr2=0x7f358819e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588108170 0x7f358819e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 -- 172.21.15.164:0/2182677688 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35881a5ff0 con 0x7f3588109360 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.918+0000 7f357fe00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f357000d950 tx=0x7f357000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.919+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3570017070 con 0x7f3588109360 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.919+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3570009c30 con 0x7f3588109360 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.919+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357000f6b0 con 0x7f3588109360 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.919+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35881a62e0 con 0x7f3588109360 2024-03-27T08:35:15.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.919+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35881a6880 con 0x7f3588109360 2024-03-27T08:35:15.913 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.920+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f358810f430 con 0x7f3588109360 2024-03-27T08:35:15.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.922+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3570010a50 con 0x7f3588109360 2024-03-27T08:35:15.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.924+0000 7f357f400640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 0x7f356c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:15.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.924+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f35700cf980 con 0x7f3588109360 2024-03-27T08:35:15.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.924+0000 7f3586a00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 0x7f356c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:15.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.925+0000 7f3586a00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 0x7f356c0a5b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35881091c0 tx=0x7f357800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:15.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:15.928+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f3570009de0 con 0x7f3588109360 2024-03-27T08:35:16.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.124+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3588061f90 con 0x7f356c0a3690 2024-03-27T08:35:16.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.132+0000 7f357f400640 1 -- 172.21.15.164:0/2182677688 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7f3588061f90 con 0x7f356c0a3690 2024-03-27T08:35:16.128 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:16.129 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 msgr2=0x7f356c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 0x7f356c0a5b50 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f35881091c0 tx=0x7f357800b390 comp rx=0 tx=0).stop 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 msgr2=0x7f358819e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f357000d950 tx=0x7f357000de10 comp rx=0 tx=0).stop 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 shutdown_connections 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f356c0a3690 0x7f356c0a5b50 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3588109d20 0x7f35881a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3588109360 0x7f358819e910 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.131 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 --2- 172.21.15.164:0/2182677688 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588108170 0x7f358819e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.137+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 >> 172.21.15.164:0/2182677688 conn(0x7f3588077130 msgr2=0x7f358810c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:16.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.138+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 shutdown_connections 2024-03-27T08:35:16.132 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.138+0000 7f358dc00640 1 -- 172.21.15.164:0/2182677688 wait complete. 2024-03-27T08:35:16.146 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-03-27T08:35:15.366485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661832,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1002,"num_read_kb":619,"num_write":359,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366820,"kb_used_data":13508,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575004,"statfs":{"total":1151940427776,"available":1151564804096,"internally_reserved":0,"allocated":13832192,"data_stored":7593030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":38,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005690"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332430+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:34:17.332430+0000","last_peered":"2024-03-27T08:34:17.332430+0000","last_clean":"2024-03-27T08:34:17.332430+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:34:17.332430+0000","last_undegraded":"2024-03-27T08:34:17.332430+0000","last_fullsized":"2024-03-27T08:34:17.332430+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329999+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:34:17.329999+0000","last_peered":"2024-03-27T08:34:17.329999+0000","last_clean":"2024-03-27T08:34:17.329999+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:34:17.329999+0000","last_undegraded":"2024-03-27T08:34:17.329999+0000","last_fullsized":"2024-03-27T08:34:17.329999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.333506+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:34:17.333506+0000","last_peered":"2024-03-27T08:34:17.333506+0000","last_clean":"2024-03-27T08:34:17.333506+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:34:17.333506+0000","last_undegraded":"2024-03-27T08:34:17.333506+0000","last_fullsized":"2024-03-27T08:34:17.333506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311829+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:34:17.311829+0000","last_peered":"2024-03-27T08:34:17.311829+0000","last_clean":"2024-03-27T08:34:17.311829+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:34:17.311829+0000","last_undegraded":"2024-03-27T08:34:17.311829+0000","last_fullsized":"2024-03-27T08:34:17.311829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.295664+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:34:17.295664+0000","last_peered":"2024-03-27T08:34:17.295664+0000","last_clean":"2024-03-27T08:34:17.295664+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:34:17.295664+0000","last_undegraded":"2024-03-27T08:34:17.295664+0000","last_fullsized":"2024-03-27T08:34:17.295664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328978+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:34:17.328978+0000","last_peered":"2024-03-27T08:34:17.328978+0000","last_clean":"2024-03-27T08:34:17.328978+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:34:17.328978+0000","last_undegraded":"2024-03-27T08:34:17.328978+0000","last_fullsized":"2024-03-27T08:34:17.328978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.309182+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:34:17.309182+0000","last_peered":"2024-03-27T08:34:17.309182+0000","last_clean":"2024-03-27T08:34:17.309182+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:34:17.309182+0000","last_undegraded":"2024-03-27T08:34:17.309182+0000","last_fullsized":"2024-03-27T08:34:17.309182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.323953+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:34:17.323953+0000","last_peered":"2024-03-27T08:34:17.323953+0000","last_clean":"2024-03-27T08:34:17.323953+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:34:17.323953+0000","last_undegraded":"2024-03-27T08:34:17.323953+0000","last_fullsized":"2024-03-27T08:34:17.323953+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335156+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:34:17.335156+0000","last_peered":"2024-03-27T08:34:17.335156+0000","last_clean":"2024-03-27T08:34:17.335156+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:34:17.335156+0000","last_undegraded":"2024-03-27T08:34:17.335156+0000","last_fullsized":"2024-03-27T08:34:17.335156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329524+0000","last_change":"2024-03-27T08:33:18.668027+0000","last_active":"2024-03-27T08:34:17.329524+0000","last_peered":"2024-03-27T08:34:17.329524+0000","last_clean":"2024-03-27T08:34:17.329524+0000","last_became_active":"2024-03-27T08:33:18.667495+0000","last_became_peered":"2024-03-27T08:33:18.667495+0000","last_unstale":"2024-03-27T08:34:17.329524+0000","last_undegraded":"2024-03-27T08:34:17.329524+0000","last_fullsized":"2024-03-27T08:34:17.329524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:00:53.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331834+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:34:17.331834+0000","last_peered":"2024-03-27T08:34:17.331834+0000","last_clean":"2024-03-27T08:34:17.331834+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:34:17.331834+0000","last_undegraded":"2024-03-27T08:34:17.331834+0000","last_fullsized":"2024-03-27T08:34:17.331834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326031+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:34:17.326031+0000","last_peered":"2024-03-27T08:34:17.326031+0000","last_clean":"2024-03-27T08:34:17.326031+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:34:17.326031+0000","last_undegraded":"2024-03-27T08:34:17.326031+0000","last_fullsized":"2024-03-27T08:34:17.326031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322199+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:34:17.322199+0000","last_peered":"2024-03-27T08:34:17.322199+0000","last_clean":"2024-03-27T08:34:17.322199+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:34:17.322199+0000","last_undegraded":"2024-03-27T08:34:17.322199+0000","last_fullsized":"2024-03-27T08:34:17.322199+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330120+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:34:17.330120+0000","last_peered":"2024-03-27T08:34:17.330120+0000","last_clean":"2024-03-27T08:34:17.330120+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:34:17.330120+0000","last_undegraded":"2024-03-27T08:34:17.330120+0000","last_fullsized":"2024-03-27T08:34:17.330120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.310666+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:34:17.310666+0000","last_peered":"2024-03-27T08:34:17.310666+0000","last_clean":"2024-03-27T08:34:17.310666+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:34:17.310666+0000","last_undegraded":"2024-03-27T08:34:17.310666+0000","last_fullsized":"2024-03-27T08:34:17.310666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334623+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:34:17.334623+0000","last_peered":"2024-03-27T08:34:17.334623+0000","last_clean":"2024-03-27T08:34:17.334623+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:34:17.334623+0000","last_undegraded":"2024-03-27T08:34:17.334623+0000","last_fullsized":"2024-03-27T08:34:17.334623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332693+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:34:17.332693+0000","last_peered":"2024-03-27T08:34:17.332693+0000","last_clean":"2024-03-27T08:34:17.332693+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:34:17.332693+0000","last_undegraded":"2024-03-27T08:34:17.332693+0000","last_fullsized":"2024-03-27T08:34:17.332693+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329468+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:34:17.329468+0000","last_peered":"2024-03-27T08:34:17.329468+0000","last_clean":"2024-03-27T08:34:17.329468+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:34:17.329468+0000","last_undegraded":"2024-03-27T08:34:17.329468+0000","last_fullsized":"2024-03-27T08:34:17.329468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311563+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:34:17.311563+0000","last_peered":"2024-03-27T08:34:17.311563+0000","last_clean":"2024-03-27T08:34:17.311563+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:34:17.311563+0000","last_undegraded":"2024-03-27T08:34:17.311563+0000","last_fullsized":"2024-03-27T08:34:17.311563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666643+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:33:18.666643+0000","last_peered":"2024-03-27T08:33:18.666643+0000","last_clean":"2024-03-27T08:33:18.666643+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:33:18.666643+0000","last_undegraded":"2024-03-27T08:33:18.666643+0000","last_fullsized":"2024-03-27T08:33:18.666643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318354+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:34:17.318354+0000","last_peered":"2024-03-27T08:34:17.318354+0000","last_clean":"2024-03-27T08:34:17.318354+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:34:17.318354+0000","last_undegraded":"2024-03-27T08:34:17.318354+0000","last_fullsized":"2024-03-27T08:34:17.318354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467972+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:33:18.467972+0000","last_peered":"2024-03-27T08:33:18.467972+0000","last_clean":"2024-03-27T08:33:18.467972+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:33:18.467972+0000","last_undegraded":"2024-03-27T08:33:18.467972+0000","last_fullsized":"2024-03-27T08:33:18.467972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331956+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:34:17.331956+0000","last_peered":"2024-03-27T08:34:17.331956+0000","last_clean":"2024-03-27T08:34:17.331956+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:34:17.331956+0000","last_undegraded":"2024-03-27T08:34:17.331956+0000","last_fullsized":"2024-03-27T08:34:17.331956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.622405+0000","last_change":"2024-03-27T08:33:18.622405+0000","last_active":"2024-03-27T08:33:18.622405+0000","last_peered":"2024-03-27T08:33:18.622405+0000","last_clean":"2024-03-27T08:33:18.622405+0000","last_became_active":"2024-03-27T08:33:18.614323+0000","last_became_peered":"2024-03-27T08:33:18.614323+0000","last_unstale":"2024-03-27T08:33:18.622405+0000","last_undegraded":"2024-03-27T08:33:18.622405+0000","last_fullsized":"2024-03-27T08:33:18.622405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:33:48.011900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335692+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:34:17.335692+0000","last_peered":"2024-03-27T08:34:17.335692+0000","last_clean":"2024-03-27T08:34:17.335692+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:34:17.335692+0000","last_undegraded":"2024-03-27T08:34:17.335692+0000","last_fullsized":"2024-03-27T08:34:17.335692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460278+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:33:18.460278+0000","last_peered":"2024-03-27T08:33:18.460278+0000","last_clean":"2024-03-27T08:33:18.460278+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:33:18.460278+0000","last_undegraded":"2024-03-27T08:33:18.460278+0000","last_fullsized":"2024-03-27T08:33:18.460278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331396+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:34:17.331396+0000","last_peered":"2024-03-27T08:34:17.331396+0000","last_clean":"2024-03-27T08:34:17.331396+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:34:17.331396+0000","last_undegraded":"2024-03-27T08:34:17.331396+0000","last_fullsized":"2024-03-27T08:34:17.331396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:12.058733+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:35:12.058733+0000","last_peered":"2024-03-27T08:35:12.058733+0000","last_clean":"2024-03-27T08:35:12.058733+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:35:12.058733+0000","last_undegraded":"2024-03-27T08:35:12.058733+0000","last_fullsized":"2024-03-27T08:35:12.058733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327624+0000","last_change":"2024-03-27T08:33:18.667599+0000","last_active":"2024-03-27T08:34:17.327624+0000","last_peered":"2024-03-27T08:34:17.327624+0000","last_clean":"2024-03-27T08:34:17.327624+0000","last_became_active":"2024-03-27T08:33:18.666812+0000","last_became_peered":"2024-03-27T08:33:18.666812+0000","last_unstale":"2024-03-27T08:34:17.327624+0000","last_undegraded":"2024-03-27T08:34:17.327624+0000","last_fullsized":"2024-03-27T08:34:17.327624+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:54:57.708196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456293+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:33:18.456293+0000","last_peered":"2024-03-27T08:33:18.456293+0000","last_clean":"2024-03-27T08:33:18.456293+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:33:18.456293+0000","last_undegraded":"2024-03-27T08:33:18.456293+0000","last_fullsized":"2024-03-27T08:33:18.456293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322316+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:34:17.322316+0000","last_peered":"2024-03-27T08:34:17.322316+0000","last_clean":"2024-03-27T08:34:17.322316+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:34:17.322316+0000","last_undegraded":"2024-03-27T08:34:17.322316+0000","last_fullsized":"2024-03-27T08:34:17.322316+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450289+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:33:18.450289+0000","last_peered":"2024-03-27T08:33:18.450289+0000","last_clean":"2024-03-27T08:33:18.450289+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:33:18.450289+0000","last_undegraded":"2024-03-27T08:33:18.450289+0000","last_fullsized":"2024-03-27T08:33:18.450289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.320033+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:34:17.320033+0000","last_peered":"2024-03-27T08:34:17.320033+0000","last_clean":"2024-03-27T08:34:17.320033+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:34:17.320033+0000","last_undegraded":"2024-03-27T08:34:17.320033+0000","last_fullsized":"2024-03-27T08:34:17.320033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453269+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:33:18.453269+0000","last_peered":"2024-03-27T08:33:18.453269+0000","last_clean":"2024-03-27T08:33:18.453269+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:33:18.453269+0000","last_undegraded":"2024-03-27T08:33:18.453269+0000","last_fullsized":"2024-03-27T08:33:18.453269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330609+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:34:17.330609+0000","last_peered":"2024-03-27T08:34:17.330609+0000","last_clean":"2024-03-27T08:34:17.330609+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:34:17.330609+0000","last_undegraded":"2024-03-27T08:34:17.330609+0000","last_fullsized":"2024-03-27T08:34:17.330609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.054497+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:35:11.054497+0000","last_peered":"2024-03-27T08:35:11.054497+0000","last_clean":"2024-03-27T08:35:11.054497+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:35:11.054497+0000","last_undegraded":"2024-03-27T08:35:11.054497+0000","last_fullsized":"2024-03-27T08:35:11.054497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335271+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:34:17.335271+0000","last_peered":"2024-03-27T08:34:17.335271+0000","last_clean":"2024-03-27T08:34:17.335271+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:34:17.335271+0000","last_undegraded":"2024-03-27T08:34:17.335271+0000","last_fullsized":"2024-03-27T08:34:17.335271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453641+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:33:18.453641+0000","last_peered":"2024-03-27T08:33:18.453641+0000","last_clean":"2024-03-27T08:33:18.453641+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:33:18.453641+0000","last_undegraded":"2024-03-27T08:33:18.453641+0000","last_fullsized":"2024-03-27T08:33:18.453641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314879+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:34:17.314879+0000","last_peered":"2024-03-27T08:34:17.314879+0000","last_clean":"2024-03-27T08:34:17.314879+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:34:17.314879+0000","last_undegraded":"2024-03-27T08:34:17.314879+0000","last_fullsized":"2024-03-27T08:34:17.314879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.455216+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:33:18.455216+0000","last_peered":"2024-03-27T08:33:18.455216+0000","last_clean":"2024-03-27T08:33:18.455216+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:33:18.455216+0000","last_undegraded":"2024-03-27T08:33:18.455216+0000","last_fullsized":"2024-03-27T08:33:18.455216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335395+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:34:17.335395+0000","last_peered":"2024-03-27T08:34:17.335395+0000","last_clean":"2024-03-27T08:34:17.335395+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:34:17.335395+0000","last_undegraded":"2024-03-27T08:34:17.335395+0000","last_fullsized":"2024-03-27T08:34:17.335395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":345,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.012520+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:35:11.012520+0000","last_peered":"2024-03-27T08:35:11.012520+0000","last_clean":"2024-03-27T08:35:11.012520+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:35:11.012520+0000","last_undegraded":"2024-03-27T08:35:11.012520+0000","last_fullsized":"2024-03-27T08:35:11.012520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66102,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":206,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.306499+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:34:17.306499+0000","last_peered":"2024-03-27T08:34:17.306499+0000","last_clean":"2024-03-27T08:34:17.306499+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:34:17.306499+0000","last_undegraded":"2024-03-27T08:34:17.306499+0000","last_fullsized":"2024-03-27T08:34:17.306499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466773+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:33:18.466773+0000","last_peered":"2024-03-27T08:33:18.466773+0000","last_clean":"2024-03-27T08:33:18.466773+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:33:18.466773+0000","last_undegraded":"2024-03-27T08:33:18.466773+0000","last_fullsized":"2024-03-27T08:33:18.466773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327742+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:34:17.327742+0000","last_peered":"2024-03-27T08:34:17.327742+0000","last_clean":"2024-03-27T08:34:17.327742+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:34:17.327742+0000","last_undegraded":"2024-03-27T08:34:17.327742+0000","last_fullsized":"2024-03-27T08:34:17.327742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453532+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:33:18.453532+0000","last_peered":"2024-03-27T08:33:18.453532+0000","last_clean":"2024-03-27T08:33:18.453532+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:33:18.453532+0000","last_undegraded":"2024-03-27T08:33:18.453532+0000","last_fullsized":"2024-03-27T08:33:18.453532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328759+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:34:17.328759+0000","last_peered":"2024-03-27T08:34:17.328759+0000","last_clean":"2024-03-27T08:34:17.328759+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:34:17.328759+0000","last_undegraded":"2024-03-27T08:34:17.328759+0000","last_fullsized":"2024-03-27T08:34:17.328759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:09.056380+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:35:09.056380+0000","last_peered":"2024-03-27T08:35:09.056380+0000","last_clean":"2024-03-27T08:35:09.056380+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:35:09.056380+0000","last_undegraded":"2024-03-27T08:35:09.056380+0000","last_fullsized":"2024-03-27T08:35:09.056380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326775+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:34:17.326775+0000","last_peered":"2024-03-27T08:34:17.326775+0000","last_clean":"2024-03-27T08:34:17.326775+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:34:17.326775+0000","last_undegraded":"2024-03-27T08:34:17.326775+0000","last_fullsized":"2024-03-27T08:34:17.326775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.511034+0000","last_change":"2024-03-27T08:33:18.509705+0000","last_active":"2024-03-27T08:33:18.511034+0000","last_peered":"2024-03-27T08:33:18.511034+0000","last_clean":"2024-03-27T08:33:18.511034+0000","last_became_active":"2024-03-27T08:33:18.470729+0000","last_became_peered":"2024-03-27T08:33:18.470729+0000","last_unstale":"2024-03-27T08:33:18.511034+0000","last_undegraded":"2024-03-27T08:33:18.511034+0000","last_fullsized":"2024-03-27T08:33:18.511034+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:16.965904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.325173+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:34:17.325173+0000","last_peered":"2024-03-27T08:34:17.325173+0000","last_clean":"2024-03-27T08:34:17.325173+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:34:17.325173+0000","last_undegraded":"2024-03-27T08:34:17.325173+0000","last_fullsized":"2024-03-27T08:34:17.325173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460393+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:33:18.460393+0000","last_peered":"2024-03-27T08:33:18.460393+0000","last_clean":"2024-03-27T08:33:18.460393+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:33:18.460393+0000","last_undegraded":"2024-03-27T08:33:18.460393+0000","last_fullsized":"2024-03-27T08:33:18.460393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314538+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:34:17.314538+0000","last_peered":"2024-03-27T08:34:17.314538+0000","last_clean":"2024-03-27T08:34:17.314538+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:34:17.314538+0000","last_undegraded":"2024-03-27T08:34:17.314538+0000","last_fullsized":"2024-03-27T08:34:17.314538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666246+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:33:18.666246+0000","last_peered":"2024-03-27T08:33:18.666246+0000","last_clean":"2024-03-27T08:33:18.666246+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:33:18.666246+0000","last_undegraded":"2024-03-27T08:33:18.666246+0000","last_fullsized":"2024-03-27T08:33:18.666246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329418+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:34:17.329418+0000","last_peered":"2024-03-27T08:34:17.329418+0000","last_clean":"2024-03-27T08:34:17.329418+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:34:17.329418+0000","last_undegraded":"2024-03-27T08:34:17.329418+0000","last_fullsized":"2024-03-27T08:34:17.329418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453177+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:33:18.453177+0000","last_peered":"2024-03-27T08:33:18.453177+0000","last_clean":"2024-03-27T08:33:18.453177+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:33:18.453177+0000","last_undegraded":"2024-03-27T08:33:18.453177+0000","last_fullsized":"2024-03-27T08:33:18.453177+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330304+0000","last_change":"2024-03-27T08:33:18.668500+0000","last_active":"2024-03-27T08:34:17.330304+0000","last_peered":"2024-03-27T08:34:17.330304+0000","last_clean":"2024-03-27T08:34:17.330304+0000","last_became_active":"2024-03-27T08:33:18.668118+0000","last_became_peered":"2024-03-27T08:33:18.668118+0000","last_unstale":"2024-03-27T08:34:17.330304+0000","last_undegraded":"2024-03-27T08:34:17.330304+0000","last_fullsized":"2024-03-27T08:34:17.330304+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:47.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317752+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:34:17.317752+0000","last_peered":"2024-03-27T08:34:17.317752+0000","last_clean":"2024-03-27T08:34:17.317752+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:34:17.317752+0000","last_undegraded":"2024-03-27T08:34:17.317752+0000","last_fullsized":"2024-03-27T08:34:17.317752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:13.066183+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:35:13.066183+0000","last_peered":"2024-03-27T08:35:13.066183+0000","last_clean":"2024-03-27T08:35:13.066183+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:35:13.066183+0000","last_undegraded":"2024-03-27T08:35:13.066183+0000","last_fullsized":"2024-03-27T08:35:13.066183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":143,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331488+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:34:17.331488+0000","last_peered":"2024-03-27T08:34:17.331488+0000","last_clean":"2024-03-27T08:34:17.331488+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:34:17.331488+0000","last_undegraded":"2024-03-27T08:34:17.331488+0000","last_fullsized":"2024-03-27T08:34:17.331488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613253+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:33:18.613253+0000","last_peered":"2024-03-27T08:33:18.613253+0000","last_clean":"2024-03-27T08:33:18.613253+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:33:18.613253+0000","last_undegraded":"2024-03-27T08:33:18.613253+0000","last_fullsized":"2024-03-27T08:33:18.613253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452942+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:33:18.452942+0000","last_peered":"2024-03-27T08:33:18.452942+0000","last_clean":"2024-03-27T08:33:18.452942+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:33:18.452942+0000","last_undegraded":"2024-03-27T08:33:18.452942+0000","last_fullsized":"2024-03-27T08:33:18.452942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314265+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:34:17.314265+0000","last_peered":"2024-03-27T08:34:17.314265+0000","last_clean":"2024-03-27T08:34:17.314265+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:34:17.314265+0000","last_undegraded":"2024-03-27T08:34:17.314265+0000","last_fullsized":"2024-03-27T08:34:17.314265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453069+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:33:18.453069+0000","last_peered":"2024-03-27T08:33:18.453069+0000","last_clean":"2024-03-27T08:33:18.453069+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:33:18.453069+0000","last_undegraded":"2024-03-27T08:33:18.453069+0000","last_fullsized":"2024-03-27T08:33:18.453069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462095+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:33:18.462095+0000","last_peered":"2024-03-27T08:33:18.462095+0000","last_clean":"2024-03-27T08:33:18.462095+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:33:18.462095+0000","last_undegraded":"2024-03-27T08:33:18.462095+0000","last_fullsized":"2024-03-27T08:33:18.462095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314390+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:34:17.314390+0000","last_peered":"2024-03-27T08:34:17.314390+0000","last_clean":"2024-03-27T08:34:17.314390+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:34:17.314390+0000","last_undegraded":"2024-03-27T08:34:17.314390+0000","last_fullsized":"2024-03-27T08:34:17.314390+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:58.577766+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:34:58.577766+0000","last_peered":"2024-03-27T08:34:58.577766+0000","last_clean":"2024-03-27T08:34:58.577766+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:34:58.577766+0000","last_undegraded":"2024-03-27T08:34:58.577766+0000","last_fullsized":"2024-03-27T08:34:58.577766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329362+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:34:17.329362+0000","last_peered":"2024-03-27T08:34:17.329362+0000","last_clean":"2024-03-27T08:34:17.329362+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:34:17.329362+0000","last_undegraded":"2024-03-27T08:34:17.329362+0000","last_fullsized":"2024-03-27T08:34:17.329362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613561+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:33:18.613561+0000","last_peered":"2024-03-27T08:33:18.613561+0000","last_clean":"2024-03-27T08:33:18.613561+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:33:18.613561+0000","last_undegraded":"2024-03-27T08:33:18.613561+0000","last_fullsized":"2024-03-27T08:33:18.613561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319836+0000","last_change":"2024-03-27T08:33:18.469718+0000","last_active":"2024-03-27T08:34:17.319836+0000","last_peered":"2024-03-27T08:34:17.319836+0000","last_clean":"2024-03-27T08:34:17.319836+0000","last_became_active":"2024-03-27T08:33:18.469083+0000","last_became_peered":"2024-03-27T08:33:18.469083+0000","last_unstale":"2024-03-27T08:34:17.319836+0000","last_undegraded":"2024-03-27T08:34:17.319836+0000","last_fullsized":"2024-03-27T08:34:17.319836+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:13.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661254+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:33:18.661254+0000","last_peered":"2024-03-27T08:33:18.661254+0000","last_clean":"2024-03-27T08:33:18.661254+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:33:18.661254+0000","last_undegraded":"2024-03-27T08:33:18.661254+0000","last_fullsized":"2024-03-27T08:33:18.661254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319660+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:34:17.319660+0000","last_peered":"2024-03-27T08:34:17.319660+0000","last_clean":"2024-03-27T08:34:17.319660+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:34:17.319660+0000","last_undegraded":"2024-03-27T08:34:17.319660+0000","last_fullsized":"2024-03-27T08:34:17.319660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466731+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:33:18.466731+0000","last_peered":"2024-03-27T08:33:18.466731+0000","last_clean":"2024-03-27T08:33:18.466731+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:33:18.466731+0000","last_undegraded":"2024-03-27T08:33:18.466731+0000","last_fullsized":"2024-03-27T08:33:18.466731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314276+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:34:17.314276+0000","last_peered":"2024-03-27T08:34:17.314276+0000","last_clean":"2024-03-27T08:34:17.314276+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:34:17.314276+0000","last_undegraded":"2024-03-27T08:34:17.314276+0000","last_fullsized":"2024-03-27T08:34:17.314276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:21.961137+0000","last_change":"2024-03-27T08:33:18.478350+0000","last_active":"2024-03-27T08:33:21.961137+0000","last_peered":"2024-03-27T08:33:21.961137+0000","last_clean":"2024-03-27T08:33:21.961137+0000","last_became_active":"2024-03-27T08:33:18.470274+0000","last_became_peered":"2024-03-27T08:33:18.470274+0000","last_unstale":"2024-03-27T08:33:21.961137+0000","last_undegraded":"2024-03-27T08:33:21.961137+0000","last_fullsized":"2024-03-27T08:33:21.961137+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:54.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326434+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:34:17.326434+0000","last_peered":"2024-03-27T08:34:17.326434+0000","last_clean":"2024-03-27T08:34:17.326434+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:34:17.326434+0000","last_undegraded":"2024-03-27T08:34:17.326434+0000","last_fullsized":"2024-03-27T08:34:17.326434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459714+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:33:18.459714+0000","last_peered":"2024-03-27T08:33:18.459714+0000","last_clean":"2024-03-27T08:33:18.459714+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:33:18.459714+0000","last_undegraded":"2024-03-27T08:33:18.459714+0000","last_fullsized":"2024-03-27T08:33:18.459714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332297+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:34:17.332297+0000","last_peered":"2024-03-27T08:34:17.332297+0000","last_clean":"2024-03-27T08:34:17.332297+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:34:17.332297+0000","last_undegraded":"2024-03-27T08:34:17.332297+0000","last_fullsized":"2024-03-27T08:34:17.332297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466537+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:33:18.466537+0000","last_peered":"2024-03-27T08:33:18.466537+0000","last_clean":"2024-03-27T08:33:18.466537+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:33:18.466537+0000","last_undegraded":"2024-03-27T08:33:18.466537+0000","last_fullsized":"2024-03-27T08:33:18.466537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332192+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:34:17.332192+0000","last_peered":"2024-03-27T08:34:17.332192+0000","last_clean":"2024-03-27T08:34:17.332192+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:34:17.332192+0000","last_undegraded":"2024-03-27T08:34:17.332192+0000","last_fullsized":"2024-03-27T08:34:17.332192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454622+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:33:18.454622+0000","last_peered":"2024-03-27T08:33:18.454622+0000","last_clean":"2024-03-27T08:33:18.454622+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:33:18.454622+0000","last_undegraded":"2024-03-27T08:33:18.454622+0000","last_fullsized":"2024-03-27T08:33:18.454622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324166+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:34:17.324166+0000","last_peered":"2024-03-27T08:34:17.324166+0000","last_clean":"2024-03-27T08:34:17.324166+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:34:17.324166+0000","last_undegraded":"2024-03-27T08:34:17.324166+0000","last_fullsized":"2024-03-27T08:34:17.324166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450620+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:33:18.450620+0000","last_peered":"2024-03-27T08:33:18.450620+0000","last_clean":"2024-03-27T08:33:18.450620+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:33:18.450620+0000","last_undegraded":"2024-03-27T08:33:18.450620+0000","last_fullsized":"2024-03-27T08:33:18.450620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324055+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:34:17.324055+0000","last_peered":"2024-03-27T08:34:17.324055+0000","last_clean":"2024-03-27T08:34:17.324055+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:34:17.324055+0000","last_undegraded":"2024-03-27T08:34:17.324055+0000","last_fullsized":"2024-03-27T08:34:17.324055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.315671+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:34:17.315671+0000","last_peered":"2024-03-27T08:34:17.315671+0000","last_clean":"2024-03-27T08:34:17.315671+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:34:17.315671+0000","last_undegraded":"2024-03-27T08:34:17.315671+0000","last_fullsized":"2024-03-27T08:34:17.315671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316512+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:34:17.316512+0000","last_peered":"2024-03-27T08:34:17.316512+0000","last_clean":"2024-03-27T08:34:17.316512+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:34:17.316512+0000","last_undegraded":"2024-03-27T08:34:17.316512+0000","last_fullsized":"2024-03-27T08:34:17.316512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314942+0000","last_change":"2024-03-27T08:33:18.669781+0000","last_active":"2024-03-27T08:34:17.314942+0000","last_peered":"2024-03-27T08:34:17.314942+0000","last_clean":"2024-03-27T08:34:17.314942+0000","last_became_active":"2024-03-27T08:33:18.668571+0000","last_became_peered":"2024-03-27T08:33:18.668571+0000","last_unstale":"2024-03-27T08:34:17.314942+0000","last_undegraded":"2024-03-27T08:34:17.314942+0000","last_fullsized":"2024-03-27T08:34:17.314942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:11:18.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316247+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:34:17.316247+0000","last_peered":"2024-03-27T08:34:17.316247+0000","last_clean":"2024-03-27T08:34:17.316247+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:34:17.316247+0000","last_undegraded":"2024-03-27T08:34:17.316247+0000","last_fullsized":"2024-03-27T08:34:17.316247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318542+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:34:17.318542+0000","last_peered":"2024-03-27T08:34:17.318542+0000","last_clean":"2024-03-27T08:34:17.318542+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:34:17.318542+0000","last_undegraded":"2024-03-27T08:34:17.318542+0000","last_fullsized":"2024-03-27T08:34:17.318542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314331+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:34:17.314331+0000","last_peered":"2024-03-27T08:34:17.314331+0000","last_clean":"2024-03-27T08:34:17.314331+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:34:17.314331+0000","last_undegraded":"2024-03-27T08:34:17.314331+0000","last_fullsized":"2024-03-27T08:34:17.314331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331939+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:34:17.331939+0000","last_peered":"2024-03-27T08:34:17.331939+0000","last_clean":"2024-03-27T08:34:17.331939+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:34:17.331939+0000","last_undegraded":"2024-03-27T08:34:17.331939+0000","last_fullsized":"2024-03-27T08:34:17.331939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317997+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:34:17.317997+0000","last_peered":"2024-03-27T08:34:17.317997+0000","last_clean":"2024-03-27T08:34:17.317997+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:34:17.317997+0000","last_undegraded":"2024-03-27T08:34:17.317997+0000","last_fullsized":"2024-03-27T08:34:17.317997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322188+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:34:17.322188+0000","last_peered":"2024-03-27T08:34:17.322188+0000","last_clean":"2024-03-27T08:34:17.322188+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:34:17.322188+0000","last_undegraded":"2024-03-27T08:34:17.322188+0000","last_fullsized":"2024-03-27T08:34:17.322188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322331+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:34:17.322331+0000","last_peered":"2024-03-27T08:34:17.322331+0000","last_clean":"2024-03-27T08:34:17.322331+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:34:17.322331+0000","last_undegraded":"2024-03-27T08:34:17.322331+0000","last_fullsized":"2024-03-27T08:34:17.322331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334093+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:34:17.334093+0000","last_peered":"2024-03-27T08:34:17.334093+0000","last_clean":"2024-03-27T08:34:17.334093+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:34:17.334093+0000","last_undegraded":"2024-03-27T08:34:17.334093+0000","last_fullsized":"2024-03-27T08:34:17.334093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324601+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:34:17.324601+0000","last_peered":"2024-03-27T08:34:17.324601+0000","last_clean":"2024-03-27T08:34:17.324601+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:34:17.324601+0000","last_undegraded":"2024-03-27T08:34:17.324601+0000","last_fullsized":"2024-03-27T08:34:17.324601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.312584+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:34:17.312584+0000","last_peered":"2024-03-27T08:34:17.312584+0000","last_clean":"2024-03-27T08:34:17.312584+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:34:17.312584+0000","last_undegraded":"2024-03-27T08:34:17.312584+0000","last_fullsized":"2024-03-27T08:34:17.312584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71230,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":876,"num_read_kb":510,"num_write":176,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285613,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547252,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1667072,"data_stored":1121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":468472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972417,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234058,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1581056,"data_stored":1061449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430288,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":467861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":533756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":469132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411436,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":536131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117093,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":468172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1060640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:35:16.150 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 -- 172.21.15.164:0/1821529357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40780f0 msgr2=0x7f54d4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 --2- 172.21.15.164:0/1821529357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40780f0 0x7f54d4078990 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f54cc009900 tx=0x7f54cc02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 -- 172.21.15.164:0/1821529357 shutdown_connections 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 --2- 172.21.15.164:0/1821529357 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d40780f0 0x7f54d4078990 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 --2- 172.21.15.164:0/1821529357 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d4077750 0x7f54d4077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 --2- 172.21.15.164:0/1821529357 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4076510 0x7f54d4076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 -- 172.21.15.164:0/1821529357 >> 172.21.15.164:0/1821529357 conn(0x7f54d40ff300 msgr2=0x7f54d4101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 -- 172.21.15.164:0/1821529357 shutdown_connections 2024-03-27T08:35:16.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.410+0000 7f54db200640 1 -- 172.21.15.164:0/1821529357 wait complete. 2024-03-27T08:35:16.404 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 Processor -- start 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 -- start start 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 0x7f54d419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d40780f0 0x7f54d41a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4113e10 con 0x7f54d4076510 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4113c90 con 0x7f54d40780f0 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54db200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f54d4113f90 con 0x7f54d4077750 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.411+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49278/0 (socket says 172.21.15.164:49278) 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 -- 172.21.15.164:0/4044246024 learned_addr learned my addr 172.21.15.164:0/4044246024 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d9200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d40780f0 0x7f54d41a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54cb400640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 0x7f54d419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 -- 172.21.15.164:0/4044246024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 msgr2=0x7f54d419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 0x7f54d419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 -- 172.21.15.164:0/4044246024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d40780f0 msgr2=0x7f54d41a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d40780f0 0x7f54d41a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 -- 172.21.15.164:0/4044246024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54d41a5ff0 con 0x7f54d4076510 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54cb400640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 0x7f54d419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d3e00640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f54c400eab0 tx=0x7f54c400ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.412+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c400ce40 con 0x7f54d4076510 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.413+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f54c4011940 con 0x7f54d4076510 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.413+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c4010a80 con 0x7f54d4076510 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.413+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54d41a62e0 con 0x7f54d4076510 2024-03-27T08:35:16.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.413+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54d41a67e0 con 0x7f54d4076510 2024-03-27T08:35:16.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.414+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54d41107e0 con 0x7f54d4076510 2024-03-27T08:35:16.407 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.416+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f54c4011af0 con 0x7f54d4076510 2024-03-27T08:35:16.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.417+0000 7f54d1600640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 0x7f54b80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.417+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f54c40d0370 con 0x7f54d4076510 2024-03-27T08:35:16.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.417+0000 7f54cb400640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 0x7f54b80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.418+0000 7f54cb400640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 0x7f54b80a5ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54d419f8e0 tx=0x7f54bc005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:16.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.421+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f54c4016030 con 0x7f54d4076510 2024-03-27T08:35:16.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.621+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f54d4061f90 con 0x7f54b80a3610 2024-03-27T08:35:16.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.634+0000 7f54d1600640 1 -- 172.21.15.164:0/4044246024 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7f54d4061f90 con 0x7f54b80a3610 2024-03-27T08:35:16.629 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:16.630 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 msgr2=0x7f54b80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 0x7f54b80a5ad0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f54d419f8e0 tx=0x7f54bc005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 msgr2=0x7f54d419e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f54c400eab0 tx=0x7f54c400ef70 comp rx=0 tx=0).stop 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 shutdown_connections 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f54b80a3610 0x7f54b80a5ad0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54d40780f0 0x7f54d41a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f54d4077750 0x7f54d419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 --2- 172.21.15.164:0/4044246024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f54d4076510 0x7f54d419e3d0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 >> 172.21.15.164:0/4044246024 conn(0x7f54d40ff300 msgr2=0x7f54d4100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 shutdown_connections 2024-03-27T08:35:16.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.639+0000 7f54db200640 1 -- 172.21.15.164:0/4044246024 wait complete. 2024-03-27T08:35:16.651 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-03-27T08:35:15.366485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661832,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1002,"num_read_kb":619,"num_write":359,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366820,"kb_used_data":13508,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575004,"statfs":{"total":1151940427776,"available":1151564804096,"internally_reserved":0,"allocated":13832192,"data_stored":7593030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":38,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005690"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332430+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:34:17.332430+0000","last_peered":"2024-03-27T08:34:17.332430+0000","last_clean":"2024-03-27T08:34:17.332430+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:34:17.332430+0000","last_undegraded":"2024-03-27T08:34:17.332430+0000","last_fullsized":"2024-03-27T08:34:17.332430+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329999+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:34:17.329999+0000","last_peered":"2024-03-27T08:34:17.329999+0000","last_clean":"2024-03-27T08:34:17.329999+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:34:17.329999+0000","last_undegraded":"2024-03-27T08:34:17.329999+0000","last_fullsized":"2024-03-27T08:34:17.329999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.333506+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:34:17.333506+0000","last_peered":"2024-03-27T08:34:17.333506+0000","last_clean":"2024-03-27T08:34:17.333506+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:34:17.333506+0000","last_undegraded":"2024-03-27T08:34:17.333506+0000","last_fullsized":"2024-03-27T08:34:17.333506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311829+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:34:17.311829+0000","last_peered":"2024-03-27T08:34:17.311829+0000","last_clean":"2024-03-27T08:34:17.311829+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:34:17.311829+0000","last_undegraded":"2024-03-27T08:34:17.311829+0000","last_fullsized":"2024-03-27T08:34:17.311829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.295664+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:34:17.295664+0000","last_peered":"2024-03-27T08:34:17.295664+0000","last_clean":"2024-03-27T08:34:17.295664+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:34:17.295664+0000","last_undegraded":"2024-03-27T08:34:17.295664+0000","last_fullsized":"2024-03-27T08:34:17.295664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328978+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:34:17.328978+0000","last_peered":"2024-03-27T08:34:17.328978+0000","last_clean":"2024-03-27T08:34:17.328978+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:34:17.328978+0000","last_undegraded":"2024-03-27T08:34:17.328978+0000","last_fullsized":"2024-03-27T08:34:17.328978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.309182+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:34:17.309182+0000","last_peered":"2024-03-27T08:34:17.309182+0000","last_clean":"2024-03-27T08:34:17.309182+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:34:17.309182+0000","last_undegraded":"2024-03-27T08:34:17.309182+0000","last_fullsized":"2024-03-27T08:34:17.309182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.323953+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:34:17.323953+0000","last_peered":"2024-03-27T08:34:17.323953+0000","last_clean":"2024-03-27T08:34:17.323953+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:34:17.323953+0000","last_undegraded":"2024-03-27T08:34:17.323953+0000","last_fullsized":"2024-03-27T08:34:17.323953+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335156+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:34:17.335156+0000","last_peered":"2024-03-27T08:34:17.335156+0000","last_clean":"2024-03-27T08:34:17.335156+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:34:17.335156+0000","last_undegraded":"2024-03-27T08:34:17.335156+0000","last_fullsized":"2024-03-27T08:34:17.335156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329524+0000","last_change":"2024-03-27T08:33:18.668027+0000","last_active":"2024-03-27T08:34:17.329524+0000","last_peered":"2024-03-27T08:34:17.329524+0000","last_clean":"2024-03-27T08:34:17.329524+0000","last_became_active":"2024-03-27T08:33:18.667495+0000","last_became_peered":"2024-03-27T08:33:18.667495+0000","last_unstale":"2024-03-27T08:34:17.329524+0000","last_undegraded":"2024-03-27T08:34:17.329524+0000","last_fullsized":"2024-03-27T08:34:17.329524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:00:53.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331834+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:34:17.331834+0000","last_peered":"2024-03-27T08:34:17.331834+0000","last_clean":"2024-03-27T08:34:17.331834+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:34:17.331834+0000","last_undegraded":"2024-03-27T08:34:17.331834+0000","last_fullsized":"2024-03-27T08:34:17.331834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326031+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:34:17.326031+0000","last_peered":"2024-03-27T08:34:17.326031+0000","last_clean":"2024-03-27T08:34:17.326031+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:34:17.326031+0000","last_undegraded":"2024-03-27T08:34:17.326031+0000","last_fullsized":"2024-03-27T08:34:17.326031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322199+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:34:17.322199+0000","last_peered":"2024-03-27T08:34:17.322199+0000","last_clean":"2024-03-27T08:34:17.322199+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:34:17.322199+0000","last_undegraded":"2024-03-27T08:34:17.322199+0000","last_fullsized":"2024-03-27T08:34:17.322199+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330120+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:34:17.330120+0000","last_peered":"2024-03-27T08:34:17.330120+0000","last_clean":"2024-03-27T08:34:17.330120+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:34:17.330120+0000","last_undegraded":"2024-03-27T08:34:17.330120+0000","last_fullsized":"2024-03-27T08:34:17.330120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.310666+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:34:17.310666+0000","last_peered":"2024-03-27T08:34:17.310666+0000","last_clean":"2024-03-27T08:34:17.310666+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:34:17.310666+0000","last_undegraded":"2024-03-27T08:34:17.310666+0000","last_fullsized":"2024-03-27T08:34:17.310666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334623+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:34:17.334623+0000","last_peered":"2024-03-27T08:34:17.334623+0000","last_clean":"2024-03-27T08:34:17.334623+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:34:17.334623+0000","last_undegraded":"2024-03-27T08:34:17.334623+0000","last_fullsized":"2024-03-27T08:34:17.334623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332693+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:34:17.332693+0000","last_peered":"2024-03-27T08:34:17.332693+0000","last_clean":"2024-03-27T08:34:17.332693+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:34:17.332693+0000","last_undegraded":"2024-03-27T08:34:17.332693+0000","last_fullsized":"2024-03-27T08:34:17.332693+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329468+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:34:17.329468+0000","last_peered":"2024-03-27T08:34:17.329468+0000","last_clean":"2024-03-27T08:34:17.329468+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:34:17.329468+0000","last_undegraded":"2024-03-27T08:34:17.329468+0000","last_fullsized":"2024-03-27T08:34:17.329468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311563+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:34:17.311563+0000","last_peered":"2024-03-27T08:34:17.311563+0000","last_clean":"2024-03-27T08:34:17.311563+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:34:17.311563+0000","last_undegraded":"2024-03-27T08:34:17.311563+0000","last_fullsized":"2024-03-27T08:34:17.311563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666643+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:33:18.666643+0000","last_peered":"2024-03-27T08:33:18.666643+0000","last_clean":"2024-03-27T08:33:18.666643+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:33:18.666643+0000","last_undegraded":"2024-03-27T08:33:18.666643+0000","last_fullsized":"2024-03-27T08:33:18.666643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318354+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:34:17.318354+0000","last_peered":"2024-03-27T08:34:17.318354+0000","last_clean":"2024-03-27T08:34:17.318354+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:34:17.318354+0000","last_undegraded":"2024-03-27T08:34:17.318354+0000","last_fullsized":"2024-03-27T08:34:17.318354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467972+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:33:18.467972+0000","last_peered":"2024-03-27T08:33:18.467972+0000","last_clean":"2024-03-27T08:33:18.467972+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:33:18.467972+0000","last_undegraded":"2024-03-27T08:33:18.467972+0000","last_fullsized":"2024-03-27T08:33:18.467972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331956+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:34:17.331956+0000","last_peered":"2024-03-27T08:34:17.331956+0000","last_clean":"2024-03-27T08:34:17.331956+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:34:17.331956+0000","last_undegraded":"2024-03-27T08:34:17.331956+0000","last_fullsized":"2024-03-27T08:34:17.331956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.622405+0000","last_change":"2024-03-27T08:33:18.622405+0000","last_active":"2024-03-27T08:33:18.622405+0000","last_peered":"2024-03-27T08:33:18.622405+0000","last_clean":"2024-03-27T08:33:18.622405+0000","last_became_active":"2024-03-27T08:33:18.614323+0000","last_became_peered":"2024-03-27T08:33:18.614323+0000","last_unstale":"2024-03-27T08:33:18.622405+0000","last_undegraded":"2024-03-27T08:33:18.622405+0000","last_fullsized":"2024-03-27T08:33:18.622405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:33:48.011900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335692+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:34:17.335692+0000","last_peered":"2024-03-27T08:34:17.335692+0000","last_clean":"2024-03-27T08:34:17.335692+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:34:17.335692+0000","last_undegraded":"2024-03-27T08:34:17.335692+0000","last_fullsized":"2024-03-27T08:34:17.335692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460278+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:33:18.460278+0000","last_peered":"2024-03-27T08:33:18.460278+0000","last_clean":"2024-03-27T08:33:18.460278+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:33:18.460278+0000","last_undegraded":"2024-03-27T08:33:18.460278+0000","last_fullsized":"2024-03-27T08:33:18.460278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331396+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:34:17.331396+0000","last_peered":"2024-03-27T08:34:17.331396+0000","last_clean":"2024-03-27T08:34:17.331396+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:34:17.331396+0000","last_undegraded":"2024-03-27T08:34:17.331396+0000","last_fullsized":"2024-03-27T08:34:17.331396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:12.058733+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:35:12.058733+0000","last_peered":"2024-03-27T08:35:12.058733+0000","last_clean":"2024-03-27T08:35:12.058733+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:35:12.058733+0000","last_undegraded":"2024-03-27T08:35:12.058733+0000","last_fullsized":"2024-03-27T08:35:12.058733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327624+0000","last_change":"2024-03-27T08:33:18.667599+0000","last_active":"2024-03-27T08:34:17.327624+0000","last_peered":"2024-03-27T08:34:17.327624+0000","last_clean":"2024-03-27T08:34:17.327624+0000","last_became_active":"2024-03-27T08:33:18.666812+0000","last_became_peered":"2024-03-27T08:33:18.666812+0000","last_unstale":"2024-03-27T08:34:17.327624+0000","last_undegraded":"2024-03-27T08:34:17.327624+0000","last_fullsized":"2024-03-27T08:34:17.327624+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:54:57.708196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456293+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:33:18.456293+0000","last_peered":"2024-03-27T08:33:18.456293+0000","last_clean":"2024-03-27T08:33:18.456293+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:33:18.456293+0000","last_undegraded":"2024-03-27T08:33:18.456293+0000","last_fullsized":"2024-03-27T08:33:18.456293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322316+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:34:17.322316+0000","last_peered":"2024-03-27T08:34:17.322316+0000","last_clean":"2024-03-27T08:34:17.322316+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:34:17.322316+0000","last_undegraded":"2024-03-27T08:34:17.322316+0000","last_fullsized":"2024-03-27T08:34:17.322316+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450289+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:33:18.450289+0000","last_peered":"2024-03-27T08:33:18.450289+0000","last_clean":"2024-03-27T08:33:18.450289+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:33:18.450289+0000","last_undegraded":"2024-03-27T08:33:18.450289+0000","last_fullsized":"2024-03-27T08:33:18.450289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.320033+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:34:17.320033+0000","last_peered":"2024-03-27T08:34:17.320033+0000","last_clean":"2024-03-27T08:34:17.320033+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:34:17.320033+0000","last_undegraded":"2024-03-27T08:34:17.320033+0000","last_fullsized":"2024-03-27T08:34:17.320033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453269+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:33:18.453269+0000","last_peered":"2024-03-27T08:33:18.453269+0000","last_clean":"2024-03-27T08:33:18.453269+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:33:18.453269+0000","last_undegraded":"2024-03-27T08:33:18.453269+0000","last_fullsized":"2024-03-27T08:33:18.453269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330609+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:34:17.330609+0000","last_peered":"2024-03-27T08:34:17.330609+0000","last_clean":"2024-03-27T08:34:17.330609+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:34:17.330609+0000","last_undegraded":"2024-03-27T08:34:17.330609+0000","last_fullsized":"2024-03-27T08:34:17.330609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.054497+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:35:11.054497+0000","last_peered":"2024-03-27T08:35:11.054497+0000","last_clean":"2024-03-27T08:35:11.054497+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:35:11.054497+0000","last_undegraded":"2024-03-27T08:35:11.054497+0000","last_fullsized":"2024-03-27T08:35:11.054497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335271+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:34:17.335271+0000","last_peered":"2024-03-27T08:34:17.335271+0000","last_clean":"2024-03-27T08:34:17.335271+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:34:17.335271+0000","last_undegraded":"2024-03-27T08:34:17.335271+0000","last_fullsized":"2024-03-27T08:34:17.335271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453641+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:33:18.453641+0000","last_peered":"2024-03-27T08:33:18.453641+0000","last_clean":"2024-03-27T08:33:18.453641+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:33:18.453641+0000","last_undegraded":"2024-03-27T08:33:18.453641+0000","last_fullsized":"2024-03-27T08:33:18.453641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314879+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:34:17.314879+0000","last_peered":"2024-03-27T08:34:17.314879+0000","last_clean":"2024-03-27T08:34:17.314879+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:34:17.314879+0000","last_undegraded":"2024-03-27T08:34:17.314879+0000","last_fullsized":"2024-03-27T08:34:17.314879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.455216+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:33:18.455216+0000","last_peered":"2024-03-27T08:33:18.455216+0000","last_clean":"2024-03-27T08:33:18.455216+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:33:18.455216+0000","last_undegraded":"2024-03-27T08:33:18.455216+0000","last_fullsized":"2024-03-27T08:33:18.455216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335395+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:34:17.335395+0000","last_peered":"2024-03-27T08:34:17.335395+0000","last_clean":"2024-03-27T08:34:17.335395+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:34:17.335395+0000","last_undegraded":"2024-03-27T08:34:17.335395+0000","last_fullsized":"2024-03-27T08:34:17.335395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":345,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.012520+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:35:11.012520+0000","last_peered":"2024-03-27T08:35:11.012520+0000","last_clean":"2024-03-27T08:35:11.012520+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:35:11.012520+0000","last_undegraded":"2024-03-27T08:35:11.012520+0000","last_fullsized":"2024-03-27T08:35:11.012520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66102,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":206,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.306499+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:34:17.306499+0000","last_peered":"2024-03-27T08:34:17.306499+0000","last_clean":"2024-03-27T08:34:17.306499+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:34:17.306499+0000","last_undegraded":"2024-03-27T08:34:17.306499+0000","last_fullsized":"2024-03-27T08:34:17.306499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466773+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:33:18.466773+0000","last_peered":"2024-03-27T08:33:18.466773+0000","last_clean":"2024-03-27T08:33:18.466773+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:33:18.466773+0000","last_undegraded":"2024-03-27T08:33:18.466773+0000","last_fullsized":"2024-03-27T08:33:18.466773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327742+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:34:17.327742+0000","last_peered":"2024-03-27T08:34:17.327742+0000","last_clean":"2024-03-27T08:34:17.327742+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:34:17.327742+0000","last_undegraded":"2024-03-27T08:34:17.327742+0000","last_fullsized":"2024-03-27T08:34:17.327742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453532+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:33:18.453532+0000","last_peered":"2024-03-27T08:33:18.453532+0000","last_clean":"2024-03-27T08:33:18.453532+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:33:18.453532+0000","last_undegraded":"2024-03-27T08:33:18.453532+0000","last_fullsized":"2024-03-27T08:33:18.453532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328759+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:34:17.328759+0000","last_peered":"2024-03-27T08:34:17.328759+0000","last_clean":"2024-03-27T08:34:17.328759+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:34:17.328759+0000","last_undegraded":"2024-03-27T08:34:17.328759+0000","last_fullsized":"2024-03-27T08:34:17.328759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:09.056380+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:35:09.056380+0000","last_peered":"2024-03-27T08:35:09.056380+0000","last_clean":"2024-03-27T08:35:09.056380+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:35:09.056380+0000","last_undegraded":"2024-03-27T08:35:09.056380+0000","last_fullsized":"2024-03-27T08:35:09.056380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326775+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:34:17.326775+0000","last_peered":"2024-03-27T08:34:17.326775+0000","last_clean":"2024-03-27T08:34:17.326775+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:34:17.326775+0000","last_undegraded":"2024-03-27T08:34:17.326775+0000","last_fullsized":"2024-03-27T08:34:17.326775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.511034+0000","last_change":"2024-03-27T08:33:18.509705+0000","last_active":"2024-03-27T08:33:18.511034+0000","last_peered":"2024-03-27T08:33:18.511034+0000","last_clean":"2024-03-27T08:33:18.511034+0000","last_became_active":"2024-03-27T08:33:18.470729+0000","last_became_peered":"2024-03-27T08:33:18.470729+0000","last_unstale":"2024-03-27T08:33:18.511034+0000","last_undegraded":"2024-03-27T08:33:18.511034+0000","last_fullsized":"2024-03-27T08:33:18.511034+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:16.965904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.325173+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:34:17.325173+0000","last_peered":"2024-03-27T08:34:17.325173+0000","last_clean":"2024-03-27T08:34:17.325173+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:34:17.325173+0000","last_undegraded":"2024-03-27T08:34:17.325173+0000","last_fullsized":"2024-03-27T08:34:17.325173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460393+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:33:18.460393+0000","last_peered":"2024-03-27T08:33:18.460393+0000","last_clean":"2024-03-27T08:33:18.460393+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:33:18.460393+0000","last_undegraded":"2024-03-27T08:33:18.460393+0000","last_fullsized":"2024-03-27T08:33:18.460393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314538+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:34:17.314538+0000","last_peered":"2024-03-27T08:34:17.314538+0000","last_clean":"2024-03-27T08:34:17.314538+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:34:17.314538+0000","last_undegraded":"2024-03-27T08:34:17.314538+0000","last_fullsized":"2024-03-27T08:34:17.314538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666246+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:33:18.666246+0000","last_peered":"2024-03-27T08:33:18.666246+0000","last_clean":"2024-03-27T08:33:18.666246+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:33:18.666246+0000","last_undegraded":"2024-03-27T08:33:18.666246+0000","last_fullsized":"2024-03-27T08:33:18.666246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329418+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:34:17.329418+0000","last_peered":"2024-03-27T08:34:17.329418+0000","last_clean":"2024-03-27T08:34:17.329418+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:34:17.329418+0000","last_undegraded":"2024-03-27T08:34:17.329418+0000","last_fullsized":"2024-03-27T08:34:17.329418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453177+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:33:18.453177+0000","last_peered":"2024-03-27T08:33:18.453177+0000","last_clean":"2024-03-27T08:33:18.453177+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:33:18.453177+0000","last_undegraded":"2024-03-27T08:33:18.453177+0000","last_fullsized":"2024-03-27T08:33:18.453177+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330304+0000","last_change":"2024-03-27T08:33:18.668500+0000","last_active":"2024-03-27T08:34:17.330304+0000","last_peered":"2024-03-27T08:34:17.330304+0000","last_clean":"2024-03-27T08:34:17.330304+0000","last_became_active":"2024-03-27T08:33:18.668118+0000","last_became_peered":"2024-03-27T08:33:18.668118+0000","last_unstale":"2024-03-27T08:34:17.330304+0000","last_undegraded":"2024-03-27T08:34:17.330304+0000","last_fullsized":"2024-03-27T08:34:17.330304+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:47.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317752+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:34:17.317752+0000","last_peered":"2024-03-27T08:34:17.317752+0000","last_clean":"2024-03-27T08:34:17.317752+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:34:17.317752+0000","last_undegraded":"2024-03-27T08:34:17.317752+0000","last_fullsized":"2024-03-27T08:34:17.317752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:13.066183+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:35:13.066183+0000","last_peered":"2024-03-27T08:35:13.066183+0000","last_clean":"2024-03-27T08:35:13.066183+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:35:13.066183+0000","last_undegraded":"2024-03-27T08:35:13.066183+0000","last_fullsized":"2024-03-27T08:35:13.066183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":143,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331488+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:34:17.331488+0000","last_peered":"2024-03-27T08:34:17.331488+0000","last_clean":"2024-03-27T08:34:17.331488+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:34:17.331488+0000","last_undegraded":"2024-03-27T08:34:17.331488+0000","last_fullsized":"2024-03-27T08:34:17.331488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613253+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:33:18.613253+0000","last_peered":"2024-03-27T08:33:18.613253+0000","last_clean":"2024-03-27T08:33:18.613253+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:33:18.613253+0000","last_undegraded":"2024-03-27T08:33:18.613253+0000","last_fullsized":"2024-03-27T08:33:18.613253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452942+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:33:18.452942+0000","last_peered":"2024-03-27T08:33:18.452942+0000","last_clean":"2024-03-27T08:33:18.452942+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:33:18.452942+0000","last_undegraded":"2024-03-27T08:33:18.452942+0000","last_fullsized":"2024-03-27T08:33:18.452942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314265+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:34:17.314265+0000","last_peered":"2024-03-27T08:34:17.314265+0000","last_clean":"2024-03-27T08:34:17.314265+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:34:17.314265+0000","last_undegraded":"2024-03-27T08:34:17.314265+0000","last_fullsized":"2024-03-27T08:34:17.314265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453069+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:33:18.453069+0000","last_peered":"2024-03-27T08:33:18.453069+0000","last_clean":"2024-03-27T08:33:18.453069+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:33:18.453069+0000","last_undegraded":"2024-03-27T08:33:18.453069+0000","last_fullsized":"2024-03-27T08:33:18.453069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462095+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:33:18.462095+0000","last_peered":"2024-03-27T08:33:18.462095+0000","last_clean":"2024-03-27T08:33:18.462095+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:33:18.462095+0000","last_undegraded":"2024-03-27T08:33:18.462095+0000","last_fullsized":"2024-03-27T08:33:18.462095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314390+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:34:17.314390+0000","last_peered":"2024-03-27T08:34:17.314390+0000","last_clean":"2024-03-27T08:34:17.314390+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:34:17.314390+0000","last_undegraded":"2024-03-27T08:34:17.314390+0000","last_fullsized":"2024-03-27T08:34:17.314390+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:58.577766+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:34:58.577766+0000","last_peered":"2024-03-27T08:34:58.577766+0000","last_clean":"2024-03-27T08:34:58.577766+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:34:58.577766+0000","last_undegraded":"2024-03-27T08:34:58.577766+0000","last_fullsized":"2024-03-27T08:34:58.577766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329362+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:34:17.329362+0000","last_peered":"2024-03-27T08:34:17.329362+0000","last_clean":"2024-03-27T08:34:17.329362+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:34:17.329362+0000","last_undegraded":"2024-03-27T08:34:17.329362+0000","last_fullsized":"2024-03-27T08:34:17.329362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613561+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:33:18.613561+0000","last_peered":"2024-03-27T08:33:18.613561+0000","last_clean":"2024-03-27T08:33:18.613561+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:33:18.613561+0000","last_undegraded":"2024-03-27T08:33:18.613561+0000","last_fullsized":"2024-03-27T08:33:18.613561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319836+0000","last_change":"2024-03-27T08:33:18.469718+0000","last_active":"2024-03-27T08:34:17.319836+0000","last_peered":"2024-03-27T08:34:17.319836+0000","last_clean":"2024-03-27T08:34:17.319836+0000","last_became_active":"2024-03-27T08:33:18.469083+0000","last_became_peered":"2024-03-27T08:33:18.469083+0000","last_unstale":"2024-03-27T08:34:17.319836+0000","last_undegraded":"2024-03-27T08:34:17.319836+0000","last_fullsized":"2024-03-27T08:34:17.319836+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:13.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661254+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:33:18.661254+0000","last_peered":"2024-03-27T08:33:18.661254+0000","last_clean":"2024-03-27T08:33:18.661254+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:33:18.661254+0000","last_undegraded":"2024-03-27T08:33:18.661254+0000","last_fullsized":"2024-03-27T08:33:18.661254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319660+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:34:17.319660+0000","last_peered":"2024-03-27T08:34:17.319660+0000","last_clean":"2024-03-27T08:34:17.319660+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:34:17.319660+0000","last_undegraded":"2024-03-27T08:34:17.319660+0000","last_fullsized":"2024-03-27T08:34:17.319660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466731+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:33:18.466731+0000","last_peered":"2024-03-27T08:33:18.466731+0000","last_clean":"2024-03-27T08:33:18.466731+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:33:18.466731+0000","last_undegraded":"2024-03-27T08:33:18.466731+0000","last_fullsized":"2024-03-27T08:33:18.466731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314276+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:34:17.314276+0000","last_peered":"2024-03-27T08:34:17.314276+0000","last_clean":"2024-03-27T08:34:17.314276+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:34:17.314276+0000","last_undegraded":"2024-03-27T08:34:17.314276+0000","last_fullsized":"2024-03-27T08:34:17.314276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:21.961137+0000","last_change":"2024-03-27T08:33:18.478350+0000","last_active":"2024-03-27T08:33:21.961137+0000","last_peered":"2024-03-27T08:33:21.961137+0000","last_clean":"2024-03-27T08:33:21.961137+0000","last_became_active":"2024-03-27T08:33:18.470274+0000","last_became_peered":"2024-03-27T08:33:18.470274+0000","last_unstale":"2024-03-27T08:33:21.961137+0000","last_undegraded":"2024-03-27T08:33:21.961137+0000","last_fullsized":"2024-03-27T08:33:21.961137+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:54.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326434+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:34:17.326434+0000","last_peered":"2024-03-27T08:34:17.326434+0000","last_clean":"2024-03-27T08:34:17.326434+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:34:17.326434+0000","last_undegraded":"2024-03-27T08:34:17.326434+0000","last_fullsized":"2024-03-27T08:34:17.326434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459714+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:33:18.459714+0000","last_peered":"2024-03-27T08:33:18.459714+0000","last_clean":"2024-03-27T08:33:18.459714+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:33:18.459714+0000","last_undegraded":"2024-03-27T08:33:18.459714+0000","last_fullsized":"2024-03-27T08:33:18.459714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332297+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:34:17.332297+0000","last_peered":"2024-03-27T08:34:17.332297+0000","last_clean":"2024-03-27T08:34:17.332297+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:34:17.332297+0000","last_undegraded":"2024-03-27T08:34:17.332297+0000","last_fullsized":"2024-03-27T08:34:17.332297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466537+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:33:18.466537+0000","last_peered":"2024-03-27T08:33:18.466537+0000","last_clean":"2024-03-27T08:33:18.466537+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:33:18.466537+0000","last_undegraded":"2024-03-27T08:33:18.466537+0000","last_fullsized":"2024-03-27T08:33:18.466537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332192+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:34:17.332192+0000","last_peered":"2024-03-27T08:34:17.332192+0000","last_clean":"2024-03-27T08:34:17.332192+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:34:17.332192+0000","last_undegraded":"2024-03-27T08:34:17.332192+0000","last_fullsized":"2024-03-27T08:34:17.332192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454622+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:33:18.454622+0000","last_peered":"2024-03-27T08:33:18.454622+0000","last_clean":"2024-03-27T08:33:18.454622+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:33:18.454622+0000","last_undegraded":"2024-03-27T08:33:18.454622+0000","last_fullsized":"2024-03-27T08:33:18.454622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324166+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:34:17.324166+0000","last_peered":"2024-03-27T08:34:17.324166+0000","last_clean":"2024-03-27T08:34:17.324166+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:34:17.324166+0000","last_undegraded":"2024-03-27T08:34:17.324166+0000","last_fullsized":"2024-03-27T08:34:17.324166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450620+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:33:18.450620+0000","last_peered":"2024-03-27T08:33:18.450620+0000","last_clean":"2024-03-27T08:33:18.450620+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:33:18.450620+0000","last_undegraded":"2024-03-27T08:33:18.450620+0000","last_fullsized":"2024-03-27T08:33:18.450620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324055+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:34:17.324055+0000","last_peered":"2024-03-27T08:34:17.324055+0000","last_clean":"2024-03-27T08:34:17.324055+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:34:17.324055+0000","last_undegraded":"2024-03-27T08:34:17.324055+0000","last_fullsized":"2024-03-27T08:34:17.324055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.315671+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:34:17.315671+0000","last_peered":"2024-03-27T08:34:17.315671+0000","last_clean":"2024-03-27T08:34:17.315671+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:34:17.315671+0000","last_undegraded":"2024-03-27T08:34:17.315671+0000","last_fullsized":"2024-03-27T08:34:17.315671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316512+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:34:17.316512+0000","last_peered":"2024-03-27T08:34:17.316512+0000","last_clean":"2024-03-27T08:34:17.316512+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:34:17.316512+0000","last_undegraded":"2024-03-27T08:34:17.316512+0000","last_fullsized":"2024-03-27T08:34:17.316512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314942+0000","last_change":"2024-03-27T08:33:18.669781+0000","last_active":"2024-03-27T08:34:17.314942+0000","last_peered":"2024-03-27T08:34:17.314942+0000","last_clean":"2024-03-27T08:34:17.314942+0000","last_became_active":"2024-03-27T08:33:18.668571+0000","last_became_peered":"2024-03-27T08:33:18.668571+0000","last_unstale":"2024-03-27T08:34:17.314942+0000","last_undegraded":"2024-03-27T08:34:17.314942+0000","last_fullsized":"2024-03-27T08:34:17.314942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:11:18.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316247+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:34:17.316247+0000","last_peered":"2024-03-27T08:34:17.316247+0000","last_clean":"2024-03-27T08:34:17.316247+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:34:17.316247+0000","last_undegraded":"2024-03-27T08:34:17.316247+0000","last_fullsized":"2024-03-27T08:34:17.316247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318542+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:34:17.318542+0000","last_peered":"2024-03-27T08:34:17.318542+0000","last_clean":"2024-03-27T08:34:17.318542+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:34:17.318542+0000","last_undegraded":"2024-03-27T08:34:17.318542+0000","last_fullsized":"2024-03-27T08:34:17.318542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314331+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:34:17.314331+0000","last_peered":"2024-03-27T08:34:17.314331+0000","last_clean":"2024-03-27T08:34:17.314331+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:34:17.314331+0000","last_undegraded":"2024-03-27T08:34:17.314331+0000","last_fullsized":"2024-03-27T08:34:17.314331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331939+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:34:17.331939+0000","last_peered":"2024-03-27T08:34:17.331939+0000","last_clean":"2024-03-27T08:34:17.331939+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:34:17.331939+0000","last_undegraded":"2024-03-27T08:34:17.331939+0000","last_fullsized":"2024-03-27T08:34:17.331939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317997+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:34:17.317997+0000","last_peered":"2024-03-27T08:34:17.317997+0000","last_clean":"2024-03-27T08:34:17.317997+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:34:17.317997+0000","last_undegraded":"2024-03-27T08:34:17.317997+0000","last_fullsized":"2024-03-27T08:34:17.317997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322188+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:34:17.322188+0000","last_peered":"2024-03-27T08:34:17.322188+0000","last_clean":"2024-03-27T08:34:17.322188+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:34:17.322188+0000","last_undegraded":"2024-03-27T08:34:17.322188+0000","last_fullsized":"2024-03-27T08:34:17.322188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322331+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:34:17.322331+0000","last_peered":"2024-03-27T08:34:17.322331+0000","last_clean":"2024-03-27T08:34:17.322331+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:34:17.322331+0000","last_undegraded":"2024-03-27T08:34:17.322331+0000","last_fullsized":"2024-03-27T08:34:17.322331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334093+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:34:17.334093+0000","last_peered":"2024-03-27T08:34:17.334093+0000","last_clean":"2024-03-27T08:34:17.334093+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:34:17.334093+0000","last_undegraded":"2024-03-27T08:34:17.334093+0000","last_fullsized":"2024-03-27T08:34:17.334093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324601+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:34:17.324601+0000","last_peered":"2024-03-27T08:34:17.324601+0000","last_clean":"2024-03-27T08:34:17.324601+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:34:17.324601+0000","last_undegraded":"2024-03-27T08:34:17.324601+0000","last_fullsized":"2024-03-27T08:34:17.324601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.312584+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:34:17.312584+0000","last_peered":"2024-03-27T08:34:17.312584+0000","last_clean":"2024-03-27T08:34:17.312584+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:34:17.312584+0000","last_undegraded":"2024-03-27T08:34:17.312584+0000","last_fullsized":"2024-03-27T08:34:17.312584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71230,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":876,"num_read_kb":510,"num_write":176,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285613,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547252,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1667072,"data_stored":1121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":468472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972417,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234058,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1581056,"data_stored":1061449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430288,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":467861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":533756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":469132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411436,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":536131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117093,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":468172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1060640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:35:16.655 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-03-27T08:35:16.655 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-27T08:35:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:16 smithi164 ceph-mon[31788]: pgmap v439: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:16 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3807083064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:16 smithi167 ceph-mon[34903]: pgmap v439: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:16 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3807083064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:16 smithi173 ceph-mon[35397]: pgmap v439: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:16 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3807083064' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 -- 172.21.15.164:0/3844521524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58075b90 msgr2=0x7ffa58073fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3844521524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58075b90 0x7ffa58073fe0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7ffa40009900 tx=0x7ffa4002bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 -- 172.21.15.164:0/3844521524 shutdown_connections 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3844521524 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58109a20 0x7ffa5810beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3844521524 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa58074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3844521524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58075b90 0x7ffa58073fe0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.914+0000 7ffa5f600640 1 -- 172.21.15.164:0/3844521524 >> 172.21.15.164:0/3844521524 conn(0x7ffa580fd0f0 msgr2=0x7ffa580ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.915+0000 7ffa5f600640 1 -- 172.21.15.164:0/3844521524 shutdown_connections 2024-03-27T08:35:16.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.915+0000 7ffa5f600640 1 -- 172.21.15.164:0/3844521524 wait complete. 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 Processor -- start 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 -- start start 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58075b90 0x7ffa5819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 0x7ffa581a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5810fa00 con 0x7ffa580745b0 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5810f880 con 0x7ffa58109a20 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5f600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ffa5810fb80 con 0x7ffa58075b90 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.916+0000 7ffa5cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49296/0 (socket says 172.21.15.164:49296) 2024-03-27T08:35:16.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 -- 172.21.15.164:0/3732487682 learned_addr learned my addr 172.21.15.164:0/3732487682 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5d600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 0x7ffa581a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 -- 172.21.15.164:0/3732487682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58075b90 msgr2=0x7ffa5819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa4fe00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58075b90 0x7ffa5819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58075b90 0x7ffa5819a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 -- 172.21.15.164:0/3732487682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 msgr2=0x7ffa581a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 0x7ffa581a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 -- 172.21.15.164:0/3732487682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa581a1c40 con 0x7ffa580745b0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5d600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 0x7ffa581a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.917+0000 7ffa5cc00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.918+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40043020 con 0x7ffa580745b0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.918+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffa40005470 con 0x7ffa580745b0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.918+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa40003c90 con 0x7ffa580745b0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.918+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa581a1ed0 con 0x7ffa580745b0 2024-03-27T08:35:16.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.918+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa581a2390 con 0x7ffa580745b0 2024-03-27T08:35:16.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.919+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa58108750 con 0x7ffa580745b0 2024-03-27T08:35:16.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.921+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7ffa40046020 con 0x7ffa580745b0 2024-03-27T08:35:16.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.922+0000 7ffa56000640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 0x7ffa380a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:16.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.922+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ffa400f1f80 con 0x7ffa580745b0 2024-03-27T08:35:16.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.922+0000 7ffa4fe00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 0x7ffa380a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:16.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.923+0000 7ffa4fe00640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 0x7ffa380a5b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffa5819b530 tx=0x7ffa48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:16.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:16.927+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7ffa4004d020 con 0x7ffa580745b0 2024-03-27T08:35:17.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.129+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 --> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffa58061f90 con 0x7ffa380a3690 2024-03-27T08:35:17.129 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.138+0000 7ffa56000640 1 -- 172.21.15.164:0/3732487682 <== mgr.14152 v2:172.21.15.164:6800/2033158356 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258931 (secure 0 0 0) 0x7ffa58061f90 con 0x7ffa380a3690 2024-03-27T08:35:17.133 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:17.134 INFO:teuthology.orchestra.run.smithi164.stderr:dumped all 2024-03-27T08:35:17.135 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 msgr2=0x7ffa380a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 0x7ffa380a5b50 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffa5819b530 tx=0x7ffa48005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 msgr2=0x7ffa5819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7ffa40000c00 tx=0x7ffa40005e40 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 shutdown_connections 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ffa380a3690 0x7ffa380a5b50 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffa58109a20 0x7ffa581a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ffa58075b90 0x7ffa5819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 --2- 172.21.15.164:0/3732487682 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ffa580745b0 0x7ffa5819a020 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.142+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 >> 172.21.15.164:0/3732487682 conn(0x7ffa580fd0f0 msgr2=0x7ffa58105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.143+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 shutdown_connections 2024-03-27T08:35:17.136 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.143+0000 7ffa5f600640 1 -- 172.21.15.164:0/3732487682 wait complete. 2024-03-27T08:35:17.153 INFO:teuthology.orchestra.run.smithi164.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2024-03-27T08:35:15.366485+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":661832,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":1002,"num_read_kb":619,"num_write":359,"num_write_kb":3066,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":1180848,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":790,"ondisk_log_size":790,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":366820,"kb_used_data":13508,"kb_used_omap":18,"kb_used_meta":353197,"kb_avail":1124575004,"statfs":{"total":1151940427776,"available":1151564804096,"internally_reserved":0,"allocated":13832192,"data_stored":7593030,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":361674041},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5793,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":38,"num_write":11,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005690"},"pg_stats":[{"pgid":"3.3f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332430+0000","last_change":"2024-03-27T08:32:46.604979+0000","last_active":"2024-03-27T08:34:17.332430+0000","last_peered":"2024-03-27T08:34:17.332430+0000","last_clean":"2024-03-27T08:34:17.332430+0000","last_became_active":"2024-03-27T08:32:46.603780+0000","last_became_peered":"2024-03-27T08:32:46.603780+0000","last_unstale":"2024-03-27T08:34:17.332430+0000","last_undegraded":"2024-03-27T08:34:17.332430+0000","last_fullsized":"2024-03-27T08:34:17.332430+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:59:55.895019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329999+0000","last_change":"2024-03-27T08:32:46.610580+0000","last_active":"2024-03-27T08:34:17.329999+0000","last_peered":"2024-03-27T08:34:17.329999+0000","last_clean":"2024-03-27T08:34:17.329999+0000","last_became_active":"2024-03-27T08:32:46.610227+0000","last_became_peered":"2024-03-27T08:32:46.610227+0000","last_unstale":"2024-03-27T08:34:17.329999+0000","last_undegraded":"2024-03-27T08:34:17.329999+0000","last_fullsized":"2024-03-27T08:34:17.329999+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:02.543523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.333506+0000","last_change":"2024-03-27T08:32:46.601788+0000","last_active":"2024-03-27T08:34:17.333506+0000","last_peered":"2024-03-27T08:34:17.333506+0000","last_clean":"2024-03-27T08:34:17.333506+0000","last_became_active":"2024-03-27T08:32:46.601459+0000","last_became_peered":"2024-03-27T08:32:46.601459+0000","last_unstale":"2024-03-27T08:34:17.333506+0000","last_undegraded":"2024-03-27T08:34:17.333506+0000","last_fullsized":"2024-03-27T08:34:17.333506+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:59:24.948459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311829+0000","last_change":"2024-03-27T08:32:46.601967+0000","last_active":"2024-03-27T08:34:17.311829+0000","last_peered":"2024-03-27T08:34:17.311829+0000","last_clean":"2024-03-27T08:34:17.311829+0000","last_became_active":"2024-03-27T08:32:46.601641+0000","last_became_peered":"2024-03-27T08:32:46.601641+0000","last_unstale":"2024-03-27T08:34:17.311829+0000","last_undegraded":"2024-03-27T08:34:17.311829+0000","last_fullsized":"2024-03-27T08:34:17.311829+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:35:56.697892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"90'4","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.295664+0000","last_change":"2024-03-27T08:32:46.601630+0000","last_active":"2024-03-27T08:34:17.295664+0000","last_peered":"2024-03-27T08:34:17.295664+0000","last_clean":"2024-03-27T08:34:17.295664+0000","last_became_active":"2024-03-27T08:32:46.596440+0000","last_became_peered":"2024-03-27T08:32:46.596440+0000","last_unstale":"2024-03-27T08:34:17.295664+0000","last_undegraded":"2024-03-27T08:34:17.295664+0000","last_fullsized":"2024-03-27T08:34:17.295664+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:18:23.735089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328978+0000","last_change":"2024-03-27T08:32:46.603268+0000","last_active":"2024-03-27T08:34:17.328978+0000","last_peered":"2024-03-27T08:34:17.328978+0000","last_clean":"2024-03-27T08:34:17.328978+0000","last_became_active":"2024-03-27T08:32:46.602586+0000","last_became_peered":"2024-03-27T08:32:46.602586+0000","last_unstale":"2024-03-27T08:34:17.328978+0000","last_undegraded":"2024-03-27T08:34:17.328978+0000","last_fullsized":"2024-03-27T08:34:17.328978+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:55:06.592928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"90'5","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.309182+0000","last_change":"2024-03-27T08:32:46.600532+0000","last_active":"2024-03-27T08:34:17.309182+0000","last_peered":"2024-03-27T08:34:17.309182+0000","last_clean":"2024-03-27T08:34:17.309182+0000","last_became_active":"2024-03-27T08:32:46.600203+0000","last_became_peered":"2024-03-27T08:32:46.600203+0000","last_unstale":"2024-03-27T08:34:17.309182+0000","last_undegraded":"2024-03-27T08:34:17.309182+0000","last_fullsized":"2024-03-27T08:34:17.309182+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:49:04.417470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.323953+0000","last_change":"2024-03-27T08:32:46.606334+0000","last_active":"2024-03-27T08:34:17.323953+0000","last_peered":"2024-03-27T08:34:17.323953+0000","last_clean":"2024-03-27T08:34:17.323953+0000","last_became_active":"2024-03-27T08:32:46.605944+0000","last_became_peered":"2024-03-27T08:32:46.605944+0000","last_unstale":"2024-03-27T08:34:17.323953+0000","last_undegraded":"2024-03-27T08:34:17.323953+0000","last_fullsized":"2024-03-27T08:34:17.323953+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:31.911263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335156+0000","last_change":"2024-03-27T08:32:46.605327+0000","last_active":"2024-03-27T08:34:17.335156+0000","last_peered":"2024-03-27T08:34:17.335156+0000","last_clean":"2024-03-27T08:34:17.335156+0000","last_became_active":"2024-03-27T08:32:46.603965+0000","last_became_peered":"2024-03-27T08:32:46.603965+0000","last_unstale":"2024-03-27T08:34:17.335156+0000","last_undegraded":"2024-03-27T08:34:17.335156+0000","last_fullsized":"2024-03-27T08:34:17.335156+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:00:34.120058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"90'16","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329524+0000","last_change":"2024-03-27T08:33:18.668027+0000","last_active":"2024-03-27T08:34:17.329524+0000","last_peered":"2024-03-27T08:34:17.329524+0000","last_clean":"2024-03-27T08:34:17.329524+0000","last_became_active":"2024-03-27T08:33:18.667495+0000","last_became_peered":"2024-03-27T08:33:18.667495+0000","last_unstale":"2024-03-27T08:34:17.329524+0000","last_undegraded":"2024-03-27T08:34:17.329524+0000","last_fullsized":"2024-03-27T08:34:17.329524+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:00:53.866290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,9],"acting":[10,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"90'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331834+0000","last_change":"2024-03-27T08:32:46.605601+0000","last_active":"2024-03-27T08:34:17.331834+0000","last_peered":"2024-03-27T08:34:17.331834+0000","last_clean":"2024-03-27T08:34:17.331834+0000","last_became_active":"2024-03-27T08:32:46.605243+0000","last_became_peered":"2024-03-27T08:32:46.605243+0000","last_unstale":"2024-03-27T08:34:17.331834+0000","last_undegraded":"2024-03-27T08:34:17.331834+0000","last_fullsized":"2024-03-27T08:34:17.331834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:21.253732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326031+0000","last_change":"2024-03-27T08:32:46.607334+0000","last_active":"2024-03-27T08:34:17.326031+0000","last_peered":"2024-03-27T08:34:17.326031+0000","last_clean":"2024-03-27T08:34:17.326031+0000","last_became_active":"2024-03-27T08:32:46.604600+0000","last_became_peered":"2024-03-27T08:32:46.604600+0000","last_unstale":"2024-03-27T08:34:17.326031+0000","last_undegraded":"2024-03-27T08:34:17.326031+0000","last_fullsized":"2024-03-27T08:34:17.326031+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:24:00.478626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322199+0000","last_change":"2024-03-27T08:32:46.600123+0000","last_active":"2024-03-27T08:34:17.322199+0000","last_peered":"2024-03-27T08:34:17.322199+0000","last_clean":"2024-03-27T08:34:17.322199+0000","last_became_active":"2024-03-27T08:32:46.598283+0000","last_became_peered":"2024-03-27T08:32:46.598283+0000","last_unstale":"2024-03-27T08:34:17.322199+0000","last_undegraded":"2024-03-27T08:34:17.322199+0000","last_fullsized":"2024-03-27T08:34:17.322199+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:58:41.411836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330120+0000","last_change":"2024-03-27T08:32:46.592239+0000","last_active":"2024-03-27T08:34:17.330120+0000","last_peered":"2024-03-27T08:34:17.330120+0000","last_clean":"2024-03-27T08:34:17.330120+0000","last_became_active":"2024-03-27T08:32:46.591452+0000","last_became_peered":"2024-03-27T08:32:46.591452+0000","last_unstale":"2024-03-27T08:34:17.330120+0000","last_undegraded":"2024-03-27T08:34:17.330120+0000","last_fullsized":"2024-03-27T08:34:17.330120+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:45:35.536539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.310666+0000","last_change":"2024-03-27T08:32:46.600542+0000","last_active":"2024-03-27T08:34:17.310666+0000","last_peered":"2024-03-27T08:34:17.310666+0000","last_clean":"2024-03-27T08:34:17.310666+0000","last_became_active":"2024-03-27T08:32:46.600195+0000","last_became_peered":"2024-03-27T08:32:46.600195+0000","last_unstale":"2024-03-27T08:34:17.310666+0000","last_undegraded":"2024-03-27T08:34:17.310666+0000","last_fullsized":"2024-03-27T08:34:17.310666+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:42:48.349896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334623+0000","last_change":"2024-03-27T08:32:46.597985+0000","last_active":"2024-03-27T08:34:17.334623+0000","last_peered":"2024-03-27T08:34:17.334623+0000","last_clean":"2024-03-27T08:34:17.334623+0000","last_became_active":"2024-03-27T08:32:46.597669+0000","last_became_peered":"2024-03-27T08:32:46.597669+0000","last_unstale":"2024-03-27T08:34:17.334623+0000","last_undegraded":"2024-03-27T08:34:17.334623+0000","last_fullsized":"2024-03-27T08:34:17.334623+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:56:15.159808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332693+0000","last_change":"2024-03-27T08:32:46.606193+0000","last_active":"2024-03-27T08:34:17.332693+0000","last_peered":"2024-03-27T08:34:17.332693+0000","last_clean":"2024-03-27T08:34:17.332693+0000","last_became_active":"2024-03-27T08:32:46.605330+0000","last_became_peered":"2024-03-27T08:32:46.605330+0000","last_unstale":"2024-03-27T08:34:17.332693+0000","last_undegraded":"2024-03-27T08:34:17.332693+0000","last_fullsized":"2024-03-27T08:34:17.332693+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:58:34.038284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329468+0000","last_change":"2024-03-27T08:32:46.610654+0000","last_active":"2024-03-27T08:34:17.329468+0000","last_peered":"2024-03-27T08:34:17.329468+0000","last_clean":"2024-03-27T08:34:17.329468+0000","last_became_active":"2024-03-27T08:32:46.610312+0000","last_became_peered":"2024-03-27T08:32:46.610312+0000","last_unstale":"2024-03-27T08:34:17.329468+0000","last_undegraded":"2024-03-27T08:34:17.329468+0000","last_fullsized":"2024-03-27T08:34:17.329468+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:20:52.010090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.311563+0000","last_change":"2024-03-27T08:32:46.597822+0000","last_active":"2024-03-27T08:34:17.311563+0000","last_peered":"2024-03-27T08:34:17.311563+0000","last_clean":"2024-03-27T08:34:17.311563+0000","last_became_active":"2024-03-27T08:32:46.596959+0000","last_became_peered":"2024-03-27T08:32:46.596959+0000","last_unstale":"2024-03-27T08:34:17.311563+0000","last_undegraded":"2024-03-27T08:34:17.311563+0000","last_fullsized":"2024-03-27T08:34:17.311563+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:20.432717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"88'9","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666643+0000","last_change":"2024-03-27T08:32:45.583455+0000","last_active":"2024-03-27T08:33:18.666643+0000","last_peered":"2024-03-27T08:33:18.666643+0000","last_clean":"2024-03-27T08:33:18.666643+0000","last_became_active":"2024-03-27T08:32:45.583103+0000","last_became_peered":"2024-03-27T08:32:45.583103+0000","last_unstale":"2024-03-27T08:33:18.666643+0000","last_undegraded":"2024-03-27T08:33:18.666643+0000","last_fullsized":"2024-03-27T08:33:18.666643+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:48:49.913632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318354+0000","last_change":"2024-03-27T08:32:46.605975+0000","last_active":"2024-03-27T08:34:17.318354+0000","last_peered":"2024-03-27T08:34:17.318354+0000","last_clean":"2024-03-27T08:34:17.318354+0000","last_became_active":"2024-03-27T08:32:46.603705+0000","last_became_peered":"2024-03-27T08:32:46.603705+0000","last_unstale":"2024-03-27T08:34:17.318354+0000","last_undegraded":"2024-03-27T08:34:17.318354+0000","last_fullsized":"2024-03-27T08:34:17.318354+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:51:41.271984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.467972+0000","last_change":"2024-03-27T08:32:45.589646+0000","last_active":"2024-03-27T08:33:18.467972+0000","last_peered":"2024-03-27T08:33:18.467972+0000","last_clean":"2024-03-27T08:33:18.467972+0000","last_became_active":"2024-03-27T08:32:45.589257+0000","last_became_peered":"2024-03-27T08:32:45.589257+0000","last_unstale":"2024-03-27T08:33:18.467972+0000","last_undegraded":"2024-03-27T08:33:18.467972+0000","last_fullsized":"2024-03-27T08:33:18.467972+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:18:45.301425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331956+0000","last_change":"2024-03-27T08:32:46.602939+0000","last_active":"2024-03-27T08:34:17.331956+0000","last_peered":"2024-03-27T08:34:17.331956+0000","last_clean":"2024-03-27T08:34:17.331956+0000","last_became_active":"2024-03-27T08:32:46.602608+0000","last_became_peered":"2024-03-27T08:32:46.602608+0000","last_unstale":"2024-03-27T08:34:17.331956+0000","last_undegraded":"2024-03-27T08:34:17.331956+0000","last_fullsized":"2024-03-27T08:34:17.331956+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:40:55.034317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"88'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.622405+0000","last_change":"2024-03-27T08:33:18.622405+0000","last_active":"2024-03-27T08:33:18.622405+0000","last_peered":"2024-03-27T08:33:18.622405+0000","last_clean":"2024-03-27T08:33:18.622405+0000","last_became_active":"2024-03-27T08:33:18.614323+0000","last_became_peered":"2024-03-27T08:33:18.614323+0000","last_unstale":"2024-03-27T08:33:18.622405+0000","last_undegraded":"2024-03-27T08:33:18.622405+0000","last_fullsized":"2024-03-27T08:33:18.622405+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:33:48.011900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,4,7],"acting":[8,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"90'9","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335692+0000","last_change":"2024-03-27T08:32:46.600332+0000","last_active":"2024-03-27T08:34:17.335692+0000","last_peered":"2024-03-27T08:34:17.335692+0000","last_clean":"2024-03-27T08:34:17.335692+0000","last_became_active":"2024-03-27T08:32:46.599996+0000","last_became_peered":"2024-03-27T08:32:46.599996+0000","last_unstale":"2024-03-27T08:34:17.335692+0000","last_undegraded":"2024-03-27T08:34:17.335692+0000","last_fullsized":"2024-03-27T08:34:17.335692+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:00:48.555943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1c","version":"87'2","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460278+0000","last_change":"2024-03-27T08:32:45.589875+0000","last_active":"2024-03-27T08:33:18.460278+0000","last_peered":"2024-03-27T08:33:18.460278+0000","last_clean":"2024-03-27T08:33:18.460278+0000","last_became_active":"2024-03-27T08:32:45.589254+0000","last_became_peered":"2024-03-27T08:32:45.589254+0000","last_unstale":"2024-03-27T08:33:18.460278+0000","last_undegraded":"2024-03-27T08:33:18.460278+0000","last_fullsized":"2024-03-27T08:33:18.460278+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:50:48.526678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"90'15","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331396+0000","last_change":"2024-03-27T08:32:46.605718+0000","last_active":"2024-03-27T08:34:17.331396+0000","last_peered":"2024-03-27T08:34:17.331396+0000","last_clean":"2024-03-27T08:34:17.331396+0000","last_became_active":"2024-03-27T08:32:46.605329+0000","last_became_peered":"2024-03-27T08:32:46.605329+0000","last_unstale":"2024-03-27T08:34:17.331396+0000","last_undegraded":"2024-03-27T08:34:17.331396+0000","last_fullsized":"2024-03-27T08:34:17.331396+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:54:19.751216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":174,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:12.058733+0000","last_change":"2024-03-27T08:32:45.576903+0000","last_active":"2024-03-27T08:35:12.058733+0000","last_peered":"2024-03-27T08:35:12.058733+0000","last_clean":"2024-03-27T08:35:12.058733+0000","last_became_active":"2024-03-27T08:32:45.576566+0000","last_became_peered":"2024-03-27T08:32:45.576566+0000","last_unstale":"2024-03-27T08:35:12.058733+0000","last_undegraded":"2024-03-27T08:35:12.058733+0000","last_fullsized":"2024-03-27T08:35:12.058733+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:19:06.891139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1647,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":147,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"90'7","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327624+0000","last_change":"2024-03-27T08:33:18.667599+0000","last_active":"2024-03-27T08:34:17.327624+0000","last_peered":"2024-03-27T08:34:17.327624+0000","last_clean":"2024-03-27T08:34:17.327624+0000","last_became_active":"2024-03-27T08:33:18.666812+0000","last_became_peered":"2024-03-27T08:33:18.666812+0000","last_unstale":"2024-03-27T08:34:17.327624+0000","last_undegraded":"2024-03-27T08:34:17.327624+0000","last_fullsized":"2024-03-27T08:34:17.327624+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:54:57.708196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,7],"acting":[8,9,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1a","version":"88'3","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.456293+0000","last_change":"2024-03-27T08:32:45.593037+0000","last_active":"2024-03-27T08:33:18.456293+0000","last_peered":"2024-03-27T08:33:18.456293+0000","last_clean":"2024-03-27T08:33:18.456293+0000","last_became_active":"2024-03-27T08:32:45.592457+0000","last_became_peered":"2024-03-27T08:32:45.592457+0000","last_unstale":"2024-03-27T08:33:18.456293+0000","last_undegraded":"2024-03-27T08:33:18.456293+0000","last_fullsized":"2024-03-27T08:33:18.456293+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:35:19.163263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"90'8","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322316+0000","last_change":"2024-03-27T08:32:46.600605+0000","last_active":"2024-03-27T08:34:17.322316+0000","last_peered":"2024-03-27T08:34:17.322316+0000","last_clean":"2024-03-27T08:34:17.322316+0000","last_became_active":"2024-03-27T08:32:46.599817+0000","last_became_peered":"2024-03-27T08:32:46.599817+0000","last_unstale":"2024-03-27T08:34:17.322316+0000","last_undegraded":"2024-03-27T08:34:17.322316+0000","last_fullsized":"2024-03-27T08:34:17.322316+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:09:16.975539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450289+0000","last_change":"2024-03-27T08:32:45.573576+0000","last_active":"2024-03-27T08:33:18.450289+0000","last_peered":"2024-03-27T08:33:18.450289+0000","last_clean":"2024-03-27T08:33:18.450289+0000","last_became_active":"2024-03-27T08:32:45.573241+0000","last_became_peered":"2024-03-27T08:32:45.573241+0000","last_unstale":"2024-03-27T08:33:18.450289+0000","last_undegraded":"2024-03-27T08:33:18.450289+0000","last_fullsized":"2024-03-27T08:33:18.450289+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:18.353169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.320033+0000","last_change":"2024-03-27T08:32:46.599492+0000","last_active":"2024-03-27T08:34:17.320033+0000","last_peered":"2024-03-27T08:34:17.320033+0000","last_clean":"2024-03-27T08:34:17.320033+0000","last_became_active":"2024-03-27T08:32:46.599150+0000","last_became_peered":"2024-03-27T08:32:46.599150+0000","last_unstale":"2024-03-27T08:34:17.320033+0000","last_undegraded":"2024-03-27T08:34:17.320033+0000","last_fullsized":"2024-03-27T08:34:17.320033+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:06:22.143268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453269+0000","last_change":"2024-03-27T08:32:45.583512+0000","last_active":"2024-03-27T08:33:18.453269+0000","last_peered":"2024-03-27T08:33:18.453269+0000","last_clean":"2024-03-27T08:33:18.453269+0000","last_became_active":"2024-03-27T08:32:45.582961+0000","last_became_peered":"2024-03-27T08:32:45.582961+0000","last_unstale":"2024-03-27T08:33:18.453269+0000","last_undegraded":"2024-03-27T08:33:18.453269+0000","last_fullsized":"2024-03-27T08:33:18.453269+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:20:02.693775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330609+0000","last_change":"2024-03-27T08:32:46.595338+0000","last_active":"2024-03-27T08:34:17.330609+0000","last_peered":"2024-03-27T08:34:17.330609+0000","last_clean":"2024-03-27T08:34:17.330609+0000","last_became_active":"2024-03-27T08:32:46.594840+0000","last_became_peered":"2024-03-27T08:32:46.594840+0000","last_unstale":"2024-03-27T08:34:17.330609+0000","last_undegraded":"2024-03-27T08:34:17.330609+0000","last_fullsized":"2024-03-27T08:34:17.330609+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:11:31.150344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"90'5","reported_seq":165,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.054497+0000","last_change":"2024-03-27T08:32:45.588696+0000","last_active":"2024-03-27T08:35:11.054497+0000","last_peered":"2024-03-27T08:35:11.054497+0000","last_clean":"2024-03-27T08:35:11.054497+0000","last_became_active":"2024-03-27T08:32:45.587754+0000","last_became_peered":"2024-03-27T08:32:45.587754+0000","last_unstale":"2024-03-27T08:35:11.054497+0000","last_undegraded":"2024-03-27T08:35:11.054497+0000","last_fullsized":"2024-03-27T08:35:11.054497+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:34.489345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":140,"num_read_kb":140,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335271+0000","last_change":"2024-03-27T08:32:46.601762+0000","last_active":"2024-03-27T08:34:17.335271+0000","last_peered":"2024-03-27T08:34:17.335271+0000","last_clean":"2024-03-27T08:34:17.335271+0000","last_became_active":"2024-03-27T08:32:46.600083+0000","last_became_peered":"2024-03-27T08:32:46.600083+0000","last_unstale":"2024-03-27T08:34:17.335271+0000","last_undegraded":"2024-03-27T08:34:17.335271+0000","last_fullsized":"2024-03-27T08:34:17.335271+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:45:25.261512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453641+0000","last_change":"2024-03-27T08:32:45.587379+0000","last_active":"2024-03-27T08:33:18.453641+0000","last_peered":"2024-03-27T08:33:18.453641+0000","last_clean":"2024-03-27T08:33:18.453641+0000","last_became_active":"2024-03-27T08:32:45.587012+0000","last_became_peered":"2024-03-27T08:32:45.587012+0000","last_unstale":"2024-03-27T08:33:18.453641+0000","last_undegraded":"2024-03-27T08:33:18.453641+0000","last_fullsized":"2024-03-27T08:33:18.453641+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:50:49.410531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314879+0000","last_change":"2024-03-27T08:32:46.601613+0000","last_active":"2024-03-27T08:34:17.314879+0000","last_peered":"2024-03-27T08:34:17.314879+0000","last_clean":"2024-03-27T08:34:17.314879+0000","last_became_active":"2024-03-27T08:32:46.600380+0000","last_became_peered":"2024-03-27T08:32:46.600380+0000","last_unstale":"2024-03-27T08:34:17.314879+0000","last_undegraded":"2024-03-27T08:34:17.314879+0000","last_fullsized":"2024-03-27T08:34:17.314879+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:03:49.391984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.455216+0000","last_change":"2024-03-27T08:32:45.586888+0000","last_active":"2024-03-27T08:33:18.455216+0000","last_peered":"2024-03-27T08:33:18.455216+0000","last_clean":"2024-03-27T08:33:18.455216+0000","last_became_active":"2024-03-27T08:32:45.586176+0000","last_became_peered":"2024-03-27T08:32:45.586176+0000","last_unstale":"2024-03-27T08:33:18.455216+0000","last_undegraded":"2024-03-27T08:33:18.455216+0000","last_fullsized":"2024-03-27T08:33:18.455216+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:40:06.265128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.335395+0000","last_change":"2024-03-27T08:32:46.594811+0000","last_active":"2024-03-27T08:34:17.335395+0000","last_peered":"2024-03-27T08:34:17.335395+0000","last_clean":"2024-03-27T08:34:17.335395+0000","last_became_active":"2024-03-27T08:32:46.594375+0000","last_became_peered":"2024-03-27T08:32:46.594375+0000","last_unstale":"2024-03-27T08:34:17.335395+0000","last_undegraded":"2024-03-27T08:34:17.335395+0000","last_fullsized":"2024-03-27T08:34:17.335395+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:30:27.393997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"90'34","reported_seq":345,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:11.012520+0000","last_change":"2024-03-27T08:32:45.590545+0000","last_active":"2024-03-27T08:35:11.012520+0000","last_peered":"2024-03-27T08:35:11.012520+0000","last_clean":"2024-03-27T08:35:11.012520+0000","last_became_active":"2024-03-27T08:32:45.589449+0000","last_became_peered":"2024-03-27T08:32:45.589449+0000","last_unstale":"2024-03-27T08:35:11.012520+0000","last_undegraded":"2024-03-27T08:35:11.012520+0000","last_fullsized":"2024-03-27T08:35:11.012520+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:01:13.918208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66102,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":291,"num_read_kb":206,"num_write":35,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.306499+0000","last_change":"2024-03-27T08:32:46.596672+0000","last_active":"2024-03-27T08:34:17.306499+0000","last_peered":"2024-03-27T08:34:17.306499+0000","last_clean":"2024-03-27T08:34:17.306499+0000","last_became_active":"2024-03-27T08:32:46.596280+0000","last_became_peered":"2024-03-27T08:32:46.596280+0000","last_unstale":"2024-03-27T08:34:17.306499+0000","last_undegraded":"2024-03-27T08:34:17.306499+0000","last_fullsized":"2024-03-27T08:34:17.306499+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:55:06.177514+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"88'6","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466773+0000","last_change":"2024-03-27T08:32:45.584974+0000","last_active":"2024-03-27T08:33:18.466773+0000","last_peered":"2024-03-27T08:33:18.466773+0000","last_clean":"2024-03-27T08:33:18.466773+0000","last_became_active":"2024-03-27T08:32:45.583987+0000","last_became_peered":"2024-03-27T08:32:45.583987+0000","last_unstale":"2024-03-27T08:33:18.466773+0000","last_undegraded":"2024-03-27T08:33:18.466773+0000","last_fullsized":"2024-03-27T08:33:18.466773+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:18:47.898565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.327742+0000","last_change":"2024-03-27T08:32:46.598788+0000","last_active":"2024-03-27T08:34:17.327742+0000","last_peered":"2024-03-27T08:34:17.327742+0000","last_clean":"2024-03-27T08:34:17.327742+0000","last_became_active":"2024-03-27T08:32:46.597602+0000","last_became_peered":"2024-03-27T08:32:46.597602+0000","last_unstale":"2024-03-27T08:34:17.327742+0000","last_undegraded":"2024-03-27T08:34:17.327742+0000","last_fullsized":"2024-03-27T08:34:17.327742+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:50:43.288390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453532+0000","last_change":"2024-03-27T08:32:45.580667+0000","last_active":"2024-03-27T08:33:18.453532+0000","last_peered":"2024-03-27T08:33:18.453532+0000","last_clean":"2024-03-27T08:33:18.453532+0000","last_became_active":"2024-03-27T08:32:45.577272+0000","last_became_peered":"2024-03-27T08:32:45.577272+0000","last_unstale":"2024-03-27T08:33:18.453532+0000","last_undegraded":"2024-03-27T08:33:18.453532+0000","last_fullsized":"2024-03-27T08:33:18.453532+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T09:05:12.722046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.328759+0000","last_change":"2024-03-27T08:32:46.597010+0000","last_active":"2024-03-27T08:34:17.328759+0000","last_peered":"2024-03-27T08:34:17.328759+0000","last_clean":"2024-03-27T08:34:17.328759+0000","last_became_active":"2024-03-27T08:32:46.595497+0000","last_became_peered":"2024-03-27T08:32:46.595497+0000","last_unstale":"2024-03-27T08:34:17.328759+0000","last_undegraded":"2024-03-27T08:34:17.328759+0000","last_fullsized":"2024-03-27T08:34:17.328759+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:23:20.885704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'4","reported_seq":166,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:09.056380+0000","last_change":"2024-03-27T08:32:45.586323+0000","last_active":"2024-03-27T08:35:09.056380+0000","last_peered":"2024-03-27T08:35:09.056380+0000","last_clean":"2024-03-27T08:35:09.056380+0000","last_became_active":"2024-03-27T08:32:45.583581+0000","last_became_peered":"2024-03-27T08:32:45.583581+0000","last_unstale":"2024-03-27T08:35:09.056380+0000","last_undegraded":"2024-03-27T08:35:09.056380+0000","last_fullsized":"2024-03-27T08:35:09.056380+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:35:59.389312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1081,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326775+0000","last_change":"2024-03-27T08:32:46.610168+0000","last_active":"2024-03-27T08:34:17.326775+0000","last_peered":"2024-03-27T08:34:17.326775+0000","last_clean":"2024-03-27T08:34:17.326775+0000","last_became_active":"2024-03-27T08:32:46.609028+0000","last_became_peered":"2024-03-27T08:32:46.609028+0000","last_unstale":"2024-03-27T08:34:17.326775+0000","last_undegraded":"2024-03-27T08:34:17.326775+0000","last_fullsized":"2024-03-27T08:34:17.326775+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:29:00.642811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"88'15","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.511034+0000","last_change":"2024-03-27T08:33:18.509705+0000","last_active":"2024-03-27T08:33:18.511034+0000","last_peered":"2024-03-27T08:33:18.511034+0000","last_clean":"2024-03-27T08:33:18.511034+0000","last_became_active":"2024-03-27T08:33:18.470729+0000","last_became_peered":"2024-03-27T08:33:18.470729+0000","last_unstale":"2024-03-27T08:33:18.511034+0000","last_undegraded":"2024-03-27T08:33:18.511034+0000","last_fullsized":"2024-03-27T08:33:18.511034+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:16.965904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":112,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.11","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.325173+0000","last_change":"2024-03-27T08:32:46.599357+0000","last_active":"2024-03-27T08:34:17.325173+0000","last_peered":"2024-03-27T08:34:17.325173+0000","last_clean":"2024-03-27T08:34:17.325173+0000","last_became_active":"2024-03-27T08:32:46.598986+0000","last_became_peered":"2024-03-27T08:32:46.598986+0000","last_unstale":"2024-03-27T08:34:17.325173+0000","last_undegraded":"2024-03-27T08:34:17.325173+0000","last_fullsized":"2024-03-27T08:34:17.325173+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:13:11.817214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"88'2","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.460393+0000","last_change":"2024-03-27T08:32:45.574055+0000","last_active":"2024-03-27T08:33:18.460393+0000","last_peered":"2024-03-27T08:33:18.460393+0000","last_clean":"2024-03-27T08:33:18.460393+0000","last_became_active":"2024-03-27T08:32:45.573693+0000","last_became_peered":"2024-03-27T08:32:45.573693+0000","last_unstale":"2024-03-27T08:33:18.460393+0000","last_undegraded":"2024-03-27T08:33:18.460393+0000","last_fullsized":"2024-03-27T08:33:18.460393+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:05:12.278116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314538+0000","last_change":"2024-03-27T08:32:46.603278+0000","last_active":"2024-03-27T08:34:17.314538+0000","last_peered":"2024-03-27T08:34:17.314538+0000","last_clean":"2024-03-27T08:34:17.314538+0000","last_became_active":"2024-03-27T08:32:46.602896+0000","last_became_peered":"2024-03-27T08:32:46.602896+0000","last_unstale":"2024-03-27T08:34:17.314538+0000","last_undegraded":"2024-03-27T08:34:17.314538+0000","last_fullsized":"2024-03-27T08:34:17.314538+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:50.080706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.666246+0000","last_change":"2024-03-27T08:32:45.574335+0000","last_active":"2024-03-27T08:33:18.666246+0000","last_peered":"2024-03-27T08:33:18.666246+0000","last_clean":"2024-03-27T08:33:18.666246+0000","last_became_active":"2024-03-27T08:32:45.572680+0000","last_became_peered":"2024-03-27T08:32:45.572680+0000","last_unstale":"2024-03-27T08:33:18.666246+0000","last_undegraded":"2024-03-27T08:33:18.666246+0000","last_fullsized":"2024-03-27T08:33:18.666246+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:17:23.887510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329418+0000","last_change":"2024-03-27T08:32:46.606946+0000","last_active":"2024-03-27T08:34:17.329418+0000","last_peered":"2024-03-27T08:34:17.329418+0000","last_clean":"2024-03-27T08:34:17.329418+0000","last_became_active":"2024-03-27T08:32:46.606225+0000","last_became_peered":"2024-03-27T08:32:46.606225+0000","last_unstale":"2024-03-27T08:34:17.329418+0000","last_undegraded":"2024-03-27T08:34:17.329418+0000","last_fullsized":"2024-03-27T08:34:17.329418+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:53:34.913437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"88'1","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453177+0000","last_change":"2024-03-27T08:32:45.586107+0000","last_active":"2024-03-27T08:33:18.453177+0000","last_peered":"2024-03-27T08:33:18.453177+0000","last_clean":"2024-03-27T08:33:18.453177+0000","last_became_active":"2024-03-27T08:32:45.585337+0000","last_became_peered":"2024-03-27T08:32:45.585337+0000","last_unstale":"2024-03-27T08:33:18.453177+0000","last_undegraded":"2024-03-27T08:33:18.453177+0000","last_fullsized":"2024-03-27T08:33:18.453177+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:10:41.993199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.330304+0000","last_change":"2024-03-27T08:33:18.668500+0000","last_active":"2024-03-27T08:34:17.330304+0000","last_peered":"2024-03-27T08:34:17.330304+0000","last_clean":"2024-03-27T08:34:17.330304+0000","last_became_active":"2024-03-27T08:33:18.668118+0000","last_became_peered":"2024-03-27T08:33:18.668118+0000","last_unstale":"2024-03-27T08:34:17.330304+0000","last_undegraded":"2024-03-27T08:34:17.330304+0000","last_fullsized":"2024-03-27T08:34:17.330304+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:52:47.310275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,0],"acting":[10,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.0","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317752+0000","last_change":"2024-03-27T08:32:46.603962+0000","last_active":"2024-03-27T08:34:17.317752+0000","last_peered":"2024-03-27T08:34:17.317752+0000","last_clean":"2024-03-27T08:34:17.317752+0000","last_became_active":"2024-03-27T08:32:46.603565+0000","last_became_peered":"2024-03-27T08:32:46.603565+0000","last_unstale":"2024-03-27T08:34:17.317752+0000","last_undegraded":"2024-03-27T08:34:17.317752+0000","last_fullsized":"2024-03-27T08:34:17.317752+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:58:56.620253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"90'5","reported_seq":168,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:35:13.066183+0000","last_change":"2024-03-27T08:32:45.581979+0000","last_active":"2024-03-27T08:35:13.066183+0000","last_peered":"2024-03-27T08:35:13.066183+0000","last_clean":"2024-03-27T08:35:13.066183+0000","last_became_active":"2024-03-27T08:32:45.581501+0000","last_became_peered":"2024-03-27T08:32:45.581501+0000","last_unstale":"2024-03-27T08:35:13.066183+0000","last_undegraded":"2024-03-27T08:35:13.066183+0000","last_fullsized":"2024-03-27T08:35:13.066183+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:05.073236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":143,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331488+0000","last_change":"2024-03-27T08:32:46.608485+0000","last_active":"2024-03-27T08:34:17.331488+0000","last_peered":"2024-03-27T08:34:17.331488+0000","last_clean":"2024-03-27T08:34:17.331488+0000","last_became_active":"2024-03-27T08:32:46.608079+0000","last_became_peered":"2024-03-27T08:32:46.608079+0000","last_unstale":"2024-03-27T08:34:17.331488+0000","last_undegraded":"2024-03-27T08:34:17.331488+0000","last_fullsized":"2024-03-27T08:34:17.331488+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:47:54.299987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"88'3","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613253+0000","last_change":"2024-03-27T08:32:45.582482+0000","last_active":"2024-03-27T08:33:18.613253+0000","last_peered":"2024-03-27T08:33:18.613253+0000","last_clean":"2024-03-27T08:33:18.613253+0000","last_became_active":"2024-03-27T08:32:45.580755+0000","last_became_peered":"2024-03-27T08:32:45.580755+0000","last_unstale":"2024-03-27T08:33:18.613253+0000","last_undegraded":"2024-03-27T08:33:18.613253+0000","last_fullsized":"2024-03-27T08:33:18.613253+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:28:39.297546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"22'137","reported_seq":347,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.452942+0000","last_change":"2024-03-27T08:31:10.470845+0000","last_active":"2024-03-27T08:33:18.452942+0000","last_peered":"2024-03-27T08:33:18.452942+0000","last_clean":"2024-03-27T08:33:18.452942+0000","last_became_active":"2024-03-27T08:31:10.469601+0000","last_became_peered":"2024-03-27T08:31:10.469601+0000","last_unstale":"2024-03-27T08:33:18.452942+0000","last_undegraded":"2024-03-27T08:33:18.452942+0000","last_fullsized":"2024-03-27T08:33:18.452942+0000","mapping_epoch":78,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":79,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:26:33.633119+0000","last_clean_scrub_stamp":"2024-03-27T08:26:33.633119+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:10:52.442666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314265+0000","last_change":"2024-03-27T08:32:46.610922+0000","last_active":"2024-03-27T08:34:17.314265+0000","last_peered":"2024-03-27T08:34:17.314265+0000","last_clean":"2024-03-27T08:34:17.314265+0000","last_became_active":"2024-03-27T08:32:46.609049+0000","last_became_peered":"2024-03-27T08:32:46.609049+0000","last_unstale":"2024-03-27T08:34:17.314265+0000","last_undegraded":"2024-03-27T08:34:17.314265+0000","last_fullsized":"2024-03-27T08:34:17.314265+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:51.754353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.453069+0000","last_change":"2024-03-27T08:32:45.589817+0000","last_active":"2024-03-27T08:33:18.453069+0000","last_peered":"2024-03-27T08:33:18.453069+0000","last_clean":"2024-03-27T08:33:18.453069+0000","last_became_active":"2024-03-27T08:32:45.589468+0000","last_became_peered":"2024-03-27T08:32:45.589468+0000","last_unstale":"2024-03-27T08:33:18.453069+0000","last_undegraded":"2024-03-27T08:33:18.453069+0000","last_fullsized":"2024-03-27T08:33:18.453069+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T08:37:33.700386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"88'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.462095+0000","last_change":"2024-03-27T08:32:45.590846+0000","last_active":"2024-03-27T08:33:18.462095+0000","last_peered":"2024-03-27T08:33:18.462095+0000","last_clean":"2024-03-27T08:33:18.462095+0000","last_became_active":"2024-03-27T08:32:45.590536+0000","last_became_peered":"2024-03-27T08:32:45.590536+0000","last_unstale":"2024-03-27T08:33:18.462095+0000","last_undegraded":"2024-03-27T08:33:18.462095+0000","last_fullsized":"2024-03-27T08:33:18.462095+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:37:23.250317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314390+0000","last_change":"2024-03-27T08:32:46.609441+0000","last_active":"2024-03-27T08:34:17.314390+0000","last_peered":"2024-03-27T08:34:17.314390+0000","last_clean":"2024-03-27T08:34:17.314390+0000","last_became_active":"2024-03-27T08:32:46.609037+0000","last_became_peered":"2024-03-27T08:32:46.609037+0000","last_unstale":"2024-03-27T08:34:17.314390+0000","last_undegraded":"2024-03-27T08:34:17.314390+0000","last_fullsized":"2024-03-27T08:34:17.314390+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:06:46.103858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"90'11","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:58.577766+0000","last_change":"2024-03-27T08:32:45.577917+0000","last_active":"2024-03-27T08:34:58.577766+0000","last_peered":"2024-03-27T08:34:58.577766+0000","last_clean":"2024-03-27T08:34:58.577766+0000","last_became_active":"2024-03-27T08:32:45.577480+0000","last_became_peered":"2024-03-27T08:32:45.577480+0000","last_unstale":"2024-03-27T08:34:58.577766+0000","last_undegraded":"2024-03-27T08:34:58.577766+0000","last_fullsized":"2024-03-27T08:34:58.577766+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:35.950711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.329362+0000","last_change":"2024-03-27T08:32:46.611510+0000","last_active":"2024-03-27T08:34:17.329362+0000","last_peered":"2024-03-27T08:34:17.329362+0000","last_clean":"2024-03-27T08:34:17.329362+0000","last_became_active":"2024-03-27T08:32:46.609527+0000","last_became_peered":"2024-03-27T08:32:46.609527+0000","last_unstale":"2024-03-27T08:34:17.329362+0000","last_undegraded":"2024-03-27T08:34:17.329362+0000","last_fullsized":"2024-03-27T08:34:17.329362+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:12:36.021477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"88'4","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.613561+0000","last_change":"2024-03-27T08:32:45.584258+0000","last_active":"2024-03-27T08:33:18.613561+0000","last_peered":"2024-03-27T08:33:18.613561+0000","last_clean":"2024-03-27T08:33:18.613561+0000","last_became_active":"2024-03-27T08:32:45.583877+0000","last_became_peered":"2024-03-27T08:32:45.583877+0000","last_unstale":"2024-03-27T08:33:18.613561+0000","last_undegraded":"2024-03-27T08:33:18.613561+0000","last_fullsized":"2024-03-27T08:33:18.613561+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T11:58:21.870608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"90'7","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319836+0000","last_change":"2024-03-27T08:33:18.469718+0000","last_active":"2024-03-27T08:34:17.319836+0000","last_peered":"2024-03-27T08:34:17.319836+0000","last_clean":"2024-03-27T08:34:17.319836+0000","last_became_active":"2024-03-27T08:33:18.469083+0000","last_became_peered":"2024-03-27T08:33:18.469083+0000","last_unstale":"2024-03-27T08:34:17.319836+0000","last_undegraded":"2024-03-27T08:34:17.319836+0000","last_fullsized":"2024-03-27T08:34:17.319836+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:06:13.679456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"88'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.661254+0000","last_change":"2024-03-27T08:32:45.587382+0000","last_active":"2024-03-27T08:33:18.661254+0000","last_peered":"2024-03-27T08:33:18.661254+0000","last_clean":"2024-03-27T08:33:18.661254+0000","last_became_active":"2024-03-27T08:32:45.586987+0000","last_became_peered":"2024-03-27T08:32:45.586987+0000","last_unstale":"2024-03-27T08:33:18.661254+0000","last_undegraded":"2024-03-27T08:33:18.661254+0000","last_fullsized":"2024-03-27T08:33:18.661254+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:16:31.768754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.319660+0000","last_change":"2024-03-27T08:32:46.599644+0000","last_active":"2024-03-27T08:34:17.319660+0000","last_peered":"2024-03-27T08:34:17.319660+0000","last_clean":"2024-03-27T08:34:17.319660+0000","last_became_active":"2024-03-27T08:32:46.599199+0000","last_became_peered":"2024-03-27T08:32:46.599199+0000","last_unstale":"2024-03-27T08:34:17.319660+0000","last_undegraded":"2024-03-27T08:34:17.319660+0000","last_fullsized":"2024-03-27T08:34:17.319660+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:57:13.936898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"88'3","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466731+0000","last_change":"2024-03-27T08:32:45.581558+0000","last_active":"2024-03-27T08:33:18.466731+0000","last_peered":"2024-03-27T08:33:18.466731+0000","last_clean":"2024-03-27T08:33:18.466731+0000","last_became_active":"2024-03-27T08:32:45.580562+0000","last_became_peered":"2024-03-27T08:32:45.580562+0000","last_unstale":"2024-03-27T08:33:18.466731+0000","last_undegraded":"2024-03-27T08:33:18.466731+0000","last_fullsized":"2024-03-27T08:33:18.466731+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:45:52.657449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314276+0000","last_change":"2024-03-27T08:32:46.596011+0000","last_active":"2024-03-27T08:34:17.314276+0000","last_peered":"2024-03-27T08:34:17.314276+0000","last_clean":"2024-03-27T08:34:17.314276+0000","last_became_active":"2024-03-27T08:32:46.595283+0000","last_became_peered":"2024-03-27T08:32:46.595283+0000","last_unstale":"2024-03-27T08:34:17.314276+0000","last_undegraded":"2024-03-27T08:34:17.314276+0000","last_fullsized":"2024-03-27T08:34:17.314276+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:02:34.160649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":16,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:21.961137+0000","last_change":"2024-03-27T08:33:18.478350+0000","last_active":"2024-03-27T08:33:21.961137+0000","last_peered":"2024-03-27T08:33:21.961137+0000","last_clean":"2024-03-27T08:33:21.961137+0000","last_became_active":"2024-03-27T08:33:18.470274+0000","last_became_peered":"2024-03-27T08:33:18.470274+0000","last_unstale":"2024-03-27T08:33:21.961137+0000","last_undegraded":"2024-03-27T08:33:21.961137+0000","last_fullsized":"2024-03-27T08:33:21.961137+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:45:54.073568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,3,8],"acting":[11,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.b","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.326434+0000","last_change":"2024-03-27T08:32:46.613211+0000","last_active":"2024-03-27T08:34:17.326434+0000","last_peered":"2024-03-27T08:34:17.326434+0000","last_clean":"2024-03-27T08:34:17.326434+0000","last_became_active":"2024-03-27T08:32:46.612274+0000","last_became_peered":"2024-03-27T08:32:46.612274+0000","last_unstale":"2024-03-27T08:34:17.326434+0000","last_undegraded":"2024-03-27T08:34:17.326434+0000","last_fullsized":"2024-03-27T08:34:17.326434+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:02:36.161599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"88'4","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.459714+0000","last_change":"2024-03-27T08:32:45.587149+0000","last_active":"2024-03-27T08:33:18.459714+0000","last_peered":"2024-03-27T08:33:18.459714+0000","last_clean":"2024-03-27T08:33:18.459714+0000","last_became_active":"2024-03-27T08:32:45.586774+0000","last_became_peered":"2024-03-27T08:32:45.586774+0000","last_unstale":"2024-03-27T08:33:18.459714+0000","last_undegraded":"2024-03-27T08:33:18.459714+0000","last_fullsized":"2024-03-27T08:33:18.459714+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:28:48.437868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"90'5","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332297+0000","last_change":"2024-03-27T08:32:46.603232+0000","last_active":"2024-03-27T08:34:17.332297+0000","last_peered":"2024-03-27T08:34:17.332297+0000","last_clean":"2024-03-27T08:34:17.332297+0000","last_became_active":"2024-03-27T08:32:46.602926+0000","last_became_peered":"2024-03-27T08:32:46.602926+0000","last_unstale":"2024-03-27T08:34:17.332297+0000","last_undegraded":"2024-03-27T08:34:17.332297+0000","last_fullsized":"2024-03-27T08:34:17.332297+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:33:45.896039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"88'3","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.466537+0000","last_change":"2024-03-27T08:32:45.580054+0000","last_active":"2024-03-27T08:33:18.466537+0000","last_peered":"2024-03-27T08:33:18.466537+0000","last_clean":"2024-03-27T08:33:18.466537+0000","last_became_active":"2024-03-27T08:32:45.579527+0000","last_became_peered":"2024-03-27T08:32:45.579527+0000","last_unstale":"2024-03-27T08:33:18.466537+0000","last_undegraded":"2024-03-27T08:33:18.466537+0000","last_fullsized":"2024-03-27T08:33:18.466537+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:52:47.702038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.332192+0000","last_change":"2024-03-27T08:32:46.606405+0000","last_active":"2024-03-27T08:34:17.332192+0000","last_peered":"2024-03-27T08:34:17.332192+0000","last_clean":"2024-03-27T08:34:17.332192+0000","last_became_active":"2024-03-27T08:32:46.605394+0000","last_became_peered":"2024-03-27T08:32:46.605394+0000","last_unstale":"2024-03-27T08:34:17.332192+0000","last_undegraded":"2024-03-27T08:34:17.332192+0000","last_fullsized":"2024-03-27T08:34:17.332192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:25:17.278213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"87'1","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.454622+0000","last_change":"2024-03-27T08:32:45.584352+0000","last_active":"2024-03-27T08:33:18.454622+0000","last_peered":"2024-03-27T08:33:18.454622+0000","last_clean":"2024-03-27T08:33:18.454622+0000","last_became_active":"2024-03-27T08:32:45.584038+0000","last_became_peered":"2024-03-27T08:32:45.584038+0000","last_unstale":"2024-03-27T08:33:18.454622+0000","last_undegraded":"2024-03-27T08:33:18.454622+0000","last_fullsized":"2024-03-27T08:33:18.454622+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:13:47.616406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324166+0000","last_change":"2024-03-27T08:32:46.600481+0000","last_active":"2024-03-27T08:34:17.324166+0000","last_peered":"2024-03-27T08:34:17.324166+0000","last_clean":"2024-03-27T08:34:17.324166+0000","last_became_active":"2024-03-27T08:32:46.600127+0000","last_became_peered":"2024-03-27T08:32:46.600127+0000","last_unstale":"2024-03-27T08:34:17.324166+0000","last_undegraded":"2024-03-27T08:34:17.324166+0000","last_fullsized":"2024-03-27T08:34:17.324166+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:13:57.422045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"87'2","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:33:18.450620+0000","last_change":"2024-03-27T08:32:45.577243+0000","last_active":"2024-03-27T08:33:18.450620+0000","last_peered":"2024-03-27T08:33:18.450620+0000","last_clean":"2024-03-27T08:33:18.450620+0000","last_became_active":"2024-03-27T08:32:45.576863+0000","last_became_peered":"2024-03-27T08:32:45.576863+0000","last_unstale":"2024-03-27T08:33:18.450620+0000","last_undegraded":"2024-03-27T08:33:18.450620+0000","last_fullsized":"2024-03-27T08:33:18.450620+0000","mapping_epoch":85,"log_start":"0'0","ondisk_log_start":"0'0","created":85,"last_epoch_clean":86,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:44.527402+0000","last_clean_scrub_stamp":"2024-03-27T08:32:44.527402+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T13:53:38.172365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324055+0000","last_change":"2024-03-27T08:32:46.599204+0000","last_active":"2024-03-27T08:34:17.324055+0000","last_peered":"2024-03-27T08:34:17.324055+0000","last_clean":"2024-03-27T08:34:17.324055+0000","last_became_active":"2024-03-27T08:32:46.598868+0000","last_became_peered":"2024-03-27T08:32:46.598868+0000","last_unstale":"2024-03-27T08:34:17.324055+0000","last_undegraded":"2024-03-27T08:34:17.324055+0000","last_fullsized":"2024-03-27T08:34:17.324055+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T15:31:42.090521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"90'9","reported_seq":27,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.315671+0000","last_change":"2024-03-27T08:32:46.604191+0000","last_active":"2024-03-27T08:34:17.315671+0000","last_peered":"2024-03-27T08:34:17.315671+0000","last_clean":"2024-03-27T08:34:17.315671+0000","last_became_active":"2024-03-27T08:32:46.603878+0000","last_became_peered":"2024-03-27T08:32:46.603878+0000","last_unstale":"2024-03-27T08:34:17.315671+0000","last_undegraded":"2024-03-27T08:34:17.315671+0000","last_fullsized":"2024-03-27T08:34:17.315671+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:49:18.694584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"90'12","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316512+0000","last_change":"2024-03-27T08:32:46.602952+0000","last_active":"2024-03-27T08:34:17.316512+0000","last_peered":"2024-03-27T08:34:17.316512+0000","last_clean":"2024-03-27T08:34:17.316512+0000","last_became_active":"2024-03-27T08:32:46.602595+0000","last_became_peered":"2024-03-27T08:32:46.602595+0000","last_unstale":"2024-03-27T08:34:17.316512+0000","last_undegraded":"2024-03-27T08:34:17.316512+0000","last_fullsized":"2024-03-27T08:34:17.316512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T18:46:57.398839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"90'8","reported_seq":32,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314942+0000","last_change":"2024-03-27T08:33:18.669781+0000","last_active":"2024-03-27T08:34:17.314942+0000","last_peered":"2024-03-27T08:34:17.314942+0000","last_clean":"2024-03-27T08:34:17.314942+0000","last_became_active":"2024-03-27T08:33:18.668571+0000","last_became_peered":"2024-03-27T08:33:18.668571+0000","last_unstale":"2024-03-27T08:34:17.314942+0000","last_undegraded":"2024-03-27T08:34:17.314942+0000","last_fullsized":"2024-03-27T08:34:17.314942+0000","mapping_epoch":89,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":90,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:11:18.952730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,9,0],"acting":[2,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"90'7","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.316247+0000","last_change":"2024-03-27T08:32:46.587498+0000","last_active":"2024-03-27T08:34:17.316247+0000","last_peered":"2024-03-27T08:34:17.316247+0000","last_clean":"2024-03-27T08:34:17.316247+0000","last_became_active":"2024-03-27T08:32:46.587130+0000","last_became_peered":"2024-03-27T08:32:46.587130+0000","last_unstale":"2024-03-27T08:34:17.316247+0000","last_undegraded":"2024-03-27T08:34:17.316247+0000","last_fullsized":"2024-03-27T08:34:17.316247+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:40:41.251484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"90'4","reported_seq":22,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.318542+0000","last_change":"2024-03-27T08:32:46.587615+0000","last_active":"2024-03-27T08:34:17.318542+0000","last_peered":"2024-03-27T08:34:17.318542+0000","last_clean":"2024-03-27T08:34:17.318542+0000","last_became_active":"2024-03-27T08:32:46.587228+0000","last_became_peered":"2024-03-27T08:32:46.587228+0000","last_unstale":"2024-03-27T08:34:17.318542+0000","last_undegraded":"2024-03-27T08:34:17.318542+0000","last_fullsized":"2024-03-27T08:34:17.318542+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T19:26:13.212897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.314331+0000","last_change":"2024-03-27T08:32:46.607048+0000","last_active":"2024-03-27T08:34:17.314331+0000","last_peered":"2024-03-27T08:34:17.314331+0000","last_clean":"2024-03-27T08:34:17.314331+0000","last_became_active":"2024-03-27T08:32:46.605606+0000","last_became_peered":"2024-03-27T08:32:46.605606+0000","last_unstale":"2024-03-27T08:34:17.314331+0000","last_undegraded":"2024-03-27T08:34:17.314331+0000","last_fullsized":"2024-03-27T08:34:17.314331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T17:47:17.016427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"90'15","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.331939+0000","last_change":"2024-03-27T08:32:46.601616+0000","last_active":"2024-03-27T08:34:17.331939+0000","last_peered":"2024-03-27T08:34:17.331939+0000","last_clean":"2024-03-27T08:34:17.331939+0000","last_became_active":"2024-03-27T08:32:46.601204+0000","last_became_peered":"2024-03-27T08:32:46.601204+0000","last_unstale":"2024-03-27T08:34:17.331939+0000","last_undegraded":"2024-03-27T08:34:17.331939+0000","last_fullsized":"2024-03-27T08:34:17.331939+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T12:54:50.035694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"90'2","reported_seq":20,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.317997+0000","last_change":"2024-03-27T08:32:46.610847+0000","last_active":"2024-03-27T08:34:17.317997+0000","last_peered":"2024-03-27T08:34:17.317997+0000","last_clean":"2024-03-27T08:34:17.317997+0000","last_became_active":"2024-03-27T08:32:46.605396+0000","last_became_peered":"2024-03-27T08:32:46.605396+0000","last_unstale":"2024-03-27T08:34:17.317997+0000","last_undegraded":"2024-03-27T08:34:17.317997+0000","last_fullsized":"2024-03-27T08:34:17.317997+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T16:30:43.096220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"90'6","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322188+0000","last_change":"2024-03-27T08:32:46.601598+0000","last_active":"2024-03-27T08:34:17.322188+0000","last_peered":"2024-03-27T08:34:17.322188+0000","last_clean":"2024-03-27T08:34:17.322188+0000","last_became_active":"2024-03-27T08:32:46.597415+0000","last_became_peered":"2024-03-27T08:32:46.597415+0000","last_unstale":"2024-03-27T08:34:17.322188+0000","last_undegraded":"2024-03-27T08:34:17.322188+0000","last_fullsized":"2024-03-27T08:34:17.322188+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:40:51.585561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.322331+0000","last_change":"2024-03-27T08:32:46.602198+0000","last_active":"2024-03-27T08:34:17.322331+0000","last_peered":"2024-03-27T08:34:17.322331+0000","last_clean":"2024-03-27T08:34:17.322331+0000","last_became_active":"2024-03-27T08:32:46.601458+0000","last_became_peered":"2024-03-27T08:32:46.601458+0000","last_unstale":"2024-03-27T08:34:17.322331+0000","last_undegraded":"2024-03-27T08:34:17.322331+0000","last_fullsized":"2024-03-27T08:34:17.322331+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T14:28:36.431290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"90'10","reported_seq":28,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.334093+0000","last_change":"2024-03-27T08:32:46.598401+0000","last_active":"2024-03-27T08:34:17.334093+0000","last_peered":"2024-03-27T08:34:17.334093+0000","last_clean":"2024-03-27T08:34:17.334093+0000","last_became_active":"2024-03-27T08:32:46.597168+0000","last_became_peered":"2024-03-27T08:32:46.597168+0000","last_unstale":"2024-03-27T08:34:17.334093+0000","last_undegraded":"2024-03-27T08:34:17.334093+0000","last_fullsized":"2024-03-27T08:34:17.334093+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:18:38.880508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"90'11","reported_seq":29,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.324601+0000","last_change":"2024-03-27T08:32:46.603442+0000","last_active":"2024-03-27T08:34:17.324601+0000","last_peered":"2024-03-27T08:34:17.324601+0000","last_clean":"2024-03-27T08:34:17.324601+0000","last_became_active":"2024-03-27T08:32:46.602934+0000","last_became_peered":"2024-03-27T08:32:46.602934+0000","last_unstale":"2024-03-27T08:34:17.324601+0000","last_undegraded":"2024-03-27T08:34:17.324601+0000","last_fullsized":"2024-03-27T08:34:17.324601+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T10:38:46.745026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"90'8","reported_seq":26,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-03-27T08:34:17.312584+0000","last_change":"2024-03-27T08:32:46.595209+0000","last_active":"2024-03-27T08:34:17.312584+0000","last_peered":"2024-03-27T08:34:17.312584+0000","last_clean":"2024-03-27T08:34:17.312584+0000","last_became_active":"2024-03-27T08:32:46.594801+0000","last_became_peered":"2024-03-27T08:32:46.594801+0000","last_unstale":"2024-03-27T08:34:17.312584+0000","last_undegraded":"2024-03-27T08:34:17.312584+0000","last_fullsized":"2024-03-27T08:34:17.312584+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-27T08:32:45.536950+0000","last_clean_scrub_stamp":"2024-03-27T08:32:45.536950+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-28T20:26:44.824503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":109,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":71230,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":876,"num_read_kb":510,"num_write":176,"num_write_kb":126,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":112,"num_keys_recovered":10,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":213690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":151,"ondisk_log_size":151,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":83,"seq":356482285613,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":27654596},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":75,"seq":322122547252,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28644,"kb_used_data":1628,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716508,"statfs":{"total":95995035648,"available":95965704192,"internally_reserved":0,"allocated":1667072,"data_stored":1121998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":70,"seq":300647710778,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27980,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717172,"statfs":{"total":95995035648,"available":95966384128,"internally_reserved":0,"allocated":987136,"data_stored":468472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,7,8,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":62,"seq":266287972417,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":54,"seq":231928234058,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36880,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708272,"statfs":{"total":95995035648,"available":95957270528,"internally_reserved":0,"allocated":1581056,"data_stored":1061449,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":48,"seq":206158430288,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":974848,"data_stored":467861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1016,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1040384,"data_stored":533756,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36308,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708844,"statfs":{"total":95995035648,"available":95957856256,"internally_reserved":0,"allocated":995328,"data_stored":469132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411436,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28056,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717096,"statfs":{"total":95995035648,"available":95966306304,"internally_reserved":0,"allocated":1064960,"data_stored":536131,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":27,"seq":115964117093,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32144,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713008,"statfs":{"total":95995035648,"available":95962120192,"internally_reserved":0,"allocated":991232,"data_stored":468172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":35,"seq":150323855454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":978944,"data_stored":468791,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":40,"seq":171798691926,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28572,"kb_used_data":1556,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716580,"statfs":{"total":95995035648,"available":95965777920,"internally_reserved":0,"allocated":1593344,"data_stored":1060640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":68477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1137,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":2501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3310,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":68173,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-27T08:35:17.158 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:35:17.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 -- 172.21.15.164:0/309754462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 msgr2=0x7f4980104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 --2- 172.21.15.164:0/309754462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f4980104190 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4970009900 tx=0x7f497002bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:17.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 -- 172.21.15.164:0/309754462 shutdown_connections 2024-03-27T08:35:17.405 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 --2- 172.21.15.164:0/309754462 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980105920 0x7f498010c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 --2- 172.21.15.164:0/309754462 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980104f60 0x7f49801053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 --2- 172.21.15.164:0/309754462 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f4980104190 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 -- 172.21.15.164:0/309754462 >> 172.21.15.164:0/309754462 conn(0x7f49800ff300 msgr2=0x7f4980101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:17.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 -- 172.21.15.164:0/309754462 shutdown_connections 2024-03-27T08:35:17.406 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.413+0000 7f4986400640 1 -- 172.21.15.164:0/309754462 wait complete. 2024-03-27T08:35:17.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.414+0000 7f4986400640 1 Processor -- start 2024-03-27T08:35:17.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.414+0000 7f4986400640 1 -- start start 2024-03-27T08:35:17.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.408 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 0x7f498019a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 0x7f49801a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f498010fa20 con 0x7f4980103d70 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f498010f8a0 con 0x7f4980104f60 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f4986400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f498010fba0 con 0x7f4980105920 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49314/0 (socket says 172.21.15.164:49314) 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 -- 172.21.15.164:0/1705194818 learned_addr learned my addr 172.21.15.164:0/1705194818 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497ea00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 0x7f498019a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497fe00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 0x7f49801a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 -- 172.21.15.164:0/1705194818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 msgr2=0x7f49801a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 0x7f49801a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.409 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 -- 172.21.15.164:0/1705194818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 msgr2=0x7f498019a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 0x7f498019a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497f400640 1 -- 172.21.15.164:0/1705194818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49801a1cb0 con 0x7f4980103d70 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497fe00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 0x7f49801a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.415+0000 7f497ea00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 0x7f498019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f497f400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4970000c00 tx=0x7f4970004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970043020 con 0x7f4980103d70 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f49700054d0 con 0x7f4980103d70 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4970003d40 con 0x7f4980103d70 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49801a1f40 con 0x7f4980103d70 2024-03-27T08:35:17.410 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.416+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49801a23a0 con 0x7f4980103d70 2024-03-27T08:35:17.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.418+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f498010b090 con 0x7f4980103d70 2024-03-27T08:35:17.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.419+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4970046020 con 0x7f4980103d70 2024-03-27T08:35:17.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.421+0000 7f4977e00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 0x7f49640a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.422+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f49700f2090 con 0x7f4980103d70 2024-03-27T08:35:17.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.422+0000 7f497ea00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 0x7f49640a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.422+0000 7f497ea00640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 0x7f49640a5ad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f496c0058c0 tx=0x7f496c005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:17.417 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.426+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f497004d020 con 0x7f4980103d70 2024-03-27T08:35:17.486 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:17 smithi164 ceph-mon[31788]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:17.486 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:17 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:35:17.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.635+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4980062820 con 0x7f4980103d70 2024-03-27T08:35:17.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.637+0000 7f4977e00640 1 -- 172.21.15.164:0/1705194818 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f49700bec70 con 0x7f4980103d70 2024-03-27T08:35:17.629 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:17.629 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 msgr2=0x7f49640a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 0x7f49640a5ad0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f496c0058c0 tx=0x7f496c005850 comp rx=0 tx=0).stop 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 msgr2=0x7f498019a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4970000c00 tx=0x7f4970004f10 comp rx=0 tx=0).stop 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 shutdown_connections 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f49640a3610 0x7f49640a5ad0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4980105920 0x7f49801a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.632 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4980104f60 0x7f498019a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 --2- 172.21.15.164:0/1705194818 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4980103d70 0x7f498019a090 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 >> 172.21.15.164:0/1705194818 conn(0x7f49800ff300 msgr2=0x7f4980108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:17.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 shutdown_connections 2024-03-27T08:35:17.633 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.640+0000 7f4986400640 1 -- 172.21.15.164:0/1705194818 wait complete. 2024-03-27T08:35:17.649 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:35:17.650 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:35:17.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:17 smithi167 ceph-mon[34903]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:17.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:17 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:35:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:17 smithi173 ceph-mon[35397]: from='client.15351 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:17.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:17 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 -- 172.21.15.164:0/2439119028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 msgr2=0x7f3208100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 --2- 172.21.15.164:0/2439119028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208100290 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f31f8009930 tx=0x7f31f802bc20 comp rx=0 tx=0).stop 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 -- 172.21.15.164:0/2439119028 shutdown_connections 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 --2- 172.21.15.164:0/2439119028 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f320810a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 --2- 172.21.15.164:0/2439119028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 0x7f3208103360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 --2- 172.21.15.164:0/2439119028 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208100290 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 -- 172.21.15.164:0/2439119028 >> 172.21.15.164:0/2439119028 conn(0x7f32080fb780 msgr2=0x7f32080fdbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 -- 172.21.15.164:0/2439119028 shutdown_connections 2024-03-27T08:35:17.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.852+0000 7f320e800640 1 -- 172.21.15.164:0/2439119028 wait complete. 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.853+0000 7f320e800640 1 Processor -- start 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.853+0000 7f320e800640 1 -- start start 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.853+0000 7f320e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.853+0000 7f320e800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 0x7f3208100e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f320e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f32081013d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f320e800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f320810d850 con 0x7f32080ffe70 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f320e800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f320810d6d0 con 0x7f3208102ee0 2024-03-27T08:35:17.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f320e800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f320810d9d0 con 0x7f32081038a0 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49330/0 (socket says 172.21.15.164:49330) 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 -- 172.21.15.164:0/3773473024 learned_addr learned my addr 172.21.15.164:0/3773473024 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3206a00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 0x7f3208100e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207e00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f32081013d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 -- 172.21.15.164:0/3773473024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 msgr2=0x7f32081013d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f32081013d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 -- 172.21.15.164:0/3773473024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 msgr2=0x7f3208100e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 0x7f3208100e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:17.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207400640 1 -- 172.21.15.164:0/3773473024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3208101c60 con 0x7f32080ffe70 2024-03-27T08:35:17.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.854+0000 7f3207e00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f32081013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f3207400640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f31f8000c00 tx=0x7f31f8004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8043020 con 0x7f32080ffe70 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f31f8005460 con 0x7f32080ffe70 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32081a1ff0 con 0x7f32080ffe70 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31f8003cd0 con 0x7f32080ffe70 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.855+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32081a2400 con 0x7f32080ffe70 2024-03-27T08:35:17.849 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.856+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3208109010 con 0x7f32080ffe70 2024-03-27T08:35:17.850 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.858+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f31f8046020 con 0x7f32080ffe70 2024-03-27T08:35:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.860+0000 7f31ffe00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 0x7f31ec0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:17.851 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.860+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f31f80f2250 con 0x7f32080ffe70 2024-03-27T08:35:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.860+0000 7f3206a00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 0x7f31ec0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:17.852 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.860+0000 7f3206a00640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 0x7f31ec0a5ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f32081025c0 tx=0x7f31f4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:17.854 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:17.863+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f31f804d020 con 0x7f32080ffe70 2024-03-27T08:35:18.060 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.068+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f320802d5c0 con 0x7f32080ffe70 2024-03-27T08:35:18.061 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.069+0000 7f31ffe00640 1 -- 172.21.15.164:0/3773473024 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f31f80bee30 con 0x7f32080ffe70 2024-03-27T08:35:18.061 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 msgr2=0x7f31ec0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 0x7f31ec0a5ad0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f32081025c0 tx=0x7f31f4005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 msgr2=0x7f3208102850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f31f8000c00 tx=0x7f31f8004e20 comp rx=0 tx=0).stop 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 shutdown_connections 2024-03-27T08:35:18.064 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f31ec0a3610 0x7f31ec0a5ad0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f32081038a0 0x7f32081013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ee0 0x7f3208100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 --2- 172.21.15.164:0/3773473024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f32080ffe70 0x7f3208102850 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 >> 172.21.15.164:0/3773473024 conn(0x7f32080fb780 msgr2=0x7f32081061e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 shutdown_connections 2024-03-27T08:35:18.065 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.072+0000 7f320e800640 1 -- 172.21.15.164:0/3773473024 wait complete. 2024-03-27T08:35:18.083 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:35:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 -- 172.21.15.164:0/3379112993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 msgr2=0x7f8e4c109e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3379112993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c109e90 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8e44009ca0 tx=0x7f8e4402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 -- 172.21.15.164:0/3379112993 shutdown_connections 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3379112993 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c109e90 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3379112993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3379112993 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 0x7f8e4c101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 -- 172.21.15.164:0/3379112993 >> 172.21.15.164:0/3379112993 conn(0x7f8e4c0fcfc0 msgr2=0x7f8e4c0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 -- 172.21.15.164:0/3379112993 shutdown_connections 2024-03-27T08:35:18.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.294+0000 7f8e50a00640 1 -- 172.21.15.164:0/3379112993 wait complete. 2024-03-27T08:35:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.295+0000 7f8e50a00640 1 Processor -- start 2024-03-27T08:35:18.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.295+0000 7f8e50a00640 1 -- start start 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 0x7f8e4c075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c10d6b0 con 0x7f8e4c103600 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c10d530 con 0x7f8e4c102c40 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e50a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c10d830 con 0x7f8e4c101a50 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e4be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e4aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e4be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49350/0 (socket says 172.21.15.164:49350) 2024-03-27T08:35:18.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e4be00640 1 -- 172.21.15.164:0/3837052424 learned_addr learned my addr 172.21.15.164:0/3837052424 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.296+0000 7f8e4b400640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 0x7f8e4c075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 -- 172.21.15.164:0/3837052424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 msgr2=0x7f8e4c075900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 0x7f8e4c075900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 -- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 msgr2=0x7f8e4c074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 -- 172.21.15.164:0/3837052424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c074d10 con 0x7f8e4c102c40 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4be00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e4aa00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c073f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e38005fd0 tx=0x7f8e3800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38009c30 con 0x7f8e4c102c40 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c1a1e00 con 0x7f8e4c102c40 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.297+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8e38009dd0 con 0x7f8e4c102c40 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.298+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e38010460 con 0x7f8e4c102c40 2024-03-27T08:35:18.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.298+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c1a2270 con 0x7f8e4c102c40 2024-03-27T08:35:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.299+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c108d70 con 0x7f8e4c102c40 2024-03-27T08:35:18.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.301+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8e38003ec0 con 0x7f8e4c102c40 2024-03-27T08:35:18.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.302+0000 7f8e43e00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 0x7f8e300a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.303+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8e380cf7d0 con 0x7f8e4c102c40 2024-03-27T08:35:18.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.303+0000 7f8e4b400640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 0x7f8e300a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.304+0000 7f8e4b400640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 0x7f8e300a5ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c102aa0 tx=0x7f8e3c00b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:18.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.309+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f8e38017020 con 0x7f8e4c102c40 2024-03-27T08:35:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.518+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8e4c062750 con 0x7f8e4c102c40 2024-03-27T08:35:18.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.518+0000 7f8e43e00640 1 -- 172.21.15.164:0/3837052424 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f8e3809bd00 con 0x7f8e4c102c40 2024-03-27T08:35:18.510 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:35:18.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 msgr2=0x7f8e300a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 0x7f8e300a5ad0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c102aa0 tx=0x7f8e3c00b390 comp rx=0 tx=0).stop 2024-03-27T08:35:18.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 msgr2=0x7f8e4c073f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.513 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c073f40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8e38005fd0 tx=0x7f8e3800dde0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 shutdown_connections 2024-03-27T08:35:18.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8e300a3610 0x7f8e300a5ad0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8e4c103600 0x7f8e4c074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e4c102c40 0x7f8e4c073f40 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 --2- 172.21.15.164:0/3837052424 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8e4c101a50 0x7f8e4c075900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 >> 172.21.15.164:0/3837052424 conn(0x7f8e4c0fcfc0 msgr2=0x7f8e4c105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:18.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 shutdown_connections 2024-03-27T08:35:18.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.522+0000 7f8e50a00640 1 -- 172.21.15.164:0/3837052424 wait complete. 2024-03-27T08:35:18.532 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1705194818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:18 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3773473024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.769+0000 7fd756e00640 1 -- 172.21.15.164:0/1831224664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750102d50 msgr2=0x7fd7501031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.769+0000 7fd756e00640 1 --2- 172.21.15.164:0/1831224664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750102d50 0x7fd7501031d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fd73c009900 tx=0x7fd73c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 -- 172.21.15.164:0/1831224664 shutdown_connections 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 --2- 172.21.15.164:0/1831224664 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750103710 0x7fd750109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 --2- 172.21.15.164:0/1831224664 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750102d50 0x7fd7501031d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 --2- 172.21.15.164:0/1831224664 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 -- 172.21.15.164:0/1831224664 >> 172.21.15.164:0/1831224664 conn(0x7fd7500fd0d0 msgr2=0x7fd7500ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 -- 172.21.15.164:0/1831224664 shutdown_connections 2024-03-27T08:35:18.762 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.770+0000 7fd756e00640 1 -- 172.21.15.164:0/1831224664 wait complete. 2024-03-27T08:35:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.771+0000 7fd756e00640 1 Processor -- start 2024-03-27T08:35:18.763 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 -- start start 2024-03-27T08:35:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750102d50 0x7fd750073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 0x7fd750074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010d810 con 0x7fd750103710 2024-03-27T08:35:18.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010d690 con 0x7fd750102d50 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.772+0000 7fd756e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd75010d990 con 0x7fd750101b60 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd754e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 0x7fd750074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:56268/0 (socket says 172.21.15.164:56268) 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 -- 172.21.15.164:0/1448986575 learned_addr learned my addr 172.21.15.164:0/1448986575 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:18.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74f400640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750102d50 0x7fd750073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 -- 172.21.15.164:0/1448986575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750102d50 msgr2=0x7fd750073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750102d50 0x7fd750073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 -- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 msgr2=0x7fd750074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 0x7fd750074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 -- 172.21.15.164:0/1448986575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd750074d10 con 0x7fd750101b60 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd754e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 0x7fd750074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.773+0000 7fd74fe00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd74000e9c0 tx=0x7fd74000ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.774+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd74000cd80 con 0x7fd750101b60 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.774+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd7400035f0 con 0x7fd750101b60 2024-03-27T08:35:18.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.774+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7501a1fc0 con 0x7fd750101b60 2024-03-27T08:35:18.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.774+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd740010690 con 0x7fd750101b60 2024-03-27T08:35:18.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.774+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7501a2420 con 0x7fd750101b60 2024-03-27T08:35:18.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.775+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd750108ef0 con 0x7fd750101b60 2024-03-27T08:35:18.768 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.777+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fd7400037a0 con 0x7fd750101b60 2024-03-27T08:35:18.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.779+0000 7fd74cc00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 0x7fd7340a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.779+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd7400d02b0 con 0x7fd750101b60 2024-03-27T08:35:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.779+0000 7fd74f400640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 0x7fd7340a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:18.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.780+0000 7fd74f400640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 0x7fd7340a5b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd73c000c00 tx=0x7fd73c02c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:18.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:18.782+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd74009ce30 con 0x7fd750101b60 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1705194818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:18 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3773473024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='client.15357 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='client.15363 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-27T08:35:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: pgmap v440: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 1.1 KiB/s wr, 7 op/s 2024-03-27T08:35:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1705194818' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:18.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:18 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3773473024' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:35:18.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.004+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd75002d5e0 con 0x7fd750101b60 2024-03-27T08:35:18.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.005+0000 7fd74cc00640 1 -- 172.21.15.164:0/1448986575 <== mon.1 v2:172.21.15.173:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fd74009c730 con 0x7fd750101b60 2024-03-27T08:35:18.997 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:35:19.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.007+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 msgr2=0x7fd7340a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.007+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 0x7fd7340a5b50 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fd73c000c00 tx=0x7fd73c02c820 comp rx=0 tx=0).stop 2024-03-27T08:35:19.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.007+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 msgr2=0x7fd750075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.007+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fd74000e9c0 tx=0x7fd74000ee80 comp rx=0 tx=0).stop 2024-03-27T08:35:19.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 shutdown_connections 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd7340a3690 0x7fd7340a5b50 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd750103710 0x7fd750074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd750102d50 0x7fd750073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 --2- 172.21.15.164:0/1448986575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd750101b60 0x7fd750075900 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 >> 172.21.15.164:0/1448986575 conn(0x7fd7500fd0d0 msgr2=0x7fd7501060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 shutdown_connections 2024-03-27T08:35:19.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.008+0000 7fd756e00640 1 -- 172.21.15.164:0/1448986575 wait complete. 2024-03-27T08:35:19.018 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 -- 172.21.15.164:0/541764521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8075b90 msgr2=0x7f9db8073fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 --2- 172.21.15.164:0/541764521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8075b90 0x7f9db8073fe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9da8009900 tx=0x7f9da802bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 -- 172.21.15.164:0/541764521 shutdown_connections 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 --2- 172.21.15.164:0/541764521 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db8109820 0x7f9db810bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 --2- 172.21.15.164:0/541764521 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db80745b0 0x7f9db8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 --2- 172.21.15.164:0/541764521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8075b90 0x7f9db8073fe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.214+0000 7f9dbd600640 1 -- 172.21.15.164:0/541764521 >> 172.21.15.164:0/541764521 conn(0x7f9db80fceb0 msgr2=0x7f9db80ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.215+0000 7f9dbd600640 1 -- 172.21.15.164:0/541764521 shutdown_connections 2024-03-27T08:35:19.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.215+0000 7f9dbd600640 1 -- 172.21.15.164:0/541764521 wait complete. 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.215+0000 7f9dbd600640 1 Processor -- start 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 -- start start 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db80745b0 0x7f9db8199e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8109820 0x7f9db81a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810f7b0 con 0x7f9db8075b90 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810f630 con 0x7f9db8109820 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbd600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f9db810f930 con 0x7f9db80745b0 2024-03-27T08:35:19.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9db7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9db7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49380/0 (socket says 172.21.15.164:49380) 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9db7400640 1 -- 172.21.15.164:0/1955092555 learned_addr learned my addr 172.21.15.164:0/1955092555 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9db7e00640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db80745b0 0x7f9db8199e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.216+0000 7f9dbcc00640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8109820 0x7f9db81a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 -- 172.21.15.164:0/1955092555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db80745b0 msgr2=0x7f9db8199e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db80745b0 0x7f9db8199e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 -- 172.21.15.164:0/1955092555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8109820 msgr2=0x7f9db81a13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8109820 0x7f9db81a13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 -- 172.21.15.164:0/1955092555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9db81a1a20 con 0x7f9db8075b90 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db7400640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9da000ea60 tx=0x7f9da000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da000cde0 con 0x7f9db8075b90 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9db81a1d10 con 0x7f9db8075b90 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9da00035f0 con 0x7f9db8075b90 2024-03-27T08:35:19.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.217+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9da0010690 con 0x7f9db8075b90 2024-03-27T08:35:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.218+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9db81a2200 con 0x7f9db8075b90 2024-03-27T08:35:19.212 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.219+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9db8108550 con 0x7f9db8075b90 2024-03-27T08:35:19.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.222+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f9da00037a0 con 0x7f9db8075b90 2024-03-27T08:35:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.223+0000 7f9db4c00640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 0x7f9d9c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.223+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f9da00d0000 con 0x7f9db8075b90 2024-03-27T08:35:19.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.224+0000 7f9db7e00640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 0x7f9d9c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.224+0000 7f9db7e00640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 0x7f9d9c0a5ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005ab0 tx=0x7f9da8005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:19.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.228+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f9da009cbe0 con 0x7f9db8075b90 2024-03-27T08:35:19.469 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.477+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9db802d370 con 0x7f9db8075b90 2024-03-27T08:35:19.470 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.478+0000 7f9db4c00640 1 -- 172.21.15.164:0/1955092555 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11888 (secure 0 0 0) 0x7f9da009c4e0 con 0x7f9db8075b90 2024-03-27T08:35:19.470 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:19.470 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:35:11.240118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34502,34430,34463]},"id":1}]} 2024-03-27T08:35:19.471 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-03-27T08:35:19.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.480+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 msgr2=0x7f9d9c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.480+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 0x7f9d9c0a5ad0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9da8005ab0 tx=0x7f9da8005fd0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.472 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.480+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 msgr2=0x7f9db819a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.480+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f9da000ea60 tx=0x7f9da000ef20 comp rx=0 tx=0).stop 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 shutdown_connections 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f9d9c0a3610 0x7f9d9c0a5ad0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9db8109820 0x7f9db81a13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9db8075b90 0x7f9db819a340 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 --2- 172.21.15.164:0/1955092555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9db80745b0 0x7f9db8199e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 >> 172.21.15.164:0/1955092555 conn(0x7f9db80fceb0 msgr2=0x7f9db8105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 shutdown_connections 2024-03-27T08:35:19.473 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.481+0000 7f9dbd600640 1 -- 172.21.15.164:0/1955092555 wait complete. 2024-03-27T08:35:19.490 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 -- 172.21.15.164:0/2570705383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 msgr2=0x7fac401071c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 --2- 172.21.15.164:0/2570705383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac401071c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fac2c009900 tx=0x7fac2c02bc40 comp rx=0 tx=0).stop 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 -- 172.21.15.164:0/2570705383 shutdown_connections 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 --2- 172.21.15.164:0/2570705383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 0x7fac40109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 --2- 172.21.15.164:0/2570705383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac401071c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 --2- 172.21.15.164:0/2570705383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40104890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 -- 172.21.15.164:0/2570705383 >> 172.21.15.164:0/2570705383 conn(0x7fac400fbdd0 msgr2=0x7fac400fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:19.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 -- 172.21.15.164:0/2570705383 shutdown_connections 2024-03-27T08:35:19.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.688+0000 7fac45600640 1 -- 172.21.15.164:0/2570705383 wait complete. 2024-03-27T08:35:19.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.689+0000 7fac45600640 1 Processor -- start 2024-03-27T08:35:19.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.689+0000 7fac45600640 1 -- start start 2024-03-27T08:35:19.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac40100450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 0x7fac40100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fac4010d620 con 0x7fac40107700 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac4010d4a0 con 0x7fac401024a0 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac45600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fac4010d7a0 con 0x7fac40104dd0 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac44c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 0x7fac40100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:44550/0 (socket says 172.21.15.164:44550) 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 -- 172.21.15.164:0/4130481497 learned_addr learned my addr 172.21.15.164:0/4130481497 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3f400640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac40100450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 -- 172.21.15.164:0/4130481497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 msgr2=0x7fac40100450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac40100450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 -- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 msgr2=0x7fac40100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 0x7fac40100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.690+0000 7fac3fe00640 1 -- 172.21.15.164:0/4130481497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac40101220 con 0x7fac401024a0 2024-03-27T08:35:19.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac3fe00640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac3000e9f0 tx=0x7fac3000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac3000cd80 con 0x7fac401024a0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac30010900 con 0x7fac401024a0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac401a1d90 con 0x7fac401024a0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac300189e0 con 0x7fac401024a0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.691+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac401a21a0 con 0x7fac401024a0 2024-03-27T08:35:19.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.692+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac400fd8c0 con 0x7fac401024a0 2024-03-27T08:35:19.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.695+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fac30010ab0 con 0x7fac401024a0 2024-03-27T08:35:19.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.697+0000 7fac3cc00640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 0x7fac240a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.697+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fac300d05a0 con 0x7fac401024a0 2024-03-27T08:35:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.697+0000 7fac3f400640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 0x7fac240a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:19.689 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.698+0000 7fac3f400640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 0x7fac240a5ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac2c02c180 tx=0x7fac2c005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:19.696 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.705+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fac3009d120 con 0x7fac401024a0 2024-03-27T08:35:19.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:19 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3837052424' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:19 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1448986575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:19 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1955092555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:19.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:19 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3837052424' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:19 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1448986575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:19 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1955092555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:19 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3837052424' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:19 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1448986575' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:35:19.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:19 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1955092555' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:19.908 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.916+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fac40062750 con 0x7fac401024a0 2024-03-27T08:35:19.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.921+0000 7fac3cc00640 1 -- 172.21.15.164:0/4130481497 <== mon.2 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7fac3009ca20 con 0x7fac401024a0 2024-03-27T08:35:19.913 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:19.913 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.923+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 msgr2=0x7fac240a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.923+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 0x7fac240a5ad0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fac2c02c180 tx=0x7fac2c005fd0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 msgr2=0x7fac40101e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fac3000e9f0 tx=0x7fac3000eeb0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 shutdown_connections 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fac240a3610 0x7fac240a5ad0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fac40107700 0x7fac40100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fac40104dd0 0x7fac40100450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 --2- 172.21.15.164:0/4130481497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac401024a0 0x7fac40101e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:19.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 >> 172.21.15.164:0/4130481497 conn(0x7fac400fbdd0 msgr2=0x7fac40102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:19.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 shutdown_connections 2024-03-27T08:35:19.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:19.924+0000 7fac45600640 1 -- 172.21.15.164:0/4130481497 wait complete. 2024-03-27T08:35:19.935 DEBUG:tasks.fwd_scrub:Yielding 2024-03-27T08:35:19.935 INFO:teuthology.run_tasks:Running task background_exec... 2024-03-27T08:35:19.946 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:35:19.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-03-27T08:35:19.946 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-03-27T08:35:19.946 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T08:35:19.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:19.947 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T08:35:19.952 INFO:teuthology.run_tasks:Running task workunit... 2024-03-27T08:35:19.964 INFO:tasks.workunit:Pulling workunits from ref 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:35:19.965 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-27T08:35:19.965 INFO:tasks.workunit:timeout=3h 2024-03-27T08:35:19.965 INFO:tasks.workunit:cleanup=True 2024-03-27T08:35:19.965 DEBUG:teuthology.orchestra.run.smithi164:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:20.006 INFO:teuthology.orchestra.run.smithi164.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:20.006 INFO:teuthology.orchestra.run.smithi164.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-27T08:35:20.006 INFO:teuthology.orchestra.run.smithi164.stdout:Device: 76h/118d Inode: 1 Links: 2 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout:Access: 2024-03-27 08:32:53.744831269 +0000 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout:Modify: 2024-03-27 08:32:53.744831269 +0000 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout:Change: 2024-03-27 08:35:10.753770641 +0000 2024-03-27T08:35:20.007 INFO:teuthology.orchestra.run.smithi164.stdout: Birth: - 2024-03-27T08:35:20.007 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-27T08:35:20.007 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-27T08:35:20.136 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 155268c4e432a12433aa833f174f9fe3b1016ae0 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 -- 172.21.15.164:0/2063752768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 msgr2=0x7fe1ac076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/2063752768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac076930 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fe19c009900 tx=0x7fe19c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 -- 172.21.15.164:0/2063752768 shutdown_connections 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/2063752768 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 0x7fe1ac078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/2063752768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 0x7fe1ac077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/2063752768 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac076930 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.145 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.153+0000 7fe1b0c00640 1 -- 172.21.15.164:0/2063752768 >> 172.21.15.164:0/2063752768 conn(0x7fe1ac0ff300 msgr2=0x7fe1ac101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.154+0000 7fe1b0c00640 1 -- 172.21.15.164:0/2063752768 shutdown_connections 2024-03-27T08:35:20.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.154+0000 7fe1b0c00640 1 -- 172.21.15.164:0/2063752768 wait complete. 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.154+0000 7fe1b0c00640 1 Processor -- start 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 -- start start 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 0x7fe1ac19e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 0x7fe1ac1a5a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac113e10 con 0x7fe1ac076510 2024-03-27T08:35:20.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac113c90 con 0x7fe1ac077750 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1b0c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac113f90 con 0x7fe1ac0780f0 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1a9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1a9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49404/0 (socket says 172.21.15.164:49404) 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1a9e00640 1 -- 172.21.15.164:0/4141885411 learned_addr learned my addr 172.21.15.164:0/4141885411 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1a9400640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 0x7fe1ac19e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.155+0000 7fe1aa800640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 0x7fe1ac1a5a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 -- 172.21.15.164:0/4141885411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 msgr2=0x7fe1ac1a5a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 0x7fe1ac1a5a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 -- 172.21.15.164:0/4141885411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 msgr2=0x7fe1ac19e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 0x7fe1ac19e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 -- 172.21.15.164:0/4141885411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1ac1a60a0 con 0x7fe1ac076510 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a9e00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c005e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a2a00640 1 -- 172.21.15.164:0/4141885411 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c043020 con 0x7fe1ac076510 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1ac1a6330 con 0x7fe1ac076510 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a2a00640 1 -- 172.21.15.164:0/4141885411 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe19c005470 con 0x7fe1ac076510 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.156+0000 7fe1a2a00640 1 -- 172.21.15.164:0/4141885411 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe19c003c90 con 0x7fe1ac076510 2024-03-27T08:35:20.149 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.157+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1ac1a6880 con 0x7fe1ac076510 2024-03-27T08:35:20.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.160+0000 7fe1a2a00640 1 -- 172.21.15.164:0/4141885411 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fe19c046020 con 0x7fe1ac076510 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.161+0000 7fe1b39e6740 1 Processor -- start 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.161+0000 7fe1b39e6740 1 -- start start 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.161+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.161+0000 7fe1a2a00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 0x7fe1900a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.161+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ad8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.153 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35adf320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555c35a3c280 con 0x555c35ad8a90 2024-03-27T08:35:20.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c359e46f0 con 0x555c35ad80d0 2024-03-27T08:35:20.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555c35a38230 con 0x555c35ad6f00 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1a2a00640 1 -- 172.21.15.164:0/4141885411 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe19c0f1ec0 con 0x7fe1ac076510 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:56338/0 (socket says 172.21.15.164:56338) 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 -- 172.21.15.164:0/3427030878 learned_addr learned my addr 172.21.15.164:0/3427030878 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35adf320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1a9e00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 0x7fe1900a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ad8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 -- 172.21.15.164:0/3427030878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 msgr2=0x555c35ad8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ad8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 -- 172.21.15.164:0/3427030878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 msgr2=0x555c35adf320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35adf320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.162+0000 7fe1aa800640 1 -- 172.21.15.164:0/3427030878 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c358187e0 con 0x555c35ad6f00 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ad8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4005f40 tx=0x7fe1a4009b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8410716316c8c2a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe1a9e00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 0x7fe1900a5ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0be040 tx=0x7fe19c02bc30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe197000640 1 -- 172.21.15.164:0/3427030878 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4011070 con 0x555c35ad6f00 2024-03-27T08:35:20.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe197000640 1 -- 172.21.15.164:0/3427030878 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe1a400fd50 con 0x555c35ad6f00 2024-03-27T08:35:20.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.163+0000 7fe197000640 1 -- 172.21.15.164:0/3427030878 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4010bc0 con 0x555c35ad6f00 2024-03-27T08:35:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3427030878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 msgr2=0x555c35ad7320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4005f40 tx=0x7fe1a4009b80 comp rx=0 tx=0).stop 2024-03-27T08:35:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3427030878 shutdown_connections 2024-03-27T08:35:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35adf320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.161 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ad8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3427030878 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad7320 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.164+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3427030878 >> 172.21.15.164:0/3427030878 conn(0x555c35ad22f0 msgr2=0x555c35ad26f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.165+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3427030878 shutdown_connections 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.165+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3427030878 wait complete. 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.165+0000 7fe1b39e6740 1 -- start start 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.165+0000 7fe1b39e6740 1 Processor -- start 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 0x555c35ae19e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad8a90 0x555c35ae8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555c35adfaa0 con 0x555c35ad80d0 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555c359f7aa0 con 0x555c35ad8a90 2024-03-27T08:35:20.162 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555c35adfc20 con 0x555c35ad6f00 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1b39e6740 10 client.0 _ll_register_callbacks cb 0x555c359f7490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:56348/0 (socket says 172.21.15.164:56348) 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 0x555c35ae19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1aa800640 1 -- 172.21.15.164:0/3123043277 learned_addr learned my addr 172.21.15.164:0/3123043277 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.166+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad8a90 0x555c35ae8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 -- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad8a90 msgr2=0x555c35ae8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad8a90 0x555c35ae8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 -- 172.21.15.164:0/3123043277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 msgr2=0x555c35ae19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 0x555c35ae19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 -- 172.21.15.164:0/3123043277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c35878f70 con 0x555c35ad6f00 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 0x555c35ae19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009560 tx=0x7fe1a4009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4220f37cfa20a390 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe18b400640 10 client.0 ms_handle_connect on v2:172.21.15.173:3300/0 2024-03-27T08:35:20.163 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.167+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a4010b80 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mon.1 v2:172.21.15.173:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe1a4010d20 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a400fd50 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe1a4035050 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe1b39e6740 10 client.25009 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c35710170 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.168+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mon.1 v2:172.21.15.173:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe1a400fd50 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mon.1 v2:172.21.15.173:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe1a401f920 con 0x555c35ad6f00 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 10 client.25009 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 10 client.25009 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 20 client.25009 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35aed060 0x555c35aef450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 4 client.25009 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555c35a497c0 con 0x555c35aed060 2024-03-27T08:35:20.164 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.169+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35aed060 0x555c35aef450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.165 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.170+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35aed060 0x555c35aef450 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=426ad63f5e8575ef server_cookie=d63db67f823d6b9a in_seq=0 out_seq=0 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.170+0000 7fe18b400640 10 client.25009 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe18b400640 1 -- 172.21.15.164:0/3123043277 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555c35a497c0 con 0x555c35aed060 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe18b400640 10 client.25009 handle_command_reply: tid=0 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 client.25009 shutdown 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 msgr2=0x555c35ae14a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009560 tx=0x7fe1a4009f20 comp rx=0 tx=0).stop 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 shutdown_connections 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35aed060 0x555c35aef450 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad8a90 0x555c35ae8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad80d0 0x555c35ae19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe18b400640 0 client.25009 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3123043277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ae14a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 >> 172.21.15.164:0/3123043277 conn(0x555c35ad22f0 msgr2=0x555c35ad1550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 shutdown_connections 2024-03-27T08:35:20.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.172+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3123043277 wait complete. 2024-03-27T08:35:20.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.173+0000 7fe1b39e6740 20 client.25009 trim_cache size 0 max 16384 2024-03-27T08:35:20.182 INFO:tasks.workunit.client.0.smithi164.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-27T08:35:20.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.210+0000 7fe1b39e6740 1 Processor -- start 2024-03-27T08:35:20.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 -- start start 2024-03-27T08:35:20.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad5c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ae89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1b1dd0 con 0x555c35ad8a90 2024-03-27T08:35:20.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1af6a0 con 0x555c35ad80d0 2024-03-27T08:35:20.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1ad4f0 con 0x555c35ad6f00 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49438/0 (socket says 172.21.15.164:49438) 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1aa800640 1 -- 172.21.15.164:0/4166984766 learned_addr learned my addr 172.21.15.164:0/4166984766 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.211+0000 7fe1a9400640 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ae89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 -- 172.21.15.164:0/4166984766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 msgr2=0x555c35ad5c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad5c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 -- 172.21.15.164:0/4166984766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 msgr2=0x555c35ae89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ae89e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 -- 172.21.15.164:0/4166984766 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555c35aefad0 con 0x555c35ad8a90 2024-03-27T08:35:20.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.212+0000 7fe1aa800640 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006010 tx=0x7fe1a4009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e96a45175a167f35 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.213+0000 7fe196600640 1 -- 172.21.15.164:0/4166984766 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a401e3a0 con 0x555c35ad8a90 2024-03-27T08:35:20.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.213+0000 7fe196600640 1 -- 172.21.15.164:0/4166984766 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe1a4010650 con 0x555c35ad8a90 2024-03-27T08:35:20.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.213+0000 7fe196600640 1 -- 172.21.15.164:0/4166984766 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a401e8e0 con 0x555c35ad8a90 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.213+0000 7fe1b39e6740 1 -- 172.21.15.164:0/4166984766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 msgr2=0x555c35ad0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.213+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4006010 tx=0x7fe1a4009610 comp rx=0 tx=0).stop 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 -- 172.21.15.164:0/4166984766 shutdown_connections 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ad0cc0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad80d0 0x555c35ae89e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/4166984766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad6f00 0x555c35ad5c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 -- 172.21.15.164:0/4166984766 >> 172.21.15.164:0/4166984766 conn(0x555c35ad22f0 msgr2=0x555c35ad5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 -- 172.21.15.164:0/4166984766 shutdown_connections 2024-03-27T08:35:20.206 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 -- 172.21.15.164:0/4166984766 wait complete. 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.214+0000 7fe1b39e6740 1 -- start start 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 Processor -- start 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad6f00 0x555c35ae4c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 0x555c35ae5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1adb60 con 0x555c35ad8a90 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1aefd0 con 0x555c35ad6f00 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe1ac1ae230 con 0x555c35ad80d0 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.215+0000 7fe1b39e6740 10 client.0 _ll_register_callbacks cb 0x7fe1a4010960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:20.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1a9400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 0x555c35ae5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49450/0 (socket says 172.21.15.164:49450) 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 -- 172.21.15.164:0/3544169572 learned_addr learned my addr 172.21.15.164:0/3544169572 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad6f00 0x555c35ae4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 -- 172.21.15.164:0/3544169572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 msgr2=0x555c35ae5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 0x555c35ae5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 -- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad6f00 msgr2=0x555c35ae4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad6f00 0x555c35ae4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1aa800640 1 -- 172.21.15.164:0/3544169572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555c35ad6d30 con 0x555c35ad8a90 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.216+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 0x555c35ae5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe1aa800640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009270 tx=0x7fe1a4009ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f3fc83d0c15510 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe18b400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1a401f3f0 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe1a4010650 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe1a401f590 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fe1a4003970 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe1b39e6740 10 client.15417 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.217+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x555c35b53850 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe1a4010650 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fe1a4045020 con 0x555c35ad8a90 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 10 client.15417 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 10 client.15417 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 20 client.15417 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35b54170 0x555c35b56590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 4 client.15417 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.218+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555c35a43b10 con 0x555c35b54170 2024-03-27T08:35:20.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.219+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35b54170 0x555c35b56590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.221+0000 7fe1a9400640 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35b54170 0x555c35b56590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=621cf94caff3e27f server_cookie=9b89f2b98d178135 in_seq=0 out_seq=0 2024-03-27T08:35:20.213 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.221+0000 7fe18b400640 10 client.15417 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.223+0000 7fe18b400640 1 -- 172.21.15.164:0/3544169572 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555c35a43b10 con 0x555c35b54170 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.223+0000 7fe18b400640 10 client.15417 handle_command_reply: tid=0 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.223+0000 7fe1b39e6740 1 client.15417 shutdown 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 msgr2=0x555c35ae7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fe1a4009270 tx=0x7fe1a4009ad0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 shutdown_connections 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555c35b54170 0x555c35b56590 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555c35ad8a90 0x555c35ae7c50 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe18b400640 0 client.15417 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555c35ad80d0 0x555c35ae5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 --2- 172.21.15.164:0/3544169572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555c35ad6f00 0x555c35ae4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 >> 172.21.15.164:0/3544169572 conn(0x555c35ad22f0 msgr2=0x555c35ad5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 shutdown_connections 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 1 -- 172.21.15.164:0/3544169572 wait complete. 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.224+0000 7fe1b39e6740 20 client.15417 trim_cache size 0 max 16384 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stdout: "return_code": 0, 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_tag": "c8f9fe4f-a534-4601-a242-31f7749c9929", 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": "asynchronous" 2024-03-27T08:35:20.217 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 msgr2=0x7fe1900a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 0x7fe1900a5ad0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe19c0be040 tx=0x7fe19c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 msgr2=0x7fe1ac19e480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe19c000c00 tx=0x7fe19c005e40 comp rx=0 tx=0).stop 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 shutdown_connections 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe1900a3610 0x7fe1900a5ad0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe1ac0780f0 0x7fe1ac1a5a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe1ac077750 0x7fe1ac19e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 --2- 172.21.15.164:0/4141885411 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe1ac076510 0x7fe1ac19e480 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 >> 172.21.15.164:0/4141885411 conn(0x7fe1ac0ff300 msgr2=0x7fe1ac100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 shutdown_connections 2024-03-27T08:35:20.219 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.225+0000 7fe1b0c00640 1 -- 172.21.15.164:0/4141885411 wait complete. 2024-03-27T08:35:20.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:35:20.243 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 -- 172.21.15.164:0/2948674251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd8100930 msgr2=0x7f3bd8100d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2948674251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd8100930 0x7f3bd8100d50 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009900 tx=0x7f3bc802bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 -- 172.21.15.164:0/2948674251 shutdown_connections 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2948674251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd81024e0 0x7f3bd8108d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2948674251 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd8101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2948674251 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd8100930 0x7f3bd8100d50 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 -- 172.21.15.164:0/2948674251 >> 172.21.15.164:0/2948674251 conn(0x7f3bd80fbec0 msgr2=0x7f3bd80fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 -- 172.21.15.164:0/2948674251 shutdown_connections 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.480+0000 7f3bd7200640 1 -- 172.21.15.164:0/2948674251 wait complete. 2024-03-27T08:35:20.476 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 Processor -- start 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 -- start start 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 0x7f3bd8197d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd81982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd810c5e0 con 0x7f3bd81024e0 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd810c460 con 0x7f3bd8100930 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd7200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd810c760 con 0x7f3bd8101b20 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49456/0 (socket says 172.21.15.164:49456) 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd6800640 1 -- 172.21.15.164:0/2594669877 learned_addr learned my addr 172.21.15.164:0/2594669877 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.482+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 0x7f3bd8197d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5400640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd81982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.477 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 -- 172.21.15.164:0/2594669877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 msgr2=0x7f3bd81982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd81982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 -- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 msgr2=0x7f3bd819f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 -- 172.21.15.164:0/2594669877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd819f990 con 0x7f3bd8100930 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5400640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.483+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 0x7f3bd8197d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009230 tx=0x7f3bc8005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.484+0000 7f3bcea00640 1 -- 172.21.15.164:0/2594669877 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8043020 con 0x7f3bd8100930 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.484+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd819fc20 con 0x7f3bd8100930 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.484+0000 7f3bcea00640 1 -- 172.21.15.164:0/2594669877 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bc80054b0 con 0x7f3bd8100930 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.484+0000 7f3bcea00640 1 -- 172.21.15.164:0/2594669877 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc8003ae0 con 0x7f3bd8100930 2024-03-27T08:35:20.478 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.484+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd81a0190 con 0x7f3bd8100930 2024-03-27T08:35:20.479 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.487+0000 7f3bdfbaa740 1 Processor -- start 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 -- start start 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bcea00640 1 -- 172.21.15.164:0/2594669877 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3bc8046020 con 0x7f3bd8100930 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea08b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea0b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a92e9696b0 con 0x55a92ea04060 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a92e911750 con 0x55a92ea03670 2024-03-27T08:35:20.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.488+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a92e965660 con 0x55a92ea091d0 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea0b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd5e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea08b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:44644/0 (socket says 172.21.15.164:44644) 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 -- 172.21.15.164:0/2882583864 learned_addr learned my addr 172.21.15.164:0/2882583864 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 -- 172.21.15.164:0/2882583864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 msgr2=0x55a92ea0b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea0b660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 -- 172.21.15.164:0/2882583864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 msgr2=0x55a92ea08b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea08b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd6800640 1 -- 172.21.15.164:0/2882583864 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92e7477d0 con 0x55a92ea03670 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.489+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea08b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bcea00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 0x7f3bbc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00118b0 tx=0x7f3bd0011d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a24c728208c0a26 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bcea00640 1 -- 172.21.15.164:0/2594669877 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3bc80f1ea0 con 0x7f3bd8100930 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 0x7f3bbc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bc3400640 1 -- 172.21.15.164:0/2882583864 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd001e070 con 0x55a92ea03670 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bc3400640 1 -- 172.21.15.164:0/2882583864 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bd000fe90 con 0x55a92ea03670 2024-03-27T08:35:20.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.490+0000 7f3bc3400640 1 -- 172.21.15.164:0/2882583864 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0019d90 con 0x55a92ea03670 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2882583864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 msgr2=0x55a92ea03a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3bd00118b0 tx=0x7f3bd0011d70 comp rx=0 tx=0).stop 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bd5e00640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 0x7f3bbc0a5ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80efd20 tx=0x7f3bc80f5980 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2882583864 shutdown_connections 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea0b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea08b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2882583864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea03a90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2882583864 >> 172.21.15.164:0/2882583864 conn(0x55a92e9febe0 msgr2=0x55a92e9fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2882583864 shutdown_connections 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2882583864 wait complete. 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.491+0000 7f3bdfbaa740 1 -- start start 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 Processor -- start 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea04060 0x55a92ea12470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55a92ea0c180 con 0x55a92ea091d0 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a92e924a80 con 0x55a92ea03670 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55a92ea0c300 con 0x55a92ea04060 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bdfbaa740 10 client.0 _ll_register_callbacks cb 0x55a92e924470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.492+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49476/0 (socket says 172.21.15.164:49476) 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 -- 172.21.15.164:0/96868426 learned_addr learned my addr 172.21.15.164:0/96868426 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd5400640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea04060 0x55a92ea12470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 -- 172.21.15.164:0/96868426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea04060 msgr2=0x55a92ea12470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea04060 0x55a92ea12470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 -- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 msgr2=0x55a92ea11f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 -- 172.21.15.164:0/96868426 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92e67d3f0 con 0x55a92ea091d0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bd6800640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000fc60 tx=0x7f3bd0000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1743c7ee6918efd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.493+0000 7f3bb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd002d060 con 0x55a92ea091d0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bd000fe90 con 0x55a92ea091d0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3bd0011110 con 0x55a92ea091d0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bd001e040 con 0x55a92ea091d0 2024-03-27T08:35:20.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bdfbaa740 10 client.15429 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a92e63d0f0 con 0x55a92ea091d0 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.494+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bd000fe90 con 0x55a92ea091d0 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3bd0024070 con 0x55a92ea091d0 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 10 client.15429 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 20 client.15429 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea1daa0 0x55a92ea1feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 4 client.15429 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92e976bf0 con 0x55a92ea1daa0 2024-03-27T08:35:20.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.495+0000 7f3bd5400640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea1daa0 0x55a92ea1feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.491 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.496+0000 7f3bd5400640 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea1daa0 0x55a92ea1feb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d41922022bf27c server_cookie=86ec9c42945d88aa in_seq=0 out_seq=0 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.496+0000 7f3bb7e00640 10 client.15429 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bb7e00640 1 -- 172.21.15.164:0/96868426 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55a92e976bf0 con 0x55a92ea1daa0 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bb7e00640 10 client.15429 handle_command_reply: tid=0 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bdfbaa740 1 client.15429 shutdown 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 msgr2=0x55a92ea194b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000fc60 tx=0x7f3bd0000f40 comp rx=0 tx=0).stop 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 shutdown_connections 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.497+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea1daa0 0x55a92ea1feb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea091d0 0x55a92ea194b0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea04060 0x55a92ea12470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/96868426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 >> 172.21.15.164:0/96868426 conn(0x55a92e9febe0 msgr2=0x55a92e9fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bb7e00640 0 client.15429 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 shutdown_connections 2024-03-27T08:35:20.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/96868426 wait complete. 2024-03-27T08:35:20.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.498+0000 7f3bdfbaa740 20 client.15429 trim_cache size 0 max 16384 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 Processor -- start 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 -- start start 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea10e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a9590 con 0x55a92ea04060 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a6e60 con 0x55a92ea03670 2024-03-27T08:35:20.527 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.535+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a4cb0 con 0x55a92ea091d0 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49484/0 (socket says 172.21.15.164:49484) 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 -- 172.21.15.164:0/1561317442 learned_addr learned my addr 172.21.15.164:0/1561317442 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd6800640 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea10e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 -- 172.21.15.164:0/1561317442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 msgr2=0x55a92ea10e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea10e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.529 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 -- 172.21.15.164:0/1561317442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 msgr2=0x55a92ea11f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.536+0000 7f3bd5400640 1 -- 172.21.15.164:0/1561317442 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a92ea048c0 con 0x55a92ea04060 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.537+0000 7f3bd5400640 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8199280 tx=0x7f3bc4014840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5168c70e26270e26 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.537+0000 7f3bc2a00640 1 -- 172.21.15.164:0/1561317442 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc401ec50 con 0x55a92ea04060 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.537+0000 7f3bc2a00640 1 -- 172.21.15.164:0/1561317442 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bc401edf0 con 0x55a92ea04060 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.537+0000 7f3bc2a00640 1 -- 172.21.15.164:0/1561317442 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4004a00 con 0x55a92ea04060 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/1561317442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 msgr2=0x55a92ea193d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.530 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f3bd8199280 tx=0x7f3bc4014840 comp rx=0 tx=0).stop 2024-03-27T08:35:20.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/1561317442 shutdown_connections 2024-03-27T08:35:20.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea10e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea193d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/1561317442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea11f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.533 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/1561317442 >> 172.21.15.164:0/1561317442 conn(0x55a92e9febe0 msgr2=0x55a92ea01e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/1561317442 shutdown_connections 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/1561317442 wait complete. 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 -- start start 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.538+0000 7f3bdfbaa740 1 Processor -- start 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea16e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea18390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a5320 con 0x55a92ea04060 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a6790 con 0x55a92ea03670 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd81a59f0 con 0x55a92ea091d0 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bdfbaa740 10 client.0 _ll_register_callbacks cb 0x7f3bc40095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bd5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:49494/0 (socket says 172.21.15.164:49494) 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bd5400640 1 -- 172.21.15.164:0/2791566522 learned_addr learned my addr 172.21.15.164:0/2791566522 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea16e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.539+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea18390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 -- 172.21.15.164:0/2791566522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 msgr2=0x55a92ea18390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea18390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 -- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 msgr2=0x55a92ea16e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea16e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 -- 172.21.15.164:0/2791566522 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92ea18980 con 0x55a92ea04060 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bd5400640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4021000 tx=0x7f3bc4009db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f926c19eda4df24 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bb7e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4014210 con 0x55a92ea04060 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3bc401e430 con 0x55a92ea04060 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.540+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc401edf0 con 0x55a92ea04060 2024-03-27T08:35:20.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3bc401e630 con 0x55a92ea04060 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 10 client.15435 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55a92ea84060 con 0x55a92ea04060 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bc401edf0 con 0x55a92ea04060 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3bc400f040 con 0x55a92ea04060 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 10 client.15435 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 10 client.15435 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 20 client.15435 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea84a60 0x55a92ea86e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 4 client.15435 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.541+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a92e970f40 con 0x55a92ea84a60 2024-03-27T08:35:20.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea84a60 0x55a92ea86e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bd6800640 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea84a60 0x55a92ea86e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=148c12e01e266b7a server_cookie=7125809165a35add in_seq=0 out_seq=0 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bb7e00640 10 client.15435 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bb7e00640 1 -- 172.21.15.164:0/2791566522 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55a92e970f40 con 0x55a92ea84a60 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bb7e00640 10 client.15435 handle_command_reply: tid=0 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.542+0000 7f3bdfbaa740 1 client.15435 shutdown 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 msgr2=0x55a92ea17380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4021000 tx=0x7f3bc4009db0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 shutdown_connections 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55a92ea84a60 0x55a92ea86e80 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55a92ea091d0 0x55a92ea18390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55a92ea04060 0x55a92ea17380 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 --2- 172.21.15.164:0/2791566522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a92ea03670 0x55a92ea16e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 >> 172.21.15.164:0/2791566522 conn(0x55a92e9febe0 msgr2=0x55a92ea01e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bb7e00640 0 client.15435 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 shutdown_connections 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 1 -- 172.21.15.164:0/2791566522 wait complete. 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.543+0000 7f3bdfbaa740 20 client.15435 trim_cache size 0 max 16384 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": { 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "c8f9fe4f-a534-4601-a242-31f7749c9929": { 2024-03-27T08:35:20.539 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/", 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "tag": "c8f9fe4f-a534-4601-a242-31f7749c9929", 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: "options": "recursive,force" 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:20.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 msgr2=0x7f3bbc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 0x7f3bbc0a5ad0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3bc80efd20 tx=0x7f3bc80f5980 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 msgr2=0x7f3bd8197d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 0x7f3bd8197d70 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8009230 tx=0x7f3bc8005dd0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 shutdown_connections 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3bbc0a3610 0x7f3bbc0a5ad0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3bd81024e0 0x7f3bd819f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3bd8101b20 0x7f3bd81982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 --2- 172.21.15.164:0/2594669877 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bd8100930 0x7f3bd8197d70 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 >> 172.21.15.164:0/2594669877 conn(0x7f3bd80fbec0 msgr2=0x7f3bd80fd9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 shutdown_connections 2024-03-27T08:35:20.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:20.544+0000 7f3bd7200640 1 -- 172.21.15.164:0/2594669877 wait complete. 2024-03-27T08:35:20.553 INFO:tasks.cephfs.filesystem:scrub status for tag:c8f9fe4f-a534-4601-a242-31f7749c9929 - {'path': '/', 'tag': 'c8f9fe4f-a534-4601-a242-31f7749c9929', 'options': 'recursive,force'} 2024-03-27T08:35:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: pgmap v441: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4130481497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: scrub queued for path: / 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:20.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:20 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: pgmap v441: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4130481497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: scrub queued for path: / 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:20.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:20 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: pgmap v441: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.1 KiB/s wr, 6 op/s 2024-03-27T08:35:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4130481497' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: scrub queued for path: / 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:21.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:20 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:21 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:21 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:35:21.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:21 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:21.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:21 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:35:22.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:21 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:22.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:21 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:35:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:22 smithi167 ceph-mon[34903]: pgmap v442: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-27T08:35:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:35:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:35:22.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:22 smithi173 ceph-mon[35397]: pgmap v442: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-27T08:35:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:35:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:35:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:22 smithi164 ceph-mon[31788]: pgmap v442: 97 pgs: 97 active+clean; 646 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1023 B/s wr, 6 op/s 2024-03-27T08:35:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:35:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:35:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:35:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:24 smithi167 ceph-mon[34903]: pgmap v443: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-27T08:35:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:24 smithi173 ceph-mon[35397]: pgmap v443: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-27T08:35:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:24 smithi164 ceph-mon[31788]: pgmap v443: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.3 KiB/s wr, 7 op/s 2024-03-27T08:35:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:26 smithi167 ceph-mon[34903]: pgmap v444: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-27T08:35:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:26 smithi173 ceph-mon[35397]: pgmap v444: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-27T08:35:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:26 smithi164 ceph-mon[31788]: pgmap v444: 97 pgs: 97 active+clean; 652 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 6 op/s 2024-03-27T08:35:28.807 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:28 smithi164 ceph-mon[31788]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:28 smithi167 ceph-mon[34903]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:28 smithi173 ceph-mon[35397]: pgmap v445: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:30.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:30 smithi164 ceph-mon[31788]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:30 smithi167 ceph-mon[34903]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:30 smithi173 ceph-mon[35397]: pgmap v446: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:32 smithi167 ceph-mon[34903]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:32 smithi173 ceph-mon[35397]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:32 smithi164 ceph-mon[31788]: pgmap v447: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 -- 172.21.15.164:0/2296233627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868109a30 msgr2=0x7f786810bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 --2- 172.21.15.164:0/2296233627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868109a30 0x7f786810bec0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f7860009ca0 tx=0x7f786002c180 comp rx=0 tx=0).stop 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 -- 172.21.15.164:0/2296233627 shutdown_connections 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 --2- 172.21.15.164:0/2296233627 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868109a30 0x7f786810bec0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 --2- 172.21.15.164:0/2296233627 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868074530 0x7f7868074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 --2- 172.21.15.164:0/2296233627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868075b10 0x7f7868073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 -- 172.21.15.164:0/2296233627 >> 172.21.15.164:0/2296233627 conn(0x7f78680fd110 msgr2=0x7f78680ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.191 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 -- 172.21.15.164:0/2296233627 shutdown_connections 2024-03-27T08:35:33.192 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.199+0000 7f7870000640 1 -- 172.21.15.164:0/2296233627 wait complete. 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.200+0000 7f7870000640 1 Processor -- start 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.200+0000 7f7870000640 1 -- start start 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 0x7f7868199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 0x7f78681a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f786810f9f0 con 0x7f7868075b10 2024-03-27T08:35:33.194 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f786810f870 con 0x7f7868074530 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f7870000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f786810fb70 con 0x7f7868109a30 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52186/0 (socket says 172.21.15.164:52186) 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 -- 172.21.15.164:0/66084123 learned_addr learned my addr 172.21.15.164:0/66084123 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786d600640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 0x7f7868199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786e000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 0x7f78681a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 -- 172.21.15.164:0/66084123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 msgr2=0x7f78681a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 0x7f78681a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 -- 172.21.15.164:0/66084123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 msgr2=0x7f7868199f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.201+0000 7f786cc00640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 0x7f7868199f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f786cc00640 1 -- 172.21.15.164:0/66084123 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78681a1b60 con 0x7f7868075b10 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f786d600640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 0x7f7868199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:33.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f786e000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 0x7f78681a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f786cc00640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f785400e9f0 tx=0x7f785400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f7866000640 1 -- 172.21.15.164:0/66084123 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785400cd80 con 0x7f7868075b10 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f7866000640 1 -- 172.21.15.164:0/66084123 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f78540054f0 con 0x7f7868075b10 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78681a1e50 con 0x7f7868075b10 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f7866000640 1 -- 172.21.15.164:0/66084123 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7854010690 con 0x7f7868075b10 2024-03-27T08:35:33.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.202+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78681a22c0 con 0x7f7868075b10 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.205+0000 7f7872dc7740 1 Processor -- start 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.205+0000 7f7866000640 1 -- 172.21.15.164:0/66084123 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7854004f20 con 0x7f7868075b10 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 -- start start 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac21bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac220e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac180d10 con 0x55b8ac2214e0 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac129260 con 0x55b8ac21b980 2024-03-27T08:35:33.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f7872dc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac17ccc0 con 0x55b8ac21c370 2024-03-27T08:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f786cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f786cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52196/0 (socket says 172.21.15.164:52196) 2024-03-27T08:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f786cc00640 1 -- 172.21.15.164:0/2821479248 learned_addr learned my addr 172.21.15.164:0/2821479248 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f786e000640 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac21bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.206+0000 7f786d600640 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac220e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 -- 172.21.15.164:0/2821479248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 msgr2=0x55b8ac220e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac220e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 -- 172.21.15.164:0/2821479248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 msgr2=0x55b8ac21bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac21bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 -- 172.21.15.164:0/2821479248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8ac120aa0 con 0x55b8ac2214e0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f786cc00640 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f78540d82a0 tx=0x7f78540d8390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b47335d91de71a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f7866000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 0x7f78500a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.207+0000 7f785a600640 1 -- 172.21.15.164:0/2821479248 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540e3070 con 0x55b8ac2214e0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f785a600640 1 -- 172.21.15.164:0/2821479248 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f78540712c0 con 0x55b8ac2214e0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f785a600640 1 -- 172.21.15.164:0/2821479248 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78540d3de0 con 0x55b8ac2214e0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7866000640 1 -- 172.21.15.164:0/66084123 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f78540d02b0 con 0x7f7868075b10 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f786e000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 0x7f78500a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 -- 172.21.15.164:0/2821479248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 msgr2=0x55b8ac223970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f78540d82a0 tx=0x7f78540d8390 comp rx=0 tx=0).stop 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f786e000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 0x7f78500a5b70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7860004af0 tx=0x7f786002e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.201 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 -- 172.21.15.164:0/2821479248 shutdown_connections 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac223970 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac220e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2821479248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac21bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 -- 172.21.15.164:0/2821479248 >> 172.21.15.164:0/2821479248 conn(0x55b8ac216ef0 msgr2=0x55b8ac2172f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.208+0000 7f7872dc7740 1 -- 172.21.15.164:0/2821479248 shutdown_connections 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.209+0000 7f7872dc7740 1 -- 172.21.15.164:0/2821479248 wait complete. 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.209+0000 7f7872dc7740 1 -- start start 2024-03-27T08:35:33.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.209+0000 7f7872dc7740 1 Processor -- start 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac226190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac224490 con 0x55b8ac21b980 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac13c630 con 0x55b8ac21c370 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b8ac224610 con 0x55b8ac2214e0 2024-03-27T08:35:33.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f7872dc7740 10 client.0 _ll_register_callbacks cb 0x55b8ac141c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52202/0 (socket says 172.21.15.164:52202) 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 -- 172.21.15.164:0/1100123806 learned_addr learned my addr 172.21.15.164:0/1100123806 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786cc00640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac226190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786e000640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 -- 172.21.15.164:0/1100123806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 msgr2=0x55b8ac22d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 -- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 msgr2=0x55b8ac226190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac226190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.210+0000 7f786d600640 1 -- 172.21.15.164:0/1100123806 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ac1485f0 con 0x55b8ac21b980 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f786d600640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f785c013790 tx=0x7f785c013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93cbdd5b0b35f073 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f784ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c011d70 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f785c004030 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f78540712c0 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f785c004230 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f7872dc7740 10 client.15447 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.211+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8abe95210 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f78540712c0 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f785c01a070 con 0x55b8ac21b980 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 10 client.15447 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 10 client.15447 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 20 client.15447 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac231b30 0x55b8ac233f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 4 client.15447 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8ac18e250 con 0x55b8ac231b30 2024-03-27T08:35:33.207 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.212+0000 7f786cc00640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac231b30 0x55b8ac233f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.213+0000 7f786cc00640 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac231b30 0x55b8ac233f80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b35ff761f56f053 server_cookie=5a77ea49038e777f in_seq=0 out_seq=0 2024-03-27T08:35:33.208 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.213+0000 7f784ea00640 10 client.15447 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.214+0000 7f784ea00640 1 -- 172.21.15.164:0/1100123806 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b8ac18e250 con 0x55b8ac231b30 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.214+0000 7f784ea00640 10 client.15447 handle_command_reply: tid=0 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.214+0000 7f7872dc7740 1 client.15447 shutdown 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.214+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 msgr2=0x55b8ac225c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.214+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f785c013790 tx=0x7f785c013c50 comp rx=0 tx=0).stop 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 shutdown_connections 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac231b30 0x55b8ac233f80 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac226190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 --2- 172.21.15.164:0/1100123806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac225c50 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f784ea00640 0 client.15447 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 >> 172.21.15.164:0/1100123806 conn(0x55b8ac216ef0 msgr2=0x55b8ac2160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 shutdown_connections 2024-03-27T08:35:33.209 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 1 -- 172.21.15.164:0/1100123806 wait complete. 2024-03-27T08:35:33.210 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.215+0000 7f7872dc7740 20 client.15447 trim_cache size 0 max 16384 2024-03-27T08:35:33.222 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 Processor -- start 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 -- start start 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac225f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac22d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f78681ada70 con 0x55b8ac2214e0 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f78681ab340 con 0x55b8ac21b980 2024-03-27T08:35:33.223 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f7872dc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f78681a9190 con 0x55b8ac21c370 2024-03-27T08:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f786e000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.231+0000 7f786e000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52218/0 (socket says 172.21.15.164:52218) 2024-03-27T08:35:33.224 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 -- 172.21.15.164:0/2954605894 learned_addr learned my addr 172.21.15.164:0/2954605894 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786d600640 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac225f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786cc00640 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac22d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 -- 172.21.15.164:0/2954605894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 msgr2=0x55b8ac22d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac22d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 -- 172.21.15.164:0/2954605894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 msgr2=0x55b8ac225f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac225f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 -- 172.21.15.164:0/2954605894 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8abf61620 con 0x55b8ac2214e0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.232+0000 7f786e000640 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7860005e30 tx=0x7f786003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1a3174eae15a1c6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7859c00640 1 -- 172.21.15.164:0/2954605894 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860045070 con 0x55b8ac2214e0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7859c00640 1 -- 172.21.15.164:0/2954605894 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7860051070 con 0x55b8ac2214e0 2024-03-27T08:35:33.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7859c00640 1 -- 172.21.15.164:0/2954605894 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7860039040 con 0x55b8ac2214e0 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 -- 172.21.15.164:0/2954605894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 msgr2=0x55b8ac215f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7860005e30 tx=0x7f786003f000 comp rx=0 tx=0).stop 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 -- 172.21.15.164:0/2954605894 shutdown_connections 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac2214e0 0x55b8ac215f70 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac21c370 0x55b8ac22d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 --2- 172.21.15.164:0/2954605894 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21b980 0x55b8ac225f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 -- 172.21.15.164:0/2954605894 >> 172.21.15.164:0/2954605894 conn(0x55b8ac216ef0 msgr2=0x55b8ac215860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 -- 172.21.15.164:0/2954605894 shutdown_connections 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.233+0000 7f7872dc7740 1 -- 172.21.15.164:0/2954605894 wait complete. 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 -- start start 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 Processor -- start 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac22d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f78681a9800 con 0x55b8ac21b980 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f78681aac70 con 0x55b8ac21c370 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f78681a9ed0 con 0x55b8ac2214e0 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.234+0000 7f7872dc7740 10 client.0 _ll_register_callbacks cb 0x7f785c009690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:52234/0 (socket says 172.21.15.164:52234) 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 -- 172.21.15.164:0/3699165173 learned_addr learned my addr 172.21.15.164:0/3699165173 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786cc00640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac22d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786e000640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 -- 172.21.15.164:0/3699165173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 msgr2=0x55b8ac22b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22b250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 -- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 msgr2=0x55b8ac22d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac22d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 -- 172.21.15.164:0/3699165173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8ac22ba80 con 0x55b8ac21b980 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f786d600640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x55b8ac217d20 tx=0x7f785c0095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1c8ae0f7517b711 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.235+0000 7f784ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c034060 con 0x55b8ac21b980 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f785c00f870 con 0x55b8ac21b980 2024-03-27T08:35:33.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7860051070 con 0x55b8ac21b980 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f785c00fab0 con 0x55b8ac21b980 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f7872dc7740 10 client.15453 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b8ac298ac0 con 0x55b8ac21b980 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7860051070 con 0x55b8ac21b980 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.236+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f785c01a040 con 0x55b8ac21b980 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 10 client.15453 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 10 client.15453 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 20 client.15453 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac2994d0 0x55b8ac29b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 4 client.15453 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b8ac1885a0 con 0x55b8ac2994d0 2024-03-27T08:35:33.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.237+0000 7f786cc00640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac2994d0 0x55b8ac29b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.238+0000 7f786cc00640 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac2994d0 0x55b8ac29b8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c008c0c7fd3125a2 server_cookie=e108bee0063785b7 in_seq=0 out_seq=0 2024-03-27T08:35:33.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.238+0000 7f784ea00640 10 client.15453 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f784ea00640 1 -- 172.21.15.164:0/3699165173 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b8ac1885a0 con 0x55b8ac2994d0 2024-03-27T08:35:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f784ea00640 10 client.15453 handle_command_reply: tid=0 2024-03-27T08:35:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 client.15453 shutdown 2024-03-27T08:35:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 msgr2=0x55b8ac22cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x55b8ac217d20 tx=0x7f785c0095a0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 shutdown_connections 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b8ac2994d0 0x55b8ac29b8f0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b8ac2214e0 0x55b8ac22b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b8ac21c370 0x55b8ac22d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 --2- 172.21.15.164:0/3699165173 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b8ac21b980 0x55b8ac22cbe0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f784ea00640 0 client.15453 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.264+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 >> 172.21.15.164:0/3699165173 conn(0x55b8ac216ef0 msgr2=0x55b8ac2160f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.265+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 shutdown_connections 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.265+0000 7f7872dc7740 1 -- 172.21.15.164:0/3699165173 wait complete. 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.265+0000 7f7872dc7740 20 client.15453 trim_cache size 0 max 16384 2024-03-27T08:35:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:35:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:35:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:35:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:35:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 msgr2=0x7f78500a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 0x7f78500a5b70 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f7860004af0 tx=0x7f786002e040 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 msgr2=0x7f786819a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f785400e9f0 tx=0x7f785400edf0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 shutdown_connections 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f78500a36b0 0x7f78500a5b70 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7868109a30 0x7f78681a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7868075b10 0x7f786819a480 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 --2- 172.21.15.164:0/66084123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7868074530 0x7f7868199f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 >> 172.21.15.164:0/66084123 conn(0x7f78680fd110 msgr2=0x7f78681059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 shutdown_connections 2024-03-27T08:35:33.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:33.266+0000 7f7870000640 1 -- 172.21.15.164:0/66084123 wait complete. 2024-03-27T08:35:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:34 smithi167 ceph-mon[34903]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:34 smithi173 ceph-mon[35397]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:34 smithi164 ceph-mon[31788]: pgmap v448: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-03-27T08:35:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:36 smithi167 ceph-mon[34903]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T08:35:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:36 smithi173 ceph-mon[35397]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T08:35:37.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:36 smithi164 ceph-mon[31788]: pgmap v449: 97 pgs: 97 active+clean; 657 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.2 KiB/s wr, 8 op/s 2024-03-27T08:35:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:38 smithi173 ceph-mon[35397]: pgmap v450: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-03-27T08:35:39.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:38 smithi164 ceph-mon[31788]: pgmap v450: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-03-27T08:35:39.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:38 smithi167 ceph-mon[34903]: pgmap v450: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.9 KiB/s wr, 10 op/s 2024-03-27T08:35:40.859 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:40 smithi164 ceph-mon[31788]: pgmap v451: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-27T08:35:41.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:40 smithi167 ceph-mon[34903]: pgmap v451: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-27T08:35:41.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:40 smithi173 ceph-mon[35397]: pgmap v451: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-03-27T08:35:43.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:42 smithi164 ceph-mon[31788]: pgmap v452: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:43.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:42 smithi167 ceph-mon[34903]: pgmap v452: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:43.087 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:42 smithi173 ceph-mon[35397]: pgmap v452: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:44 smithi164 ceph-mon[31788]: pgmap v453: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:45.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:44 smithi167 ceph-mon[34903]: pgmap v453: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:45.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:44 smithi173 ceph-mon[35397]: pgmap v453: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 -- 172.21.15.164:0/1312326759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4280780f0 msgr2=0x7fb428078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 --2- 172.21.15.164:0/1312326759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4280780f0 0x7fb428078990 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fb420009ca0 tx=0x7fb42002c100 comp rx=0 tx=0).stop 2024-03-27T08:35:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 -- 172.21.15.164:0/1312326759 shutdown_connections 2024-03-27T08:35:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 --2- 172.21.15.164:0/1312326759 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4280780f0 0x7fb428078990 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.403 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 --2- 172.21.15.164:0/1312326759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428077750 0x7fb428077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 --2- 172.21.15.164:0/1312326759 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb428076510 0x7fb428076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 -- 172.21.15.164:0/1312326759 >> 172.21.15.164:0/1312326759 conn(0x7fb4280ff310 msgr2=0x7fb428101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 -- 172.21.15.164:0/1312326759 shutdown_connections 2024-03-27T08:35:46.404 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.410+0000 7fb42d600640 1 -- 172.21.15.164:0/1312326759 wait complete. 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.411+0000 7fb42d600640 1 Processor -- start 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.411+0000 7fb42d600640 1 -- start start 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 0x7fb42819e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4280780f0 0x7fb4281a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb428113e00 con 0x7fb428077750 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb428113c80 con 0x7fb428076510 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb42d600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb428113f80 con 0x7fb4280780f0 2024-03-27T08:35:46.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41488/0 (socket says 172.21.15.164:41488) 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 -- 172.21.15.164:0/4253916459 learned_addr learned my addr 172.21.15.164:0/4253916459 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426a00640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 0x7fb42819e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 -- 172.21.15.164:0/4253916459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4280780f0 msgr2=0x7fb4281a58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb427400640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4280780f0 0x7fb4281a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4280780f0 0x7fb4281a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 -- 172.21.15.164:0/4253916459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 msgr2=0x7fb42819e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 0x7fb42819e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426000640 1 -- 172.21.15.164:0/4253916459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4281a5f20 con 0x7fb428077750 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.412+0000 7fb426a00640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 0x7fb42819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb426000640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d950 tx=0x7fb41400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb41f400640 1 -- 172.21.15.164:0/4253916459 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb414017030 con 0x7fb428077750 2024-03-27T08:35:46.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb41f400640 1 -- 172.21.15.164:0/4253916459 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb414004020 con 0x7fb428077750 2024-03-27T08:35:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4281a6210 con 0x7fb428077750 2024-03-27T08:35:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb41f400640 1 -- 172.21.15.164:0/4253916459 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4140047a0 con 0x7fb428077750 2024-03-27T08:35:46.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.413+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4281a67b0 con 0x7fb428077750 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.416+0000 7fb43040d740 1 Processor -- start 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 -- start start 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d28da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb41f400640 1 -- 172.21.15.164:0/4253916459 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb4140041d0 con 0x7fb428077750 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d2e4e0 0x55c781d30970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c781c8dd10 con 0x55c781d29370 2024-03-27T08:35:46.410 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c781c36260 con 0x55c781d2e4e0 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb43040d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c781c89cc0 con 0x55c781d28980 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb426a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb426a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41496/0 (socket says 172.21.15.164:41496) 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb426a00640 1 -- 172.21.15.164:0/1224848420 learned_addr learned my addr 172.21.15.164:0/1224848420 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb426000640 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d2e4e0 0x55c781d30970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.411 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.417+0000 7fb427400640 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d28da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 -- 172.21.15.164:0/1224848420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 msgr2=0x55c781d28da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d28da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 -- 172.21.15.164:0/1224848420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d2e4e0 msgr2=0x55c781d30970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d2e4e0 0x55c781d30970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 -- 172.21.15.164:0/1224848420 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c781c2daa0 con 0x55c781d29370 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb426a00640 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb41800bc20 tx=0x7fb41800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=291d0c1d3f9904da server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb413400640 1 -- 172.21.15.164:0/1224848420 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb418017620 con 0x55c781d29370 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb41f400640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 0x7fb40c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb413400640 1 -- 172.21.15.164:0/1224848420 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb418017c90 con 0x55c781d29370 2024-03-27T08:35:46.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.418+0000 7fb413400640 1 -- 172.21.15.164:0/1224848420 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41800fc50 con 0x55c781d29370 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb41f400640 1 -- 172.21.15.164:0/4253916459 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb4140cf760 con 0x7fb428077750 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb427400640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 0x7fb40c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 -- 172.21.15.164:0/1224848420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 msgr2=0x55c781d2de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fb41800bc20 tx=0x7fb41800d710 comp rx=0 tx=0).stop 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 -- 172.21.15.164:0/1224848420 shutdown_connections 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d2e4e0 0x55c781d30970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d29370 0x55c781d2de70 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 --2- 172.21.15.164:0/1224848420 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d28da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 -- 172.21.15.164:0/1224848420 >> 172.21.15.164:0/1224848420 conn(0x55c781d23ef0 msgr2=0x55c781d242f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.419+0000 7fb43040d740 1 -- 172.21.15.164:0/1224848420 shutdown_connections 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.420+0000 7fb427400640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 0x7fb40c0a5bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb42002c710 tx=0x7fb4200325a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.420+0000 7fb43040d740 1 -- 172.21.15.164:0/1224848420 wait complete. 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.420+0000 7fb43040d740 1 -- start start 2024-03-27T08:35:46.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.420+0000 7fb43040d740 1 Processor -- start 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d32d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d33290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55c781d31490 con 0x55c781d2e4e0 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c781c49630 con 0x55c781d28980 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55c781d31610 con 0x55c781d29370 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb43040d740 10 client.0 _ll_register_callbacks cb 0x55c781c4ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41510/0 (socket says 172.21.15.164:41510) 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 -- 172.21.15.164:0/2745712597 learned_addr learned my addr 172.21.15.164:0/2745712597 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb426a00640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d32d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb426000640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d33290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 -- 172.21.15.164:0/2745712597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 msgr2=0x55c781d33290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d33290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 -- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 msgr2=0x55c781d32d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d32d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.421+0000 7fb427400640 1 -- 172.21.15.164:0/2745712597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c781c555f0 con 0x55c781d2e4e0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb427400640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb420009a60 tx=0x7fb4200095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7596892405f01b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb407e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420044070 con 0x55c781d2e4e0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb420004180 con 0x55c781d2e4e0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb418017c90 con 0x55c781d2e4e0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb420039040 con 0x55c781d2e4e0 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb43040d740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:46.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.422+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c7819a2210 con 0x55c781d2e4e0 2024-03-27T08:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb418017c90 con 0x55c781d2e4e0 2024-03-27T08:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb42004bc40 con 0x55c781d2e4e0 2024-03-27T08:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:46.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 10 client.15465 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 20 client.15465 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781d3ec00 0x55c781d41050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 4 client.15465 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.423+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c781c9b250 con 0x55c781d3ec00 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.424+0000 7fb426a00640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781d3ec00 0x55c781d41050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.425+0000 7fb426a00640 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781d3ec00 0x55c781d41050 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6646358d7db4948e server_cookie=90c3fc14a2a7bb76 in_seq=0 out_seq=0 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.425+0000 7fb407e00640 10 client.15465 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.426+0000 7fb407e00640 1 -- 172.21.15.164:0/2745712597 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55c781c9b250 con 0x55c781d3ec00 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.426+0000 7fb407e00640 10 client.15465 handle_command_reply: tid=0 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 client.15465 shutdown 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 msgr2=0x55c781d3a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb420009a60 tx=0x7fb4200095c0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 shutdown_connections 2024-03-27T08:35:46.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781d3ec00 0x55c781d41050 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a260 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d33290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 --2- 172.21.15.164:0/2745712597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d32d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb407e00640 0 client.15465 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 >> 172.21.15.164:0/2745712597 conn(0x55c781d23ef0 msgr2=0x55c781d230f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 shutdown_connections 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 1 -- 172.21.15.164:0/2745712597 wait complete. 2024-03-27T08:35:46.422 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.427+0000 7fb43040d740 20 client.15465 trim_cache size 0 max 16384 2024-03-27T08:35:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 Processor -- start 2024-03-27T08:35:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 -- start start 2024-03-27T08:35:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d2a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.437 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d2ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281b1d30 con 0x55c781d2e4e0 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281af600 con 0x55c781d28980 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.443+0000 7fb43040d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281ad450 con 0x55c781d29370 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41518/0 (socket says 172.21.15.164:41518) 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 -- 172.21.15.164:0/367312263 learned_addr learned my addr 172.21.15.164:0/367312263 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb426a00640 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d2a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb426000640 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d2ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 -- 172.21.15.164:0/367312263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 msgr2=0x55c781d2ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d2ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.438 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 -- 172.21.15.164:0/367312263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 msgr2=0x55c781d2a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d2a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 -- 172.21.15.164:0/367312263 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c781a6e620 con 0x55c781d2e4e0 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.444+0000 7fb427400640 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb42002c640 tx=0x7fb42002c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaa3f492398f2b05 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.445+0000 7fb412a00640 1 -- 172.21.15.164:0/367312263 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420044040 con 0x55c781d2e4e0 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.445+0000 7fb412a00640 1 -- 172.21.15.164:0/367312263 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb420050070 con 0x55c781d2e4e0 2024-03-27T08:35:46.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.445+0000 7fb412a00640 1 -- 172.21.15.164:0/367312263 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420004590 con 0x55c781d2e4e0 2024-03-27T08:35:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.445+0000 7fb43040d740 1 -- 172.21.15.164:0/367312263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 msgr2=0x55c781d3a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.445+0000 7fb43040d740 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fb42002c640 tx=0x7fb42002c8a0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 -- 172.21.15.164:0/367312263 shutdown_connections 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d3a220 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d29370 0x55c781d2ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 --2- 172.21.15.164:0/367312263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d28980 0x55c781d2a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 -- 172.21.15.164:0/367312263 >> 172.21.15.164:0/367312263 conn(0x55c781d23ef0 msgr2=0x55c781d242d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 -- 172.21.15.164:0/367312263 shutdown_connections 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 -- 172.21.15.164:0/367312263 wait complete. 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 -- start start 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.446+0000 7fb43040d740 1 Processor -- start 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d37880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d29370 0x55c781d37dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281adac0 con 0x55c781d2e4e0 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281aef30 con 0x55c781d29370 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4281ae190 con 0x55c781d28980 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb43040d740 10 client.0 _ll_register_callbacks cb 0x7fb420037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41532/0 (socket says 172.21.15.164:41532) 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 -- 172.21.15.164:0/2784577300 learned_addr learned my addr 172.21.15.164:0/2784577300 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb426000640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d29370 0x55c781d37dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb426a00640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d37880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 -- 172.21.15.164:0/2784577300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 msgr2=0x55c781d37880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d37880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 -- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d29370 msgr2=0x55c781d37dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:46.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d29370 0x55c781d37dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.447+0000 7fb427400640 1 -- 172.21.15.164:0/2784577300 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c781d39370 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb427400640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb420006010 tx=0x7fb420032ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4d879358cd72bd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb407e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb420066020 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb420034990 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb420050070 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb420044050 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb43040d740 10 client.15471 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c781d3a680 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.448+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb420050070 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fb420057480 con 0x55c781d2e4e0 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 10 client.15471 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 10 client.15471 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:46.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 20 client.15471 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781da5570 0x55c781da7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 4 client.15471 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c781c955a0 con 0x55c781da5570 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.449+0000 7fb426a00640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781da5570 0x55c781da7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.450+0000 7fb426a00640 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781da5570 0x55c781da7990 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34b791b7aca1beea server_cookie=8a7384aaa249f258 in_seq=0 out_seq=0 2024-03-27T08:35:46.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.450+0000 7fb407e00640 10 client.15471 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb407e00640 1 -- 172.21.15.164:0/2784577300 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c781c955a0 con 0x55c781da5570 2024-03-27T08:35:46.452 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb407e00640 10 client.15471 handle_command_reply: tid=0 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 client.15471 shutdown 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 msgr2=0x55c781d38d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb420006010 tx=0x7fb420032ca0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 shutdown_connections 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55c781da5570 0x55c781da7990 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55c781d2e4e0 0x55c781d38d80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c781d29370 0x55c781d37dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 --2- 172.21.15.164:0/2784577300 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55c781d28980 0x55c781d37880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb407e00640 0 client.15471 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.459+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 >> 172.21.15.164:0/2784577300 conn(0x55c781d23ef0 msgr2=0x55c781d32d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 shutdown_connections 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb43040d740 1 -- 172.21.15.164:0/2784577300 wait complete. 2024-03-27T08:35:46.453 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb43040d740 20 client.15471 trim_cache size 0 max 16384 2024-03-27T08:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:35:46.454 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 msgr2=0x7fb40c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 0x7fb40c0a5bf0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fb42002c710 tx=0x7fb4200325a0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 msgr2=0x7fb42819e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.460+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fb41400d950 tx=0x7fb41400de10 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 shutdown_connections 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb40c0a3730 0x7fb40c0a5bf0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4280780f0 0x7fb4281a58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb428077750 0x7fb42819e840 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 --2- 172.21.15.164:0/4253916459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb428076510 0x7fb42819e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:46.455 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 >> 172.21.15.164:0/4253916459 conn(0x7fb4280ff310 msgr2=0x7fb428100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 shutdown_connections 2024-03-27T08:35:46.456 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:46.461+0000 7fb42d600640 1 -- 172.21.15.164:0/4253916459 wait complete. 2024-03-27T08:35:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:46 smithi164 ceph-mon[31788]: pgmap v454: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:47.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:46 smithi167 ceph-mon[34903]: pgmap v454: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:47.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:46 smithi173 ceph-mon[35397]: pgmap v454: 97 pgs: 97 active+clean; 658 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 1.4 KiB/s wr, 10 op/s 2024-03-27T08:35:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:48 smithi164 ceph-mon[31788]: pgmap v455: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-03-27T08:35:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:48 smithi167 ceph-mon[34903]: pgmap v455: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-03-27T08:35:49.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:48 smithi173 ceph-mon[35397]: pgmap v455: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.1 KiB/s wr, 9 op/s 2024-03-27T08:35:50.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:49 smithi164 ceph-mon[31788]: pgmap v456: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:35:50.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:49 smithi167 ceph-mon[34903]: pgmap v456: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:35:50.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:49 smithi173 ceph-mon[35397]: pgmap v456: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 341 B/s wr, 6 op/s 2024-03-27T08:35:50.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:35:50.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 -- 172.21.15.164:0/888993913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109d20 msgr2=0x7f41341105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 --2- 172.21.15.164:0/888993913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109d20 0x7f41341105b0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f412c009900 tx=0x7f412c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 -- 172.21.15.164:0/888993913 shutdown_connections 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 --2- 172.21.15.164:0/888993913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109d20 0x7f41341105b0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 --2- 172.21.15.164:0/888993913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134109360 0x7f41341097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 --2- 172.21.15.164:0/888993913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134108170 0x7f4134108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 -- 172.21.15.164:0/888993913 >> 172.21.15.164:0/888993913 conn(0x7f4134077110 msgr2=0x7f4134079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 -- 172.21.15.164:0/888993913 shutdown_connections 2024-03-27T08:35:50.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.784+0000 7f413ae00640 1 -- 172.21.15.164:0/888993913 wait complete. 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.785+0000 7f413ae00640 1 Processor -- start 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.785+0000 7f413ae00640 1 -- start start 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.785+0000 7f413ae00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134108170 0x7f413419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.785+0000 7f413ae00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.785+0000 7f413ae00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134109d20 0x7f41341a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f413ae00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113e20 con 0x7f4134109360 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f413ae00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113ca0 con 0x7f4134108170 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f413ae00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4134113fa0 con 0x7f4134109d20 2024-03-27T08:35:50.780 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41560/0 (socket says 172.21.15.164:41560) 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 -- 172.21.15.164:0/513074980 learned_addr learned my addr 172.21.15.164:0/513074980 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133e00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134108170 0x7f413419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4138e00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134109d20 0x7f41341a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 -- 172.21.15.164:0/513074980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134109d20 msgr2=0x7f41341a59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134109d20 0x7f41341a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 -- 172.21.15.164:0/513074980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134108170 msgr2=0x7f413419e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134108170 0x7f413419e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 -- 172.21.15.164:0/513074980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41341a6050 con 0x7f4134109360 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.786+0000 7f4133400640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f412000e9f0 tx=0x7f412000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.787+0000 7f4130c00640 1 -- 172.21.15.164:0/513074980 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412000cd80 con 0x7f4134109360 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.787+0000 7f4130c00640 1 -- 172.21.15.164:0/513074980 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4120010900 con 0x7f4134109360 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.787+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41341a6340 con 0x7f4134109360 2024-03-27T08:35:50.781 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.787+0000 7f4130c00640 1 -- 172.21.15.164:0/513074980 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41200189e0 con 0x7f4134109360 2024-03-27T08:35:50.782 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.787+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41341a68e0 con 0x7f4134109360 2024-03-27T08:35:50.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.790+0000 7f413dbce740 1 Processor -- start 2024-03-27T08:35:50.783 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.790+0000 7f413dbce740 1 -- start start 2024-03-27T08:35:50.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.790+0000 7f413dbce740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.784 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.790+0000 7f413dbce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27eea0 0x5603ac2839a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f413dbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2864a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f413dbce740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5603ac1e46b0 con 0x5603ac27e4b0 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f413dbce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5603ac18c750 con 0x5603ac27eea0 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f413dbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603ac1e0660 con 0x5603ac284010 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41570/0 (socket says 172.21.15.164:41570) 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 -- 172.21.15.164:0/1965916440 learned_addr learned my addr 172.21.15.164:0/1965916440 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4130c00640 1 -- 172.21.15.164:0/513074980 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4120010ab0 con 0x7f4134109360 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4133e00640 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27eea0 0x5603ac2839a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 -- 172.21.15.164:0/1965916440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 msgr2=0x5603ac2864a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2864a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 -- 172.21.15.164:0/1965916440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27eea0 msgr2=0x5603ac2839a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27eea0 0x5603ac2839a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.785 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.791+0000 7f4138e00640 1 -- 172.21.15.164:0/1965916440 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603abfc27d0 con 0x5603ac27e4b0 2024-03-27T08:35:50.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.792+0000 7f4138e00640 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f412c006010 tx=0x7f412c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedd628a756e2c81 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.792+0000 7f4129600640 1 -- 172.21.15.164:0/1965916440 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c042070 con 0x5603ac27e4b0 2024-03-27T08:35:50.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.792+0000 7f4129600640 1 -- 172.21.15.164:0/1965916440 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f412c02cb20 con 0x5603ac27e4b0 2024-03-27T08:35:50.786 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.792+0000 7f4129600640 1 -- 172.21.15.164:0/1965916440 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c003e30 con 0x5603ac27e4b0 2024-03-27T08:35:50.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f4130c00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 0x7f41180a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.789 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 -- 172.21.15.164:0/1965916440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 msgr2=0x5603ac27e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f412c006010 tx=0x7f412c0095f0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 -- 172.21.15.164:0/1965916440 shutdown_connections 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2864a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27eea0 0x5603ac2839a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 --2- 172.21.15.164:0/1965916440 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac27e8d0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f4130c00640 1 -- 172.21.15.164:0/513074980 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f41200d00e0 con 0x7f4134109360 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 -- 172.21.15.164:0/1965916440 >> 172.21.15.164:0/1965916440 conn(0x5603ac279a20 msgr2=0x5603ac279e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f4133e00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 0x7f41180a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 -- 172.21.15.164:0/1965916440 shutdown_connections 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.793+0000 7f413dbce740 1 -- 172.21.15.164:0/1965916440 wait complete. 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 -- start start 2024-03-27T08:35:50.790 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f4133e00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 0x7f41180a5b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5603ac27a990 tx=0x7f4124009580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 Processor -- start 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac288ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac284010 0x5603ac28ff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5603ac286f60 con 0x5603ac27e4b0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5603ac19fa80 con 0x5603ac284010 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5603ac2870e0 con 0x5603ac27eea0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.794+0000 7f413dbce740 10 client.0 _ll_register_callbacks cb 0x5603ac19f470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41578/0 (socket says 172.21.15.164:41578) 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 -- 172.21.15.164:0/1167161799 learned_addr learned my addr 172.21.15.164:0/1167161799 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4138e00640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac284010 0x5603ac28ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133400640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac288ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.791 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 -- 172.21.15.164:0/1167161799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 msgr2=0x5603ac288ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac288ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 -- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac284010 msgr2=0x5603ac28ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac284010 0x5603ac28ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 -- 172.21.15.164:0/1167161799 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603abef83f0 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133400640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac288ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f4133e00640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f41240127d0 tx=0x7f4124004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1f6df39259964cd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.795+0000 7f411e000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4124003b70 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4124003d10 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c02cb20 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f412400e8d0 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f413dbce740 10 client.15483 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603abeb80f0 con 0x5603ac27e4b0 2024-03-27T08:35:50.792 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.796+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f412c02cb20 con 0x5603ac27e4b0 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f412400f040 con 0x5603ac27e4b0 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 10 client.15483 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 20 client.15483 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2948c0 0x5603ac296d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 4 client.15483 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:50.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5603ac1f1bf0 con 0x5603ac2948c0 2024-03-27T08:35:50.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.797+0000 7f4133400640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2948c0 0x5603ac296d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.798+0000 7f4133400640 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2948c0 0x5603ac296d80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbdaad9db410d78e server_cookie=ba0faf194f2575ea in_seq=0 out_seq=0 2024-03-27T08:35:50.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.798+0000 7f411e000640 10 client.15483 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.799+0000 7f411e000640 1 -- 172.21.15.164:0/1167161799 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5603ac1f1bf0 con 0x5603ac2948c0 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.799+0000 7f411e000640 10 client.15483 handle_command_reply: tid=0 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 client.15483 shutdown 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 msgr2=0x5603ac2889b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f41240127d0 tx=0x7f4124004a40 comp rx=0 tx=0).stop 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 shutdown_connections 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2948c0 0x5603ac296d80 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac284010 0x5603ac28ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac288ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 --2- 172.21.15.164:0/1167161799 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27e4b0 0x5603ac2889b0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 >> 172.21.15.164:0/1167161799 conn(0x5603ac279a20 msgr2=0x5603ac278c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f411e000640 0 client.15483 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 shutdown_connections 2024-03-27T08:35:50.795 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 1 -- 172.21.15.164:0/1167161799 wait complete. 2024-03-27T08:35:50.796 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.800+0000 7f413dbce740 20 client.15483 trim_cache size 0 max 16384 2024-03-27T08:35:50.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 Processor -- start 2024-03-27T08:35:50.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 -- start start 2024-03-27T08:35:50.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac278390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac28fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f41341b1f20 con 0x5603ac284010 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41341af7f0 con 0x5603ac27e4b0 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f413dbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41341ad640 con 0x5603ac27eea0 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.819+0000 7f4138e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41588/0 (socket says 172.21.15.164:41588) 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 -- 172.21.15.164:0/1403375581 learned_addr learned my addr 172.21.15.164:0/1403375581 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4133400640 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac28fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.813 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4133e00640 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac278390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 -- 172.21.15.164:0/1403375581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 msgr2=0x5603ac28fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac28fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 -- 172.21.15.164:0/1403375581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 msgr2=0x5603ac278390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac278390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 -- 172.21.15.164:0/1403375581 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603ac27a790 con 0x5603ac284010 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.820+0000 7f4138e00640 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f412c005c40 tx=0x7f412c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b229910ec5415f47 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f4128c00640 1 -- 172.21.15.164:0/1403375581 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c04b030 con 0x5603ac284010 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f4128c00640 1 -- 172.21.15.164:0/1403375581 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f412c047450 con 0x5603ac284010 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f4128c00640 1 -- 172.21.15.164:0/1403375581 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f412c042040 con 0x5603ac284010 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 -- 172.21.15.164:0/1403375581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 msgr2=0x5603ac2788d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f412c005c40 tx=0x7f412c000bc0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 -- 172.21.15.164:0/1403375581 shutdown_connections 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac284010 0x5603ac2788d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac27eea0 0x5603ac28fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 --2- 172.21.15.164:0/1403375581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac278390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 -- 172.21.15.164:0/1403375581 >> 172.21.15.164:0/1403375581 conn(0x5603ac279a20 msgr2=0x5603ac2885c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 -- 172.21.15.164:0/1403375581 shutdown_connections 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.821+0000 7f413dbce740 1 -- 172.21.15.164:0/1403375581 wait complete. 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 -- start start 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 Processor -- start 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac28cf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2f8c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f41341adcb0 con 0x5603ac27eea0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41341af120 con 0x5603ac27e4b0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.822+0000 7f413dbce740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f41341ae380 con 0x5603ac284010 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f413dbce740 10 client.0 _ll_register_callbacks cb 0x7f4124009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41596/0 (socket says 172.21.15.164:41596) 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 -- 172.21.15.164:0/1092027686 learned_addr learned my addr 172.21.15.164:0/1092027686 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133e00640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac28cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 -- 172.21.15.164:0/1092027686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 msgr2=0x5603ac2f8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2f8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 -- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 msgr2=0x5603ac28cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac28cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 -- 172.21.15.164:0/1092027686 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603ac2f91b0 con 0x5603ac27eea0 2024-03-27T08:35:50.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133e00640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac28cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f4133400640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f412009c550 tx=0x7f412000cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada17fdc551f8a88 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f411e000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.823+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4120098860 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4120098c30 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f412c047450 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f412009ccc0 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 10 client.15489 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5603ac2fa5c0 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f412c047450 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4120018b80 con 0x5603ac27eea0 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 10 client.15489 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 10 client.15489 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 20 client.15489 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:50.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2faf20 0x5603ac2fd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:50.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 4 client.15489 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:35:50.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.824+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5603ac1ebf40 con 0x5603ac2faf20 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.825+0000 7f4133e00640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2faf20 0x5603ac2fd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.825+0000 7f411e000640 10 client.15489 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.825+0000 7f4133e00640 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2faf20 0x5603ac2fd360 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d73cc7c651cfc026 server_cookie=ba08304ff71bc06 in_seq=0 out_seq=0 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f411e000640 1 -- 172.21.15.164:0/1092027686 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5603ac1ebf40 con 0x5603ac2faf20 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f411e000640 10 client.15489 handle_command_reply: tid=0 2024-03-27T08:35:50.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 client.15489 shutdown 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 msgr2=0x5603ac28d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f412009c550 tx=0x7f412000cf20 comp rx=0 tx=0).stop 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 shutdown_connections 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5603ac2faf20 0x5603ac2fd360 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5603ac284010 0x5603ac2f8c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5603ac27eea0 0x5603ac28d440 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 --2- 172.21.15.164:0/1092027686 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5603ac27e4b0 0x5603ac28cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f411e000640 0 client.15489 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 >> 172.21.15.164:0/1092027686 conn(0x5603ac279a20 msgr2=0x5603ac27cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 shutdown_connections 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 1 -- 172.21.15.164:0/1092027686 wait complete. 2024-03-27T08:35:50.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.826+0000 7f413dbce740 20 client.15489 trim_cache size 0 max 16384 2024-03-27T08:35:50.824 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "no active scrubs running", 2024-03-27T08:35:50.824 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": {} 2024-03-27T08:35:50.824 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:50.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 msgr2=0x7f41180a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 0x7f41180a5b50 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5603ac27a990 tx=0x7f4124009580 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 msgr2=0x7f413419e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f412000e9f0 tx=0x7f412000eeb0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 shutdown_connections 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f41180a3690 0x7f41180a5b50 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4134109d20 0x7f41341a59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4134109360 0x7f413419e970 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 --2- 172.21.15.164:0/513074980 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4134108170 0x7f413419e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 >> 172.21.15.164:0/513074980 conn(0x7f4134077110 msgr2=0x7f413410c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 shutdown_connections 2024-03-27T08:35:50.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:50.827+0000 7f413ae00640 1 -- 172.21.15.164:0/513074980 wait complete. 2024-03-27T08:35:50.838 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T08:35:50.839 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:35:51.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 -- 172.21.15.164:0/2030887704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa58010a5a0 msgr2=0x7fa580110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 --2- 172.21.15.164:0/2030887704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa58010a5a0 0x7fa580110e50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa578009ca0 tx=0x7fa57802c100 comp rx=0 tx=0).stop 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 -- 172.21.15.164:0/2030887704 shutdown_connections 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 --2- 172.21.15.164:0/2030887704 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa58010a5a0 0x7fa580110e50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 --2- 172.21.15.164:0/2030887704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580109c00 0x7fa58010a060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 --2- 172.21.15.164:0/2030887704 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa580108ef0 0x7fa580109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 -- 172.21.15.164:0/2030887704 >> 172.21.15.164:0/2030887704 conn(0x7fa58006f180 msgr2=0x7fa5800715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 -- 172.21.15.164:0/2030887704 shutdown_connections 2024-03-27T08:35:51.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.053+0000 7fa587c00640 1 -- 172.21.15.164:0/2030887704 wait complete. 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.054+0000 7fa587c00640 1 Processor -- start 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.054+0000 7fa587c00640 1 -- start start 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580108ef0 0x7fa5801a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa58010a5a0 0x7fa5801a9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113dc0 con 0x7fa580109c00 2024-03-27T08:35:51.050 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113c40 con 0x7fa580108ef0 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa587c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa580113f40 con 0x7fa58010a5a0 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa57fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa57fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41610/0 (socket says 172.21.15.164:41610) 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa57fe00640 1 -- 172.21.15.164:0/2506641597 learned_addr learned my addr 172.21.15.164:0/2506641597 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa585200640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580108ef0 0x7fa5801a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.055+0000 7fa585c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa58010a5a0 0x7fa5801a9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 -- 172.21.15.164:0/2506641597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa58010a5a0 msgr2=0x7fa5801a9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa58010a5a0 0x7fa5801a9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.051 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 -- 172.21.15.164:0/2506641597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580108ef0 msgr2=0x7fa5801a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580108ef0 0x7fa5801a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 -- 172.21.15.164:0/2506641597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5801aa4c0 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57fe00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa57000ea20 tx=0x7fa57000eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000cd40 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5700168e0 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57000b8d0 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5801aa7b0 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.056+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5801aad00 con 0x7fa580109c00 2024-03-27T08:35:51.052 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.057+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58010fd30 con 0x7fa580109c00 2024-03-27T08:35:51.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.059+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fa570016a90 con 0x7fa580109c00 2024-03-27T08:35:51.053 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.061+0000 7fa57d600640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 0x7fa5640a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.061+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa5700cfc80 con 0x7fa580109c00 2024-03-27T08:35:51.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.061+0000 7fa585200640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 0x7fa5640a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.054 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.062+0000 7fa585200640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 0x7fa5640a5ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009b60 tx=0x7fa56c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.058 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.066+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa57009c800 con 0x7fa580109c00 2024-03-27T08:35:51.302 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.309+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa58002d370 con 0x7fa580109c00 2024-03-27T08:35:51.303 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.310+0000 7fa57d600640 1 -- 172.21.15.164:0/2506641597 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11888 (secure 0 0 0) 0x7fa57009c100 con 0x7fa580109c00 2024-03-27T08:35:51.303 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:35:51.304 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:35:11.240118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34502,34430,34463]},"id":1}]} 2024-03-27T08:35:51.304 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 msgr2=0x7fa5640a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 0x7fa5640a5ad0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa56c009b60 tx=0x7fa56c005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 msgr2=0x7fa5801a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fa57000ea20 tx=0x7fa57000eee0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 shutdown_connections 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa5640a3610 0x7fa5640a5ad0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa58010a5a0 0x7fa5801a9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa580109c00 0x7fa5801a2de0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 --2- 172.21.15.164:0/2506641597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa580108ef0 0x7fa5801a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 >> 172.21.15.164:0/2506641597 conn(0x7fa58006f180 msgr2=0x7fa58010cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 shutdown_connections 2024-03-27T08:35:51.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.313+0000 7fa587c00640 1 -- 172.21.15.164:0/2506641597 wait complete. 2024-03-27T08:35:51.326 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T08:35:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 -- 172.21.15.164:0/2575362391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 msgr2=0x7ff6f4076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 --2- 172.21.15.164:0/2575362391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f4076930 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009900 tx=0x7ff6e402bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:51.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 -- 172.21.15.164:0/2575362391 shutdown_connections 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 --2- 172.21.15.164:0/2575362391 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 0x7ff6f4078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 --2- 172.21.15.164:0/2575362391 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 0x7ff6f4077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 --2- 172.21.15.164:0/2575362391 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f4076930 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 -- 172.21.15.164:0/2575362391 >> 172.21.15.164:0/2575362391 conn(0x7ff6f40ff300 msgr2=0x7ff6f4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 -- 172.21.15.164:0/2575362391 shutdown_connections 2024-03-27T08:35:51.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.544+0000 7ff6fa200640 1 -- 172.21.15.164:0/2575362391 wait complete. 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.545+0000 7ff6fa200640 1 Processor -- start 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 -- start start 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 0x7ff6f419ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 0x7ff6f41a5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113dd0 con 0x7ff6f4076510 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113c50 con 0x7ff6f4077750 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6fa200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f4113f50 con 0x7ff6f40780f0 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41618/0 (socket says 172.21.15.164:41618) 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6f3400640 1 -- 172.21.15.164:0/425426930 learned_addr learned my addr 172.21.15.164:0/425426930 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.546+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 0x7ff6f419ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 0x7ff6f41a5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 -- 172.21.15.164:0/425426930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 msgr2=0x7ff6f41a5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 0x7ff6f41a5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 -- 172.21.15.164:0/425426930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 msgr2=0x7ff6f419ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 0x7ff6f419ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 -- 172.21.15.164:0/425426930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6f41a60f0 con 0x7ff6f4076510 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6f3400640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009230 tx=0x7ff6e4004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6ebe00640 1 -- 172.21.15.164:0/425426930 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4043020 con 0x7ff6f4076510 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6ebe00640 1 -- 172.21.15.164:0/425426930 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff6e4004350 con 0x7ff6f4076510 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6f41a6380 con 0x7ff6f4076510 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.547+0000 7ff6ebe00640 1 -- 172.21.15.164:0/425426930 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e4003ca0 con 0x7ff6f4076510 2024-03-27T08:35:51.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.548+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6f41a6920 con 0x7ff6f4076510 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 Processor -- start 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 -- start start 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6ebe00640 1 -- 172.21.15.164:0/425426930 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7ff6e4046020 con 0x7ff6f4076510 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5514ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5519db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5643a54dc7b0 con 0x5643a551a420 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5643a5479670 con 0x5643a55152b0 2024-03-27T08:35:51.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.552+0000 7ff6fd019740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5643a5421970 con 0x5643a55148c0 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41630/0 (socket says 172.21.15.164:41630) 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 -- 172.21.15.164:0/3246567006 learned_addr learned my addr 172.21.15.164:0/3246567006 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f3400640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5519db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5514ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 -- 172.21.15.164:0/3246567006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 msgr2=0x5643a5514ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5514ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 -- 172.21.15.164:0/3246567006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 msgr2=0x5643a5519db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5519db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f2a00640 1 -- 172.21.15.164:0/3246567006 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a518d3f0 con 0x5643a551a420 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.553+0000 7ff6f3400640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5519db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00bce0 tx=0x7ff6dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e6ca70344e12d80 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6ebe00640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 0x7ff6d80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6e3e00640 1 -- 172.21.15.164:0/3246567006 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc015070 con 0x5643a551a420 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6e3e00640 1 -- 172.21.15.164:0/3246567006 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff6dc01a930 con 0x5643a551a420 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6e3e00640 1 -- 172.21.15.164:0/3246567006 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc0119e0 con 0x5643a551a420 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6ebe00640 1 -- 172.21.15.164:0/425426930 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff6e40f1a90 con 0x7ff6f4076510 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.554+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 0x7ff6d80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- 172.21.15.164:0/3246567006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 msgr2=0x5643a551c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc00bce0 tx=0x7ff6dc00f730 comp rx=0 tx=0).stop 2024-03-27T08:35:51.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- 172.21.15.164:0/3246567006 shutdown_connections 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a551c8b0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5519db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3246567006 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5514ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- 172.21.15.164:0/3246567006 >> 172.21.15.164:0/3246567006 conn(0x5643a550fe30 msgr2=0x5643a5510230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 0x7ff6d80a5b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0092f0 tx=0x7ff6ec009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- 172.21.15.164:0/3246567006 shutdown_connections 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- 172.21.15.164:0/3246567006 wait complete. 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.555+0000 7ff6fd019740 1 -- start start 2024-03-27T08:35:51.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 Processor -- start 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a551ea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a551efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5643a5434ca0 con 0x5643a551a420 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5643a5475620 con 0x5643a55152b0 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5643a551d3d0 con 0x5643a55148c0 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6fd019740 10 client.0 _ll_register_callbacks cb 0x5643a5471160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:51.554 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41640/0 (socket says 172.21.15.164:41640) 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6f3e00640 1 -- 172.21.15.164:0/861948601 learned_addr learned my addr 172.21.15.164:0/861948601 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.556+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a551efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3400640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a551ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 -- 172.21.15.164:0/861948601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 msgr2=0x5643a551ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a551ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 -- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 msgr2=0x5643a551efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a551efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 -- 172.21.15.164:0/861948601 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a52577d0 con 0x5643a551a420 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0097d0 tx=0x7ff6ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d139f6e9241e0174 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:51.555 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00ece0 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff6ec01f420 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.557+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6dc01a930 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec012e30 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6fd019740 10 client.15507 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643a5529430 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff6dc01a930 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff6ec00f040 con 0x5643a551a420 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6fd019740 10 client.15507 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6fd019740 10 client.15507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.558+0000 7ff6fd019740 20 client.15507 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.559+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a552aba0 0x5643a552d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.559+0000 7ff6fd019740 4 client.15507 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.559+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5643a5486bb0 con 0x5643a552aba0 2024-03-27T08:35:51.556 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.559+0000 7ff6f3400640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a552aba0 0x5643a552d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.560+0000 7ff6f3400640 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a552aba0 0x5643a552d030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4fcf5690ab3c4fbb server_cookie=a635a4aafec7d21c in_seq=0 out_seq=0 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.560+0000 7ff6e0c00640 10 client.15507 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6e0c00640 1 -- 172.21.15.164:0/861948601 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5643a5486bb0 con 0x5643a552aba0 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6e0c00640 10 client.15507 handle_command_reply: tid=0 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 client.15507 shutdown 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 msgr2=0x5643a5525ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0097d0 tx=0x7ff6ec004a40 comp rx=0 tx=0).stop 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 shutdown_connections 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a552aba0 0x5643a552d030 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5525ff0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a551efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6e0c00640 0 client.15507 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 --2- 172.21.15.164:0/861948601 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a551ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.557 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 >> 172.21.15.164:0/861948601 conn(0x5643a550fe30 msgr2=0x5643a550f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 shutdown_connections 2024-03-27T08:35:51.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 1 -- 172.21.15.164:0/861948601 wait complete. 2024-03-27T08:35:51.558 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.561+0000 7ff6fd019740 20 client.15507 trim_cache size 0 max 16384 2024-03-27T08:35:51.568 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 Processor -- start 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 -- start start 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5525fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a551a420 0x5643a55318f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41b1ed0 con 0x5643a55148c0 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41af7a0 con 0x5643a55152b0 2024-03-27T08:35:51.569 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6fd019740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41ad5f0 con 0x5643a551a420 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6f3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41648/0 (socket says 172.21.15.164:41648) 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.576+0000 7ff6f3400640 1 -- 172.21.15.164:0/3904361324 learned_addr learned my addr 172.21.15.164:0/3904361324 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 -- 172.21.15.164:0/3904361324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a551a420 msgr2=0x5643a55318f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a551a420 0x5643a55318f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 -- 172.21.15.164:0/3904361324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 msgr2=0x5643a5525fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5525fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.570 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 -- 172.21.15.164:0/3904361324 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5643a5514ef0 con 0x5643a55148c0 2024-03-27T08:35:51.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6f3400640 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40f5310 tx=0x7ff6e40de040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889d0481d6b3e99b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6e3400640 1 -- 172.21.15.164:0/3904361324 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40bdd40 con 0x5643a55148c0 2024-03-27T08:35:51.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6e3400640 1 -- 172.21.15.164:0/3904361324 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff6e4003e40 con 0x5643a55148c0 2024-03-27T08:35:51.571 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.577+0000 7ff6e3400640 1 -- 172.21.15.164:0/3904361324 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6e40bd8d0 con 0x5643a55148c0 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- 172.21.15.164:0/3904361324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 msgr2=0x5643a55137a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40f5310 tx=0x7ff6e40de040 comp rx=0 tx=0).stop 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- 172.21.15.164:0/3904361324 shutdown_connections 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a551a420 0x5643a55318f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5525fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 --2- 172.21.15.164:0/3904361324 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a55148c0 0x5643a55137a0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- 172.21.15.164:0/3904361324 >> 172.21.15.164:0/3904361324 conn(0x5643a550fe30 msgr2=0x5643a5513090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- 172.21.15.164:0/3904361324 shutdown_connections 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- 172.21.15.164:0/3904361324 wait complete. 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.578+0000 7ff6fd019740 1 -- start start 2024-03-27T08:35:51.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 Processor -- start 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5523a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5523f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41adc60 con 0x5643a551a420 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41af0d0 con 0x5643a55152b0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff6f41ae330 con 0x5643a55148c0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6fd019740 10 client.0 _ll_register_callbacks cb 0x7ff6ec009ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6f3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41664/0 (socket says 172.21.15.164:41664) 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.579+0000 7ff6f3e00640 1 -- 172.21.15.164:0/2452434788 learned_addr learned my addr 172.21.15.164:0/2452434788 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3400640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5523a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f2a00640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5523f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 -- 172.21.15.164:0/2452434788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 msgr2=0x5643a5523a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5523a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 -- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 msgr2=0x5643a5523f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5523f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 -- 172.21.15.164:0/2452434788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5643a5525560 con 0x5643a551a420 2024-03-27T08:35:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6f3e00640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0097a0 tx=0x7ff6ec027cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8620b2118094c2af server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.580+0000 7ff6e0c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec040060 con 0x5643a551a420 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff6ec00ece0 con 0x5643a551a420 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5643a5480f00 con 0x5643a551a420 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff6ec037040 con 0x5643a551a420 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6fd019740 10 client.15513 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5643a55912b0 con 0x5643a551a420 2024-03-27T08:35:51.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.581+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5643a5480f00 con 0x5643a551a420 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff6ec03bc60 con 0x5643a551a420 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 10 client.15513 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 10 client.15513 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 20 client.15513 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a5591ce0 0x5643a5594100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 4 client.15513 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5643a53fe560 con 0x5643a5591ce0 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.582+0000 7ff6f3400640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a5591ce0 0x5643a5594100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.583+0000 7ff6f3400640 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a5591ce0 0x5643a5594100 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4e6efd15f798c169 server_cookie=44cde8fc41bf9a04 in_seq=0 out_seq=0 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.583+0000 7ff6e0c00640 10 client.15513 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.583+0000 7ff6e0c00640 1 -- 172.21.15.164:0/2452434788 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5643a53fe560 con 0x5643a5591ce0 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.583+0000 7ff6e0c00640 10 client.15513 handle_command_reply: tid=0 2024-03-27T08:35:51.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.583+0000 7ff6fd019740 1 client.15513 shutdown 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 msgr2=0x5643a5524f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0097a0 tx=0x7ff6ec027cb0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 shutdown_connections 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5643a5591ce0 0x5643a5594100 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5643a551a420 0x5643a5524f70 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5643a55152b0 0x5643a5523f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6e0c00640 0 client.15513 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 --2- 172.21.15.164:0/2452434788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5643a55148c0 0x5643a5523a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 >> 172.21.15.164:0/2452434788 conn(0x5643a550fe30 msgr2=0x5643a5513920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 shutdown_connections 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 1 -- 172.21.15.164:0/2452434788 wait complete. 2024-03-27T08:35:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.584+0000 7ff6fd019740 20 client.15513 trim_cache size 0 max 16384 2024-03-27T08:35:51.580 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:35:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 msgr2=0x7ff6d80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 0x7ff6d80a5b50 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec0092f0 tx=0x7ff6ec009280 comp rx=0 tx=0).stop 2024-03-27T08:35:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 msgr2=0x7ff6f419e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4009230 tx=0x7ff6e4004ea0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 shutdown_connections 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff6d80a3690 0x7ff6d80a5b50 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff6f40780f0 0x7ff6f41a5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6f4077750 0x7ff6f419ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 --2- 172.21.15.164:0/425426930 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff6f4076510 0x7ff6f419e4d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 >> 172.21.15.164:0/425426930 conn(0x7ff6f40ff300 msgr2=0x7ff6f4100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 shutdown_connections 2024-03-27T08:35:51.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.585+0000 7ff6fa200640 1 -- 172.21.15.164:0/425426930 wait complete. 2024-03-27T08:35:51.592 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2506641597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:51.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.810+0000 7f0b9fe00640 1 -- 172.21.15.164:0/2081309949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 msgr2=0x7f0ba01096e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.810+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/2081309949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba01096e0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f0b88009ca0 tx=0x7f0b8802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 -- 172.21.15.164:0/2081309949 shutdown_connections 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/2081309949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 0x7f0ba01104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/2081309949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba01096e0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/2081309949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 0x7f0ba0108490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 -- 172.21.15.164:0/2081309949 >> 172.21.15.164:0/2081309949 conn(0x7f0ba0077020 msgr2=0x7f0ba0079440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 -- 172.21.15.164:0/2081309949 shutdown_connections 2024-03-27T08:35:51.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.811+0000 7f0b9fe00640 1 -- 172.21.15.164:0/2081309949 wait complete. 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 Processor -- start 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 -- start start 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 0x7f0ba019e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 0x7f0ba01a5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0113cd0 con 0x7f0ba0109260 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0113b50 con 0x7f0ba0109c20 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.812+0000 7f0b9fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0113e50 con 0x7f0ba0108070 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.806 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41680/0 (socket says 172.21.15.164:41680) 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 -- 172.21.15.164:0/623231178 learned_addr learned my addr 172.21.15.164:0/623231178 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9f400640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 0x7f0ba01a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 0x7f0ba019e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 -- 172.21.15.164:0/623231178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 msgr2=0x7f0ba019e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 0x7f0ba019e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 -- 172.21.15.164:0/623231178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 msgr2=0x7f0ba01a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 0x7f0ba01a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 -- 172.21.15.164:0/623231178 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba01a5ff0 con 0x7f0ba0109260 2024-03-27T08:35:51.807 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.813+0000 7f0b9e000640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b88037040 tx=0x7f0b88032980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.814+0000 7f0ba4a00640 1 -- 172.21.15.164:0/623231178 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88039050 con 0x7f0ba0109260 2024-03-27T08:35:51.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.814+0000 7f0ba4a00640 1 -- 172.21.15.164:0/623231178 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b8803a040 con 0x7f0ba0109260 2024-03-27T08:35:51.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.814+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba01a6280 con 0x7f0ba0109260 2024-03-27T08:35:51.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.814+0000 7f0ba4a00640 1 -- 172.21.15.164:0/623231178 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b88040450 con 0x7f0ba0109260 2024-03-27T08:35:51.808 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.814+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba01a6770 con 0x7f0ba0109260 2024-03-27T08:35:51.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.817+0000 7f0ba8bc9740 1 Processor -- start 2024-03-27T08:35:51.810 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.817+0000 7f0ba8bc9740 1 -- start start 2024-03-27T08:35:51.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba4a00640 1 -- 172.21.15.164:0/623231178 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f0b88003c90 con 0x7f0ba0109260 2024-03-27T08:35:51.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5dab0 0x55d747f5ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.811 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d747f257b0 con 0x55d747f5e4a0 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d747ec2670 con 0x55d747f5dab0 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d747e6a970 con 0x55d747f63610 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41692/0 (socket says 172.21.15.164:41692) 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 -- 172.21.15.164:0/3774585270 learned_addr learned my addr 172.21.15.164:0/3774585270 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9f400640 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5dab0 0x55d747f5ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 -- 172.21.15.164:0/3774585270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 msgr2=0x55d747f65aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 -- 172.21.15.164:0/3774585270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5dab0 msgr2=0x55d747f5ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5dab0 0x55d747f5ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.818+0000 7f0b9ea00640 1 -- 172.21.15.164:0/3774585270 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d747bd63f0 con 0x55d747f5e4a0 2024-03-27T08:35:51.812 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.819+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000bc80 tx=0x7f0b9000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5deae24b57b37342 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.819+0000 7f0b8fe00640 1 -- 172.21.15.164:0/3774585270 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90015070 con 0x55d747f5e4a0 2024-03-27T08:35:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.819+0000 7f0b8fe00640 1 -- 172.21.15.164:0/3774585270 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9001a930 con 0x55d747f5e4a0 2024-03-27T08:35:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.819+0000 7f0b8fe00640 1 -- 172.21.15.164:0/3774585270 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b900119e0 con 0x55d747f5e4a0 2024-03-27T08:35:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.819+0000 7f0ba4a00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 0x7f0b800a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba4a00640 1 -- 172.21.15.164:0/623231178 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0b880f2960 con 0x7f0ba0109260 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0b9f400640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 0x7f0b800a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/3774585270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 msgr2=0x55d747f62fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000bc80 tx=0x7f0b9000f730 comp rx=0 tx=0).stop 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/3774585270 shutdown_connections 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f65aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5e4a0 0x55d747f62fa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/3774585270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5dab0 0x55d747f5ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/3774585270 >> 172.21.15.164:0/3774585270 conn(0x55d747f59020 msgr2=0x55d747f59420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/3774585270 shutdown_connections 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.820+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/3774585270 wait complete. 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.821+0000 7f0b9f400640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 0x7f0b800a5ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d747f5ed00 tx=0x7f0b98005cc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.821+0000 7f0ba8bc9740 1 -- start start 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.821+0000 7f0ba8bc9740 1 Processor -- start 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.821+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f5e4a0 0x55d747f68230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f63610 0x55d747f6f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d747e7dca0 con 0x55d747f5dab0 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d747ebe620 con 0x55d747f63610 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d747f665c0 con 0x55d747f5e4a0 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0ba8bc9740 10 client.0 _ll_register_callbacks cb 0x55d747eba160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41700/0 (socket says 172.21.15.164:41700) 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 -- 172.21.15.164:0/147221177 learned_addr learned my addr 172.21.15.164:0/147221177 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9f400640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f63610 0x55d747f6f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.818 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 -- 172.21.15.164:0/147221177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f5e4a0 msgr2=0x55d747f68230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f5e4a0 0x55d747f68230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 -- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f63610 msgr2=0x55d747f6f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f63610 0x55d747f6f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.822+0000 7f0b9ea00640 1 -- 172.21.15.164:0/147221177 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d747ca07d0 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000b410 tx=0x7f0b9000bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09834900ee837ab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90028060 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0b9001aae0 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b9001a930 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b90015040 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0ba8bc9740 10 client.15525 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d747f725d0 con 0x55d747f5dab0 2024-03-27T08:35:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.823+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9001a930 con 0x55d747f5dab0 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0b90022030 con 0x55d747f5dab0 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 10 client.15525 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 10 client.15525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 20 client.15525 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747f73a30 0x55d747f75e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 4 client.15525 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d747ecfbb0 con 0x55d747f73a30 2024-03-27T08:35:51.821 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2506641597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.824+0000 7f0b9e000640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747f73a30 0x55d747f75e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.825+0000 7f0b9e000640 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747f73a30 0x55d747f75e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58628abff97dbcc2 server_cookie=b143f760853ea66a in_seq=0 out_seq=0 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.825+0000 7f0b8cc00640 10 client.15525 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0b8cc00640 1 -- 172.21.15.164:0/147221177 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d747ecfbb0 con 0x55d747f73a30 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0b8cc00640 10 client.15525 handle_command_reply: tid=0 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 client.15525 shutdown 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 msgr2=0x55d747f67cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f0b9000b410 tx=0x7f0b9000bfa0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 shutdown_connections 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747f73a30 0x55d747f75e20 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f63610 0x55d747f6f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f5e4a0 0x55d747f68230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0b8cc00640 0 client.15525 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/147221177 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f67cf0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.827+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 >> 172.21.15.164:0/147221177 conn(0x55d747f59020 msgr2=0x55d747f58240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.828+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 shutdown_connections 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.828+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/147221177 wait complete. 2024-03-27T08:35:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.828+0000 7f0ba8bc9740 20 client.15525 trim_cache size 0 max 16384 2024-03-27T08:35:51.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2506641597' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.842+0000 7f0ba8bc9740 1 Processor -- start 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.842+0000 7f0ba8bc9740 1 -- start start 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f7b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01b1d70 con 0x55d747f5dab0 2024-03-27T08:35:51.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01af640 con 0x55d747f5e4a0 2024-03-27T08:35:51.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01ad490 con 0x55d747f63610 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41712/0 (socket says 172.21.15.164:41712) 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 -- 172.21.15.164:0/1222688011 learned_addr learned my addr 172.21.15.164:0/1222688011 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9f400640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f7b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9e000640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 -- 172.21.15.164:0/1222688011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 msgr2=0x55d747f7b6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f7b6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 -- 172.21.15.164:0/1222688011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 msgr2=0x55d747f6f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9ea00640 1 -- 172.21.15.164:0/1222688011 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d747f5f350 con 0x55d747f5dab0 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.843+0000 7f0b9e000640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.844+0000 7f0b9f400640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.844+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b90011db0 tx=0x7f0b9000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8559923761b8bd39 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.844+0000 7f0b8f400640 1 -- 172.21.15.164:0/1222688011 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90032070 con 0x55d747f5dab0 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.844+0000 7f0b8f400640 1 -- 172.21.15.164:0/1222688011 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b90011910 con 0x55d747f5dab0 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.844+0000 7f0b8f400640 1 -- 172.21.15.164:0/1222688011 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90028070 con 0x55d747f5dab0 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/1222688011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 msgr2=0x55d747f5cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0b90011db0 tx=0x7f0b9000b480 comp rx=0 tx=0).stop 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/1222688011 shutdown_connections 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f7b6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/1222688011 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f5cb10 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/1222688011 >> 172.21.15.164:0/1222688011 conn(0x55d747f59020 msgr2=0x55d747f579b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/1222688011 shutdown_connections 2024-03-27T08:35:51.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/1222688011 wait complete. 2024-03-27T08:35:51.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 -- start start 2024-03-27T08:35:51.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.845+0000 7f0ba8bc9740 1 Processor -- start 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f6e000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01adb00 con 0x55d747f5dab0 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01aef70 con 0x55d747f5e4a0 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01ae1d0 con 0x55d747f63610 2024-03-27T08:35:51.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0ba8bc9740 10 client.0 _ll_register_callbacks cb 0x7f0b98004120 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41724/0 (socket says 172.21.15.164:41724) 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 -- 172.21.15.164:0/2520316413 learned_addr learned my addr 172.21.15.164:0/2520316413 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9e000640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 -- 172.21.15.164:0/2520316413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 msgr2=0x55d747f6e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f6e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 -- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 msgr2=0x55d747f6cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9ea00640 1 -- 172.21.15.164:0/2520316413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d747f6e5f0 con 0x55d747f5dab0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.846+0000 7f0b9e000640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0b9ea00640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d747f5fed0 tx=0x7f0b9001bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6511cacdd1ed77d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0b8cc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:51.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90028030 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b90011910 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f0b90005460 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f0b90046050 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0ba8bc9740 10 client.15531 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.847+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d747fd9de0 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b90011910 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f0b90022050 con 0x55d747f5dab0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 10 client.15531 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 10 client.15531 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 20 client.15531 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747fda6d0 0x55d747fdcaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 4 client.15531 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d747ec9f00 con 0x55d747fda6d0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.848+0000 7f0b9e000640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747fda6d0 0x55d747fdcaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:51.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.849+0000 7f0b8cc00640 10 client.15531 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.849+0000 7f0b9e000640 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747fda6d0 0x55d747fdcaf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d438b2b9dbdc41f1 server_cookie=509ee1e89b8b723 in_seq=0 out_seq=0 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.849+0000 7f0b8cc00640 1 -- 172.21.15.164:0/2520316413 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d747ec9f00 con 0x55d747fda6d0 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.849+0000 7f0b8cc00640 10 client.15531 handle_command_reply: tid=0 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 client.15531 shutdown 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 msgr2=0x55d747f6cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x55d747f5fed0 tx=0x7f0b9001bc10 comp rx=0 tx=0).stop 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 shutdown_connections 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55d747fda6d0 0x55d747fdcaf0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d747f63610 0x55d747f6e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d747f5e4a0 0x55d747f6cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 --2- 172.21.15.164:0/2520316413 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d747f5dab0 0x55d747f6cab0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0b8cc00640 0 client.15531 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:35:51.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 >> 172.21.15.164:0/2520316413 conn(0x55d747f59020 msgr2=0x55d747f5c990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 shutdown_connections 2024-03-27T08:35:51.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 1 -- 172.21.15.164:0/2520316413 wait complete. 2024-03-27T08:35:51.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.850+0000 7f0ba8bc9740 20 client.15531 trim_cache size 0 max 16384 2024-03-27T08:35:51.847 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 msgr2=0x7f0b800a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 0x7f0b800a5ad0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x55d747f5ed00 tx=0x7f0b98005cc0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 msgr2=0x7f0ba019e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f0b88037040 tx=0x7f0b88032980 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 shutdown_connections 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f0b800a3610 0x7f0b800a5ad0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0109c20 0x7f0ba01a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f0ba0109260 0x7f0ba019e910 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 --2- 172.21.15.164:0/623231178 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f0ba0108070 0x7f0ba019e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 >> 172.21.15.164:0/623231178 conn(0x7f0ba0077020 msgr2=0x7f0ba010c5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 shutdown_connections 2024-03-27T08:35:51.848 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:51.851+0000 7f0b9fe00640 1 -- 172.21.15.164:0/623231178 wait complete. 2024-03-27T08:35:51.860 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 -- 172.21.15.164:0/4166135636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 msgr2=0x7f7e8010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 --2- 172.21.15.164:0/4166135636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e8010c1d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009ca0 tx=0x7f7e7802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 -- 172.21.15.164:0/4166135636 shutdown_connections 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 --2- 172.21.15.164:0/4166135636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e8010c1d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 --2- 172.21.15.164:0/4166135636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e80105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 --2- 172.21.15.164:0/4166135636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 0x7f7e801041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.074 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 -- 172.21.15.164:0/4166135636 >> 172.21.15.164:0/4166135636 conn(0x7f7e800ff300 msgr2=0x7f7e80101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 -- 172.21.15.164:0/4166135636 shutdown_connections 2024-03-27T08:35:52.075 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.081+0000 7f7e87400640 1 -- 172.21.15.164:0/4166135636 wait complete. 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 Processor -- start 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 -- start start 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 0x7f7e8019a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e8019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010f9f0 con 0x7f7e80105940 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010f870 con 0x7f7e80103d90 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.082+0000 7f7e87400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e8010fb70 con 0x7f7e80104f80 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.077 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41738/0 (socket says 172.21.15.164:41738) 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 -- 172.21.15.164:0/3131685109 learned_addr learned my addr 172.21.15.164:0/3131685109 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e84a00640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 0x7f7e8019a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e8019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 -- 172.21.15.164:0/3131685109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 msgr2=0x7f7e8019a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e8019a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 -- 172.21.15.164:0/3131685109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 msgr2=0x7f7e8019a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 0x7f7e8019a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e85400640 1 -- 172.21.15.164:0/3131685109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e801a1c70 con 0x7f7e80105940 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.083+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e8019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e85400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802c630 tx=0x7f7e78032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e7d600640 1 -- 172.21.15.164:0/3131685109 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78039050 con 0x7f7e80105940 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e7d600640 1 -- 172.21.15.164:0/3131685109 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7e7803a040 con 0x7f7e80105940 2024-03-27T08:35:52.078 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e801a1f00 con 0x7f7e80105940 2024-03-27T08:35:52.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e7d600640 1 -- 172.21.15.164:0/3131685109 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e78040450 con 0x7f7e80105940 2024-03-27T08:35:52.079 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.084+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e801a2360 con 0x7f7e80105940 2024-03-27T08:35:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.087+0000 7f7e7d600640 1 -- 172.21.15.164:0/3131685109 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7e78003b70 con 0x7f7e80105940 2024-03-27T08:35:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.087+0000 7f7e8a174740 1 Processor -- start 2024-03-27T08:35:52.080 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.087+0000 7f7e8a174740 1 -- start start 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b28c0 0x55919a2b2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b8420 0x55919a2ba8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55919a27a7b0 con 0x55919a2b32b0 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55919a217670 con 0x55919a2b8420 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e8a174740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55919a1bf970 con 0x55919a2b28c0 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41750/0 (socket says 172.21.15.164:41750) 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e84a00640 1 -- 172.21.15.164:0/2303951013 learned_addr learned my addr 172.21.15.164:0/2303951013 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b8420 0x55919a2ba8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.088+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b28c0 0x55919a2b2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 -- 172.21.15.164:0/2303951013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b28c0 msgr2=0x55919a2b2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b28c0 0x55919a2b2ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 -- 172.21.15.164:0/2303951013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b8420 msgr2=0x55919a2ba8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b8420 0x55919a2ba8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 -- 172.21.15.164:0/2303951013 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559199f2b3f0 con 0x55919a2b32b0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009c20 tx=0x7f7e740117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd2654746a4f6a19 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e7d600640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 0x7f7e680a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e71c00640 1 -- 172.21.15.164:0/2303951013 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74012450 con 0x55919a2b32b0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e71c00640 1 -- 172.21.15.164:0/2303951013 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7e74012ac0 con 0x55919a2b32b0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e71c00640 1 -- 172.21.15.164:0/2303951013 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400fae0 con 0x55919a2b32b0 2024-03-27T08:35:52.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e7d600640 1 -- 172.21.15.164:0/3131685109 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7e780f2970 con 0x7f7e80105940 2024-03-27T08:35:52.084 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.089+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 0x7f7e680a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 -- 172.21.15.164:0/2303951013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 msgr2=0x55919a2b7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 0x7f7e680a5ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005fd0 tx=0x7f7e6c005e50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009c20 tx=0x7f7e740117b0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 -- 172.21.15.164:0/2303951013 shutdown_connections 2024-03-27T08:35:52.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b8420 0x55919a2ba8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2b7db0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2303951013 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b28c0 0x55919a2b2ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 -- 172.21.15.164:0/2303951013 >> 172.21.15.164:0/2303951013 conn(0x55919a2ade30 msgr2=0x55919a2ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 -- 172.21.15.164:0/2303951013 shutdown_connections 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.090+0000 7f7e8a174740 1 -- 172.21.15.164:0/2303951013 wait complete. 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 -- start start 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 Processor -- start 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2bcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55919a1d2ca0 con 0x55919a2b28c0 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55919a213620 con 0x55919a2b32b0 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.091+0000 7f7e8a174740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55919a2bb3d0 con 0x55919a2b8420 2024-03-27T08:35:52.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e8a174740 10 client.0 _ll_register_callbacks cb 0x55919a20f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41754/0 (socket says 172.21.15.164:41754) 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 -- 172.21.15.164:0/2122202499 learned_addr learned my addr 172.21.15.164:0/2122202499 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2bcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e85400640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 -- 172.21.15.164:0/2122202499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 msgr2=0x55919a2c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2c3fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 -- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 msgr2=0x55919a2bcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2bcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 -- 172.21.15.164:0/2122202499 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559199ff57d0 con 0x55919a2b28c0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e84a00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400f480 tx=0x7f7e74012f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dba5d4d1d9da6c7f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.092+0000 7f7e66000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74028070 con 0x55919a2b28c0 2024-03-27T08:35:52.089 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7e74012450 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e74012ac0 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e74034050 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e8a174740 10 client.15543 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55919a2c7330 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.093+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7e74012ac0 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7e74003710 con 0x55919a2b28c0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 10 client.15543 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 20 client.15543 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a2c86e0 0x55919a2caad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 4 client.15543 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55919a224bb0 con 0x55919a2c86e0 2024-03-27T08:35:52.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.094+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a2c86e0 0x55919a2caad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.095+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a2c86e0 0x55919a2caad0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35bc277e5099e07c server_cookie=f4ce5314d82b9051 in_seq=0 out_seq=0 2024-03-27T08:35:52.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.095+0000 7f7e66000640 10 client.15543 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.096+0000 7f7e66000640 1 -- 172.21.15.164:0/2122202499 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55919a224bb0 con 0x55919a2c86e0 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.096+0000 7f7e66000640 10 client.15543 handle_command_reply: tid=0 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 client.15543 shutdown 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 msgr2=0x55919a2bca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f7e7400f480 tx=0x7f7e74012f80 comp rx=0 tx=0).stop 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 shutdown_connections 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a2c86e0 0x55919a2caad0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2bcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e66000640 0 client.15543 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:52.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 --2- 172.21.15.164:0/2122202499 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2bca40 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 >> 172.21.15.164:0/2122202499 conn(0x55919a2ade30 msgr2=0x55919a2ad030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 shutdown_connections 2024-03-27T08:35:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 1 -- 172.21.15.164:0/2122202499 wait complete. 2024-03-27T08:35:52.093 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.097+0000 7f7e8a174740 20 client.15543 trim_cache size 0 max 16384 2024-03-27T08:35:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.111+0000 7f7e8a174740 1 Processor -- start 2024-03-27T08:35:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 -- start start 2024-03-27T08:35:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2c3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2bc060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801adb00 con 0x55919a2b28c0 2024-03-27T08:35:52.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801ab3d0 con 0x55919a2b32b0 2024-03-27T08:35:52.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e8a174740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9220 con 0x55919a2b8420 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41760/0 (socket says 172.21.15.164:41760) 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 -- 172.21.15.164:0/3387414087 learned_addr learned my addr 172.21.15.164:0/3387414087 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2c3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 -- 172.21.15.164:0/3387414087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 msgr2=0x55919a2bc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2bc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 -- 172.21.15.164:0/3387414087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 msgr2=0x55919a2c3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2c3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.112+0000 7f7e84a00640 1 -- 172.21.15.164:0/3387414087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55919a2a9680 con 0x55919a2b28c0 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.113+0000 7f7e84a00640 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009b70 tx=0x7f7e74005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ef67b69148af14 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.113+0000 7f7e71200640 1 -- 172.21.15.164:0/3387414087 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e74028040 con 0x55919a2b28c0 2024-03-27T08:35:52.106 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.113+0000 7f7e71200640 1 -- 172.21.15.164:0/3387414087 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7e74009530 con 0x55919a2b28c0 2024-03-27T08:35:52.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.113+0000 7f7e71200640 1 -- 172.21.15.164:0/3387414087 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e7400f5a0 con 0x55919a2b28c0 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- 172.21.15.164:0/3387414087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 msgr2=0x55919a2b17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f7e74009b70 tx=0x7f7e74005810 comp rx=0 tx=0).stop 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- 172.21.15.164:0/3387414087 shutdown_connections 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a2bc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b32b0 0x55919a2c3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 --2- 172.21.15.164:0/3387414087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b28c0 0x55919a2b17a0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- 172.21.15.164:0/3387414087 >> 172.21.15.164:0/3387414087 conn(0x55919a2ade30 msgr2=0x55919a2b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- 172.21.15.164:0/3387414087 shutdown_connections 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- 172.21.15.164:0/3387414087 wait complete. 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 -- start start 2024-03-27T08:35:52.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.114+0000 7f7e8a174740 1 Processor -- start 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 0x55919a2c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a32c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9890 con 0x55919a2b32b0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801aad00 con 0x55919a2b28c0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7e801a9f60 con 0x55919a2b8420 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e8a174740 10 client.0 _ll_register_callbacks cb 0x7f7e74009aa0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41772/0 (socket says 172.21.15.164:41772) 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 -- 172.21.15.164:0/604622911 learned_addr learned my addr 172.21.15.164:0/604622911 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e84a00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 0x55919a2c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e85400640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a32c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 -- 172.21.15.164:0/604622911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 msgr2=0x55919a32c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a32c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 -- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 msgr2=0x55919a2c0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 0x55919a2c0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e7fe00640 1 -- 172.21.15.164:0/604622911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55919a32cf50 con 0x55919a2b32b0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e85400640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a32c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.115+0000 7f7e84a00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 0x55919a2c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e7fe00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0105c0 tx=0x7f7e6c005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e9da6f00600baac server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e66000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e6c029260 con 0x55919a2b32b0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7e6c029400 con 0x55919a2b32b0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7e74009530 con 0x55919a2b32b0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7e6c039050 con 0x55919a2b32b0 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e8a174740 10 client.15549 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:52.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.116+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55919a32e2f0 con 0x55919a2b32b0 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7e74009530 con 0x55919a2b32b0 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f7e6c032410 con 0x55919a2b32b0 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 10 client.15549 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 10 client.15549 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 20 client.15549 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a32ecd0 0x55919a3310f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 4 client.15549 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:35:52.113 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55919a21ef00 con 0x55919a32ecd0 2024-03-27T08:35:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.117+0000 7f7e84a00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a32ecd0 0x55919a3310f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.118+0000 7f7e84a00640 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a32ecd0 0x55919a3310f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=268c497bee285caf server_cookie=2ad570ef9a81bbc in_seq=0 out_seq=0 2024-03-27T08:35:52.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.118+0000 7f7e66000640 10 client.15549 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e66000640 1 -- 172.21.15.164:0/604622911 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55919a21ef00 con 0x55919a32ecd0 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e66000640 10 client.15549 handle_command_reply: tid=0 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 client.15549 shutdown 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 msgr2=0x55919a2c1430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c0105c0 tx=0x7f7e6c005850 comp rx=0 tx=0).stop 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 shutdown_connections 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55919a32ecd0 0x55919a3310f0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55919a2b8420 0x55919a32c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55919a2b32b0 0x55919a2c1430 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e66000640 0 client.15549 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 --2- 172.21.15.164:0/604622911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55919a2b28c0 0x55919a2c0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 >> 172.21.15.164:0/604622911 conn(0x55919a2ade30 msgr2=0x55919a2b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 shutdown_connections 2024-03-27T08:35:52.115 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 1 -- 172.21.15.164:0/604622911 wait complete. 2024-03-27T08:35:52.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.119+0000 7f7e8a174740 20 client.15549 trim_cache size 0 max 16384 2024-03-27T08:35:52.116 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 msgr2=0x7f7e680a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 0x7f7e680a5ad0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7e6c005fd0 tx=0x7f7e6c005e50 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 msgr2=0x7f7e801a1600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f7e7802c630 tx=0x7f7e78032900 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 shutdown_connections 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7e680a3610 0x7f7e680a5ad0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7e80105940 0x7f7e801a1600 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7e80104f80 0x7f7e8019a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 --2- 172.21.15.164:0/3131685109 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7e80103d90 0x7f7e8019a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 >> 172.21.15.164:0/3131685109 conn(0x7f7e800ff300 msgr2=0x7f7e80108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 shutdown_connections 2024-03-27T08:35:52.117 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:52.120+0000 7f7e87400640 1 -- 172.21.15.164:0/3131685109 wait complete. 2024-03-27T08:35:52.504 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:52 smithi164 ceph-mon[31788]: pgmap v457: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T08:35:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:52 smithi167 ceph-mon[34903]: pgmap v457: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T08:35:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:52 smithi173 ceph-mon[35397]: pgmap v457: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 170 B/s wr, 6 op/s 2024-03-27T08:35:53.130 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T08:35:53.130 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:35:53.130 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T08:35:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 -- 172.21.15.164:0/783382722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 msgr2=0x7f96b4078990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 --2- 172.21.15.164:0/783382722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b4078990 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f96ac009ca0 tx=0x7f96ac02c0f0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 -- 172.21.15.164:0/783382722 shutdown_connections 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 --2- 172.21.15.164:0/783382722 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b4078990 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 --2- 172.21.15.164:0/783382722 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 0x7f96b4077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 --2- 172.21.15.164:0/783382722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 0x7f96b4076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 -- 172.21.15.164:0/783382722 >> 172.21.15.164:0/783382722 conn(0x7f96b40ff300 msgr2=0x7f96b4101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 -- 172.21.15.164:0/783382722 shutdown_connections 2024-03-27T08:35:53.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.361+0000 7f96bc400640 1 -- 172.21.15.164:0/783382722 wait complete. 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.362+0000 7f96bc400640 1 Processor -- start 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.362+0000 7f96bc400640 1 -- start start 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 0x7f96b419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 0x7f96b419e970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4113df0 con 0x7f96b40780f0 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4113c70 con 0x7f96b4076510 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96bc400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96b4113f70 con 0x7f96b4077750 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41798/0 (socket says 172.21.15.164:41798) 2024-03-27T08:35:53.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 -- 172.21.15.164:0/1525553654 learned_addr learned my addr 172.21.15.164:0/1525553654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96b9000640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 0x7f96b419e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 0x7f96b419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 -- 172.21.15.164:0/1525553654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 msgr2=0x7f96b419e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 0x7f96b419e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 -- 172.21.15.164:0/1525553654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 msgr2=0x7f96b419e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 0x7f96b419e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.363+0000 7f96ba400640 1 -- 172.21.15.164:0/1525553654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96b41a6050 con 0x7f96b40780f0 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96ba400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f96ac02c630 tx=0x7f96ac032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96b2000640 1 -- 172.21.15.164:0/1525553654 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac039050 con 0x7f96b40780f0 2024-03-27T08:35:53.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96b2000640 1 -- 172.21.15.164:0/1525553654 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96ac03a040 con 0x7f96b40780f0 2024-03-27T08:35:53.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96b41a62e0 con 0x7f96b40780f0 2024-03-27T08:35:53.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96b2000640 1 -- 172.21.15.164:0/1525553654 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac040450 con 0x7f96b40780f0 2024-03-27T08:35:53.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.364+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96b41a67d0 con 0x7f96b40780f0 2024-03-27T08:35:53.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.367+0000 7f96b2000640 1 -- 172.21.15.164:0/1525553654 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f96ac003b70 con 0x7f96b40780f0 2024-03-27T08:35:53.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.367+0000 7f96bf1cf740 1 Processor -- start 2024-03-27T08:35:53.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 -- start start 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c36a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36b0d0 0x562b1c36b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562b1c2cf280 con 0x562b1c36ba90 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562b1c2776f0 con 0x562b1c36b0d0 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562b1c2cb230 con 0x562b1c369f00 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96b9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96b9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41806/0 (socket says 172.21.15.164:41806) 2024-03-27T08:35:53.362 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96b9000640 1 -- 172.21.15.164:0/3015663695 learned_addr learned my addr 172.21.15.164:0/3015663695 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.368+0000 7f96b9a00640 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36b0d0 0x562b1c36b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c36a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 -- 172.21.15.164:0/3015663695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 msgr2=0x562b1c36a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c36a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 -- 172.21.15.164:0/3015663695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36b0d0 msgr2=0x562b1c36b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36b0d0 0x562b1c36b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 -- 172.21.15.164:0/3015663695 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1c0ab7e0 con 0x562b1c36ba90 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b2000640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 0x7f96980a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9000640 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f96a00058c0 tx=0x7f96a000c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bfacc2a6cfb2f53 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b2000640 1 -- 172.21.15.164:0/1525553654 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96ac0f29a0 con 0x7f96b40780f0 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 0x7f96980a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96aaa00640 1 -- 172.21.15.164:0/3015663695 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0019030 con 0x562b1c36ba90 2024-03-27T08:35:53.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96aaa00640 1 -- 172.21.15.164:0/3015663695 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a00054f0 con 0x562b1c36ba90 2024-03-27T08:35:53.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.369+0000 7f96aaa00640 1 -- 172.21.15.164:0/3015663695 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011780 con 0x562b1c36ba90 2024-03-27T08:35:53.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3015663695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 msgr2=0x562b1c372320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f96a00058c0 tx=0x7f96a000c6b0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 0x7f96980a5ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009c40 tx=0x7f96a4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3015663695 shutdown_connections 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c372320 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36b0d0 0x562b1c36b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3015663695 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c36a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3015663695 >> 172.21.15.164:0/3015663695 conn(0x562b1c3652f0 msgr2=0x562b1c3656f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3015663695 shutdown_connections 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.370+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3015663695 wait complete. 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 -- start start 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 Processor -- start 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c369f00 0x562b1c3744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c3749f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562b1c372aa0 con 0x562b1c36ba90 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562b1c28aaa0 con 0x562b1c369f00 2024-03-27T08:35:53.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562b1c372c20 con 0x562b1c36b0d0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.371+0000 7f96bf1cf740 10 client.0 _ll_register_callbacks cb 0x562b1c28a490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41820/0 (socket says 172.21.15.164:41820) 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 -- 172.21.15.164:0/1295152030 learned_addr learned my addr 172.21.15.164:0/1295152030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c369f00 0x562b1c3744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96b9000640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c3749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 -- 172.21.15.164:0/1295152030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 msgr2=0x562b1c3749f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c3749f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 -- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c369f00 msgr2=0x562b1c3744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c369f00 0x562b1c3744b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 -- 172.21.15.164:0/1295152030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b1c10bf70 con 0x562b1c36ba90 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f96ba400640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0323f0 tx=0x7f96ac0be960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b8f8f610de2df7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.372+0000 7f969f400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac0bf520 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96ac0bb490 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a00054f0 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96ac0bee20 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 10 client.15561 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562b1bfa3170 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a00054f0 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f96ac0c7600 con 0x562b1c36ba90 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 10 client.15561 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 20 client.15561 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3802a0 0x562b1c382740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 4 client.15561 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:53.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.373+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b1c2dc7c0 con 0x562b1c3802a0 2024-03-27T08:35:53.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.374+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3802a0 0x562b1c382740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.375+0000 7f96b9a00640 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3802a0 0x562b1c382740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6ae54216373ecb3 server_cookie=9878ede9f4b733e in_seq=0 out_seq=0 2024-03-27T08:35:53.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.375+0000 7f969f400640 10 client.15561 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f969f400640 1 -- 172.21.15.164:0/1295152030 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562b1c2dc7c0 con 0x562b1c3802a0 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f969f400640 10 client.15561 handle_command_reply: tid=0 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 client.15561 shutdown 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 msgr2=0x562b1c37ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f96ac0323f0 tx=0x7f96ac0be960 comp rx=0 tx=0).stop 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 shutdown_connections 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3802a0 0x562b1c382740 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36ba90 0x562b1c37ba30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c3749f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/1295152030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c369f00 0x562b1c3744b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f969f400640 0 client.15561 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 >> 172.21.15.164:0/1295152030 conn(0x562b1c3652f0 msgr2=0x562b1c364550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 shutdown_connections 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 1 -- 172.21.15.164:0/1295152030 wait complete. 2024-03-27T08:35:53.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.377+0000 7f96bf1cf740 20 client.15561 trim_cache size 0 max 16384 2024-03-27T08:35:53.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.396+0000 7f96bf1cf740 1 Processor -- start 2024-03-27T08:35:53.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.396+0000 7f96bf1cf740 1 -- start start 2024-03-27T08:35:53.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c368c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c387040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41b1e30 con 0x562b1c36b0d0 2024-03-27T08:35:53.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41af700 con 0x562b1c36ba90 2024-03-27T08:35:53.390 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41ad550 con 0x562b1c369f00 2024-03-27T08:35:53.391 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41824/0 (socket says 172.21.15.164:41824) 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 -- 172.21.15.164:0/780928393 learned_addr learned my addr 172.21.15.164:0/780928393 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96ba400640 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c387040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9a00640 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c368c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 -- 172.21.15.164:0/780928393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 msgr2=0x562b1c368c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c368c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 -- 172.21.15.164:0/780928393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 msgr2=0x562b1c387040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c387040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.397+0000 7f96b9000640 1 -- 172.21.15.164:0/780928393 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b1c382dc0 con 0x562b1c36b0d0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.398+0000 7f96b9000640 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f96a0015ff0 tx=0x7f96a000cef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a109e6f19e0d08af server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.398+0000 7f96aa000640 1 -- 172.21.15.164:0/780928393 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0019040 con 0x562b1c36b0d0 2024-03-27T08:35:53.392 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.398+0000 7f96aa000640 1 -- 172.21.15.164:0/780928393 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a0004680 con 0x562b1c36b0d0 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.398+0000 7f96aa000640 1 -- 172.21.15.164:0/780928393 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a0011810 con 0x562b1c36b0d0 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- 172.21.15.164:0/780928393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 msgr2=0x562b1c37b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f96a0015ff0 tx=0x7f96a000cef0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- 172.21.15.164:0/780928393 shutdown_connections 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c387040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c36b0d0 0x562b1c37b9f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/780928393 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c369f00 0x562b1c368c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- 172.21.15.164:0/780928393 >> 172.21.15.164:0/780928393 conn(0x562b1c3652f0 msgr2=0x562b1c368550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- 172.21.15.164:0/780928393 shutdown_connections 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- 172.21.15.164:0/780928393 wait complete. 2024-03-27T08:35:53.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 -- start start 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.399+0000 7f96bf1cf740 1 Processor -- start 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c378bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c3e6680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41adbc0 con 0x562b1c369f00 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41af030 con 0x562b1c36ba90 2024-03-27T08:35:53.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96b41ae290 con 0x562b1c36b0d0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96bf1cf740 10 client.0 _ll_register_callbacks cb 0x7f96ac0bb0c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41840/0 (socket says 172.21.15.164:41840) 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 -- 172.21.15.164:0/3157622595 learned_addr learned my addr 172.21.15.164:0/3157622595 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96ba400640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c3e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9000640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c378bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 -- 172.21.15.164:0/3157622595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 msgr2=0x562b1c378bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c378bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 -- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 msgr2=0x562b1c3e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c3e6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.400+0000 7f96b9a00640 1 -- 172.21.15.164:0/3157622595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b1c37bc90 con 0x562b1c369f00 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f96b9a00640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562b1c382ff0 tx=0x7f96a4015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15364e60ebcea273 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f969f400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a4020e20 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96a4004020 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a0004680 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f96a4004220 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f96bf1cf740 10 client.15567 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.401+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x562b1c3e7c40 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a0004680 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f96ac004040 con 0x562b1c369f00 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 10 client.15567 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 10 client.15567 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 20 client.15567 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:53.398 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3e8670 0x562b1c3eaa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 4 client.15567 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T08:35:53.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x562b1c2d6b10 con 0x562b1c3e8670 2024-03-27T08:35:53.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.402+0000 7f96b9000640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3e8670 0x562b1c3eaa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.403+0000 7f96b9000640 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3e8670 0x562b1c3eaa90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bbebaee7ecb68bc server_cookie=708246d7afea7c71 in_seq=0 out_seq=0 2024-03-27T08:35:53.399 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.403+0000 7f969f400640 10 client.15567 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f969f400640 1 -- 172.21.15.164:0/3157622595 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x562b1c2d6b10 con 0x562b1c3e8670 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f969f400640 10 client.15567 handle_command_reply: tid=0 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 client.15567 shutdown 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 msgr2=0x562b1c378680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x562b1c382ff0 tx=0x7f96a4015040 comp rx=0 tx=0).stop 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 shutdown_connections 2024-03-27T08:35:53.400 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562b1c3e8670 0x562b1c3eaa90 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b1c36ba90 0x562b1c3e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562b1c36b0d0 0x562b1c378bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.406+0000 7f969f400640 0 client.15567 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bf1cf740 1 --2- 172.21.15.164:0/3157622595 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562b1c369f00 0x562b1c378680 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 >> 172.21.15.164:0/3157622595 conn(0x562b1c3652f0 msgr2=0x562b1c368de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 shutdown_connections 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bf1cf740 1 -- 172.21.15.164:0/3157622595 wait complete. 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bf1cf740 20 client.15567 trim_cache size 0 max 16384 2024-03-27T08:35:53.401 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:53.402 INFO:teuthology.orchestra.run.smithi164.stdout: "return_code": 0, 2024-03-27T08:35:53.402 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_tag": "74da5b57-6eab-4c90-83a1-aab5f82fe4ca", 2024-03-27T08:35:53.402 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": "asynchronous" 2024-03-27T08:35:53.402 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:53.402 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 msgr2=0x7f96980a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 0x7f96980a5ad0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f96a4009c40 tx=0x7f96a4005f90 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.407+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 msgr2=0x7f96b41a59e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f96ac02c630 tx=0x7f96ac032900 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 shutdown_connections 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96980a3610 0x7f96980a5ad0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96b40780f0 0x7f96b41a59e0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96b4077750 0x7f96b419e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 --2- 172.21.15.164:0/1525553654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96b4076510 0x7f96b419e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 >> 172.21.15.164:0/1525553654 conn(0x7f96b40ff300 msgr2=0x7f96b41009f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 shutdown_connections 2024-03-27T08:35:53.403 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.408+0000 7f96bc400640 1 -- 172.21.15.164:0/1525553654 wait complete. 2024-03-27T08:35:53.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:35:53.419 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:35:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 -- 172.21.15.164:0/3952451645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 msgr2=0x7f84a8104190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.634 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 --2- 172.21.15.164:0/3952451645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a8104190 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f849c009900 tx=0x7f849c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 -- 172.21.15.164:0/3952451645 shutdown_connections 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 --2- 172.21.15.164:0/3952451645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8105920 0x7f84a810c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 --2- 172.21.15.164:0/3952451645 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8104f60 0x7f84a81053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 --2- 172.21.15.164:0/3952451645 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a8104190 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 -- 172.21.15.164:0/3952451645 >> 172.21.15.164:0/3952451645 conn(0x7f84a80ff300 msgr2=0x7f84a8101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 -- 172.21.15.164:0/3952451645 shutdown_connections 2024-03-27T08:35:53.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.641+0000 7f84afa00640 1 -- 172.21.15.164:0/3952451645 wait complete. 2024-03-27T08:35:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.642+0000 7f84afa00640 1 Processor -- start 2024-03-27T08:35:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.642+0000 7f84afa00640 1 -- start start 2024-03-27T08:35:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8104f60 0x7f84a819e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.637 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 0x7f84a81a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810fa20 con 0x7f84a8103d70 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810f8a0 con 0x7f84a8104f60 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84afa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84a810fba0 con 0x7f84a8105920 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41858/0 (socket says 172.21.15.164:41858) 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84ad000640 1 -- 172.21.15.164:0/4123867008 learned_addr learned my addr 172.21.15.164:0/4123867008 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84a7e00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8104f60 0x7f84a819e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.643+0000 7f84ada00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 0x7f84a81a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 -- 172.21.15.164:0/4123867008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 msgr2=0x7f84a81a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 0x7f84a81a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 -- 172.21.15.164:0/4123867008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8104f60 msgr2=0x7f84a819e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8104f60 0x7f84a819e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 -- 172.21.15.164:0/4123867008 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84a81a6090 con 0x7f84a8103d70 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ada00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 0x7f84a81a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84ad000640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f849c000c00 tx=0x7f849c004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84a5600640 1 -- 172.21.15.164:0/4123867008 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c043020 con 0x7f84a8103d70 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84a5600640 1 -- 172.21.15.164:0/4123867008 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f849c005460 con 0x7f84a8103d70 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84a5600640 1 -- 172.21.15.164:0/4123867008 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c003d00 con 0x7f84a8103d70 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.644+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84a81a6320 con 0x7f84a8103d70 2024-03-27T08:35:53.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.646+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84a81a68c0 con 0x7f84a8103d70 2024-03-27T08:35:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84a5600640 1 -- 172.21.15.164:0/4123867008 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f849c046020 con 0x7f84a8103d70 2024-03-27T08:35:53.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 Processor -- start 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 -- start start 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d668d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d6e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7ccc6b0 con 0x55d2b7d66ea0 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7c74750 con 0x55d2b7d664b0 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.648+0000 7f84b277e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7cc8660 con 0x55d2b7d6c010 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41864/0 (socket says 172.21.15.164:41864) 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 -- 172.21.15.164:0/685806442 learned_addr learned my addr 172.21.15.164:0/685806442 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ada00640 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d668d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84a7e00640 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d6e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.642 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 -- 172.21.15.164:0/685806442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 msgr2=0x55d2b7d6e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d6e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 -- 172.21.15.164:0/685806442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 msgr2=0x55d2b7d668d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d668d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 -- 172.21.15.164:0/685806442 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b7aaa7d0 con 0x55d2b7d66ea0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84a5600640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 0x7f84900a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.649+0000 7f84ad000640 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f849c0f5e70 tx=0x7f849c0f5f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c43123f1dbb3a81 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.650+0000 7f849a000640 1 -- 172.21.15.164:0/685806442 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0ba680 con 0x55d2b7d66ea0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.650+0000 7f84a5600640 1 -- 172.21.15.164:0/4123867008 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f849c0f1f60 con 0x7f84a8103d70 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.650+0000 7f84ada00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 0x7f84900a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.650+0000 7f849a000640 1 -- 172.21.15.164:0/685806442 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f849c0ff070 con 0x55d2b7d66ea0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.650+0000 7f849a000640 1 -- 172.21.15.164:0/685806442 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0bdd40 con 0x55d2b7d66ea0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- 172.21.15.164:0/685806442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 msgr2=0x55d2b7d6b9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f849c0f5e70 tx=0x7f849c0f5f60 comp rx=0 tx=0).stop 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84ada00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 0x7f84900a5b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55d2b7d67700 tx=0x7f84a0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- 172.21.15.164:0/685806442 shutdown_connections 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d6e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d6b9a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 --2- 172.21.15.164:0/685806442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d668d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- 172.21.15.164:0/685806442 >> 172.21.15.164:0/685806442 conn(0x55d2b7d61a20 msgr2=0x55d2b7d61e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- 172.21.15.164:0/685806442 shutdown_connections 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- 172.21.15.164:0/685806442 wait complete. 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 -- start start 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.651+0000 7f84b277e740 1 Processor -- start 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d664b0 0x55d2b7d706c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d70c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7d6ed80 con 0x55d2b7d6c010 2024-03-27T08:35:53.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7c87a80 con 0x55d2b7d66ea0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2b7d6ef00 con 0x55d2b7d664b0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84b277e740 10 client.0 _ll_register_callbacks cb 0x55d2b7c87470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84ada00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84ada00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41874/0 (socket says 172.21.15.164:41874) 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84ada00640 1 -- 172.21.15.164:0/2227386007 learned_addr learned my addr 172.21.15.164:0/2227386007 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84a7e00640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d70c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.652+0000 7f84ad000640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d664b0 0x55d2b7d706c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 -- 172.21.15.164:0/2227386007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d664b0 msgr2=0x55d2b7d706c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d664b0 0x55d2b7d706c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 -- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 msgr2=0x55d2b7d70c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d70c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 -- 172.21.15.164:0/2227386007 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b79e03f0 con 0x55d2b7d6c010 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84ada00640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84a00094b0 tx=0x7f84a0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32975511904742c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f848ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a002c060 con 0x55d2b7d6c010 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f84a0017030 con 0x55d2b7d6c010 2024-03-27T08:35:53.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.653+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f849c0ff070 con 0x55d2b7d6c010 2024-03-27T08:35:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84a001fb90 con 0x55d2b7d6c010 2024-03-27T08:35:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 10 client.15579 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d2b79a00f0 con 0x55d2b7d6c010 2024-03-27T08:35:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f849c0ff070 con 0x55d2b7d6c010 2024-03-27T08:35:53.651 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f84a001c3f0 con 0x55d2b7d6c010 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 10 client.15579 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 20 client.15579 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7d7c620 0x55d2b7d7eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 4 client.15579 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.654+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2b7cd9bf0 con 0x55d2b7d7c620 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.655+0000 7f84ad000640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7d7c620 0x55d2b7d7eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.655+0000 7f84ad000640 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7d7c620 0x55d2b7d7eaa0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3bea34ca2ab9f1b server_cookie=60e1ae19fd554d23 in_seq=0 out_seq=0 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.655+0000 7f848ea00640 10 client.15579 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f848ea00640 1 -- 172.21.15.164:0/2227386007 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d2b7cd9bf0 con 0x55d2b7d7c620 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f848ea00640 10 client.15579 handle_command_reply: tid=0 2024-03-27T08:35:53.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 client.15579 shutdown 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 msgr2=0x55d2b7d77c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f84a00094b0 tx=0x7f84a0004ab0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 shutdown_connections 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7d7c620 0x55d2b7d7eaa0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d6c010 0x55d2b7d77c40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d70c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 --2- 172.21.15.164:0/2227386007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d664b0 0x55d2b7d706c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f848ea00640 0 client.15579 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 >> 172.21.15.164:0/2227386007 conn(0x55d2b7d61a20 msgr2=0x55d2b7d60c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 shutdown_connections 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 1 -- 172.21.15.164:0/2227386007 wait complete. 2024-03-27T08:35:53.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.658+0000 7f84b277e740 20 client.15579 trim_cache size 0 max 16384 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 Processor -- start 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 -- start start 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d77c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d60390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81b1ed0 con 0x55d2b7d664b0 2024-03-27T08:35:53.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81af7a0 con 0x55d2b7d66ea0 2024-03-27T08:35:53.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84b277e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81ad5f0 con 0x55d2b7d6c010 2024-03-27T08:35:53.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.676+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.678 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d77c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41888/0 (socket says 172.21.15.164:41888) 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 -- 172.21.15.164:0/440508105 learned_addr learned my addr 172.21.15.164:0/440508105 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ada00640 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d60390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 -- 172.21.15.164:0/440508105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 msgr2=0x55d2b7d60390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d60390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 -- 172.21.15.164:0/440508105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 msgr2=0x55d2b7d77c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d77c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 -- 172.21.15.164:0/440508105 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2b7d62790 con 0x55d2b7d664b0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.677+0000 7f84ad000640 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f849c02c210 tx=0x7f849c0ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=849f0d32b9bcfbad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f8499600640 1 -- 172.21.15.164:0/440508105 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0bdf20 con 0x55d2b7d664b0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f8499600640 1 -- 172.21.15.164:0/440508105 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f849c0ff040 con 0x55d2b7d664b0 2024-03-27T08:35:53.679 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f8499600640 1 -- 172.21.15.164:0/440508105 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f849c0be1b0 con 0x55d2b7d664b0 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 -- 172.21.15.164:0/440508105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 msgr2=0x55d2b7d5ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f849c02c210 tx=0x7f849c0ba040 comp rx=0 tx=0).stop 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 -- 172.21.15.164:0/440508105 shutdown_connections 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d60390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d77c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 --2- 172.21.15.164:0/440508105 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d664b0 0x55d2b7d5ca80 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 -- 172.21.15.164:0/440508105 >> 172.21.15.164:0/440508105 conn(0x55d2b7d61a20 msgr2=0x55d2b7d683a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 -- 172.21.15.164:0/440508105 shutdown_connections 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.678+0000 7f84b277e740 1 -- 172.21.15.164:0/440508105 wait complete. 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 -- start start 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 Processor -- start 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d75270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d76770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81adc60 con 0x55d2b7d66ea0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81af0d0 con 0x55d2b7d664b0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f84a81ae330 con 0x55d2b7d6c010 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.679+0000 7f84b277e740 10 client.0 _ll_register_callbacks cb 0x7f84a00109c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41890/0 (socket says 172.21.15.164:41890) 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 -- 172.21.15.164:0/4213183279 learned_addr learned my addr 172.21.15.164:0/4213183279 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84ad000640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d75270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84ada00640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d76770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 -- 172.21.15.164:0/4213183279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 msgr2=0x55d2b7d76770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d76770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 -- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 msgr2=0x55d2b7d75270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:53.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d75270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 -- 172.21.15.164:0/4213183279 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2b7d76d60 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f84a7e00640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8494005d00 tx=0x7f8494011b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68529ba3ed879ca9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.680+0000 7f848ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8494004020 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f849c0ff040 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f84940041c0 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f84940043c0 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f84b277e740 10 client.15585 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d2b7de2a00 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.681+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f849c0ff040 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8494005440 con 0x55d2b7d66ea0 2024-03-27T08:35:53.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 10 client.15585 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 10 client.15585 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 20 client.15585 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7de3430 0x55d2b7de5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 4 client.15585 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d2b7cd3f40 con 0x55d2b7de3430 2024-03-27T08:35:53.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.682+0000 7f84ad000640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7de3430 0x55d2b7de5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.683+0000 7f848ea00640 10 client.15585 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.683+0000 7f84ad000640 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7de3430 0x55d2b7de5850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d82132597686818 server_cookie=c31c001dba2a79a6 in_seq=0 out_seq=0 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.683+0000 7f848ea00640 1 -- 172.21.15.164:0/4213183279 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d2b7cd3f40 con 0x55d2b7de3430 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.683+0000 7f848ea00640 10 client.15585 handle_command_reply: tid=0 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.683+0000 7f84b277e740 1 client.15585 shutdown 2024-03-27T08:35:53.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 msgr2=0x55d2b7d757b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f8494005d00 tx=0x7f8494011b50 comp rx=0 tx=0).stop 2024-03-27T08:35:53.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 shutdown_connections 2024-03-27T08:35:53.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2b7de3430 0x55d2b7de5850 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2b7d6c010 0x55d2b7d76770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2b7d66ea0 0x55d2b7d757b0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 --2- 172.21.15.164:0/4213183279 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2b7d664b0 0x55d2b7d75270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f848ea00640 0 client.15585 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 >> 172.21.15.164:0/4213183279 conn(0x55d2b7d61a20 msgr2=0x55d2b7d64c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 shutdown_connections 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 1 -- 172.21.15.164:0/4213183279 wait complete. 2024-03-27T08:35:53.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.684+0000 7f84b277e740 20 client.15585 trim_cache size 0 max 16384 2024-03-27T08:35:53.687 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:35:53.687 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": { 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: "74da5b57-6eab-4c90-83a1-aab5f82fe4ca": { 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/", 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: "tag": "74da5b57-6eab-4c90-83a1-aab5f82fe4ca", 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: "options": "recursive,force" 2024-03-27T08:35:53.688 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:35:53.689 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:35:53.689 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 msgr2=0x7f84900a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 0x7f84900a5b50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55d2b7d67700 tx=0x7f84a0009500 comp rx=0 tx=0).stop 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 msgr2=0x7f84a819e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f849c000c00 tx=0x7f849c004e20 comp rx=0 tx=0).stop 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 shutdown_connections 2024-03-27T08:35:53.690 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f84900a3690 0x7f84900a5b50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f84a8105920 0x7f84a81a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f84a8104f60 0x7f84a819e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 --2- 172.21.15.164:0/4123867008 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f84a8103d70 0x7f84a819e470 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 >> 172.21.15.164:0/4123867008 conn(0x7f84a80ff300 msgr2=0x7f84a8077fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 shutdown_connections 2024-03-27T08:35:53.691 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:35:53.685+0000 7f84afa00640 1 -- 172.21.15.164:0/4123867008 wait complete. 2024-03-27T08:35:53.695 INFO:tasks.cephfs.filesystem:scrub status for tag:74da5b57-6eab-4c90-83a1-aab5f82fe4ca - {'path': '/', 'tag': '74da5b57-6eab-4c90-83a1-aab5f82fe4ca', 'options': 'recursive,force'} 2024-03-27T08:35:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:54 smithi164 ceph-mon[31788]: pgmap v458: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:54 smithi164 ceph-mon[31788]: scrub queued for path: / 2024-03-27T08:35:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:54 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:54.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:54 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:35:54.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:54 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:54.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:54 smithi167 ceph-mon[34903]: pgmap v458: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:54.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:54 smithi167 ceph-mon[34903]: scrub queued for path: / 2024-03-27T08:35:54.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:54 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:54.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:54 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:35:54.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:54 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:54 smithi173 ceph-mon[35397]: pgmap v458: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:54 smithi173 ceph-mon[35397]: scrub queued for path: / 2024-03-27T08:35:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:54 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:54 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:35:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:54 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:35:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:56 smithi164 ceph-mon[31788]: pgmap v459: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:56.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:56 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:35:56.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:56 smithi167 ceph-mon[34903]: pgmap v459: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:56.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:56 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:35:56.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:56 smithi173 ceph-mon[35397]: pgmap v459: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:35:56.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:56 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:35:58.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:35:58 smithi164 ceph-mon[31788]: pgmap v460: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:35:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:35:58 smithi167 ceph-mon[34903]: pgmap v460: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:35:58.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:35:58 smithi173 ceph-mon[35397]: pgmap v460: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 -- 172.21.15.164:0/3668637806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 msgr2=0x7f1494104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 --2- 172.21.15.164:0/3668637806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494104810 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1484009900 tx=0x7f148402bc50 comp rx=0 tx=0).stop 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 -- 172.21.15.164:0/3668637806 shutdown_connections 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 --2- 172.21.15.164:0/3668637806 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494107680 0x7f1494109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 --2- 172.21.15.164:0/3668637806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494104d50 0x7f1494107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 --2- 172.21.15.164:0/3668637806 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494104810 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 -- 172.21.15.164:0/3668637806 >> 172.21.15.164:0/3668637806 conn(0x7f14940fbe30 msgr2=0x7f14940fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 -- 172.21.15.164:0/3668637806 shutdown_connections 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.608+0000 7f149a200640 1 -- 172.21.15.164:0/3668637806 wait complete. 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.609+0000 7f149a200640 1 Processor -- start 2024-03-27T08:35:59.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.609+0000 7f149a200640 1 -- start start 2024-03-27T08:35:59.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 0x7f149419a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494107680 0x7f14941a1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f1494100950 con 0x7f1494102420 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14941007d0 con 0x7f1494107680 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f149a200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f1494100ad0 con 0x7f1494104d50 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58558/0 (socket says 172.21.15.164:58558) 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 -- 172.21.15.164:0/953881762 learned_addr learned my addr 172.21.15.164:0/953881762 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1499800640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494107680 0x7f14941a1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f148be00640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 0x7f149419a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 -- 172.21.15.164:0/953881762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 msgr2=0x7f149419a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 0x7f149419a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 -- 172.21.15.164:0/953881762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494107680 msgr2=0x7f14941a1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494107680 0x7f14941a1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f1498e00640 1 -- 172.21.15.164:0/953881762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14941a1af0 con 0x7f1494102420 2024-03-27T08:35:59.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.610+0000 7f148be00640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 0x7f149419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f1498e00640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f148402efd0 tx=0x7f1484004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f1492000640 1 -- 172.21.15.164:0/953881762 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484041070 con 0x7f1494102420 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14941a1d80 con 0x7f1494102420 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f1492000640 1 -- 172.21.15.164:0/953881762 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f14840044d0 con 0x7f1494102420 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f1492000640 1 -- 172.21.15.164:0/953881762 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1484034440 con 0x7f1494102420 2024-03-27T08:35:59.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.611+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14941a2200 con 0x7f1494102420 2024-03-27T08:35:59.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.614+0000 7f149e60b740 1 Processor -- start 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 -- start start 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b031550 0x561a3b036050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b038b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561a3af95d10 con 0x561a3b031550 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a3af3e260 con 0x561a3b0366c0 2024-03-27T08:35:59.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f149e60b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561a3af91cc0 con 0x561a3b030b60 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.615+0000 7f1499800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f1499800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:50414/0 (socket says 172.21.15.164:50414) 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f1499800640 1 -- 172.21.15.164:0/2515577575 learned_addr learned my addr 172.21.15.164:0/2515577575 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b038b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f1492000640 1 -- 172.21.15.164:0/953881762 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f1484044070 con 0x7f1494102420 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 -- 172.21.15.164:0/2515577575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 msgr2=0x561a3b030f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 -- 172.21.15.164:0/2515577575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b031550 msgr2=0x561a3b036050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T08:35:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b031550 0x561a3b036050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.616+0000 7f148be00640 1 -- 172.21.15.164:0/2515577575 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a3af35aa0 con 0x561a3b0366c0 2024-03-27T08:35:59.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.617+0000 7f1499800640 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.617+0000 7f148be00640 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b038b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1494069d30 tx=0x7f147c00e2f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9394060b67e404bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.617+0000 7f148a000640 1 -- 172.21.15.164:0/2515577575 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c016070 con 0x561a3b0366c0 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.617+0000 7f148a000640 1 -- 172.21.15.164:0/2515577575 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f147c0054f0 con 0x561a3b0366c0 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.617+0000 7f148a000640 1 -- 172.21.15.164:0/2515577575 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147c011470 con 0x561a3b0366c0 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f1492000640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 0x7f14780a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f1492000640 1 -- 172.21.15.164:0/953881762 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f14840f1a60 con 0x7f1494102420 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f1499800640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 0x7f14780a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 -- 172.21.15.164:0/2515577575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 msgr2=0x561a3b038b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b038b50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f1494069d30 tx=0x7f147c00e2f0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 -- 172.21.15.164:0/2515577575 shutdown_connections 2024-03-27T08:35:59.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b038b50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b031550 0x561a3b036050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 --2- 172.21.15.164:0/2515577575 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b030b60 0x561a3b030f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.618+0000 7f149e60b740 1 -- 172.21.15.164:0/2515577575 >> 172.21.15.164:0/2515577575 conn(0x561a3b02c0d0 msgr2=0x561a3b02c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.619+0000 7f149e60b740 1 -- 172.21.15.164:0/2515577575 shutdown_connections 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.619+0000 7f1499800640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 0x7f14780a5ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x561a3b031db0 tx=0x7f148c0097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.619+0000 7f149e60b740 1 -- 172.21.15.164:0/2515577575 wait complete. 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.619+0000 7f149e60b740 1 -- start start 2024-03-27T08:35:59.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.619+0000 7f149e60b740 1 Processor -- start 2024-03-27T08:35:59.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b03b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b0423e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561a3b039670 con 0x561a3b030b60 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a3af51630 con 0x561a3b0366c0 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561a3b0397f0 con 0x561a3b031550 2024-03-27T08:35:59.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f149e60b740 10 client.0 _ll_register_callbacks cb 0x561a3af56c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58574/0 (socket says 172.21.15.164:58574) 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 -- 172.21.15.164:0/1664811172 learned_addr learned my addr 172.21.15.164:0/1664811172 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1499800640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b0423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f148be00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b03b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 -- 172.21.15.164:0/1664811172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 msgr2=0x561a3b03b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b03b410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 -- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 msgr2=0x561a3b0423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b0423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1498e00640 1 -- 172.21.15.164:0/1664811172 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a3af5d5f0 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f1499800640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b0423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.620+0000 7f148be00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b03b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1498e00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14840bded0 tx=0x7f14840bdd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc4df61dd37e539c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1482a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148404b040 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f14840c6720 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f147c0054f0 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f14840be640 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f149e60b740 10 client.15594 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561a3acaa210 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.621+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f147c0054f0 con 0x561a3b030b60 2024-03-27T08:35:59.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f14840d7140 con 0x561a3b030b60 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 10 client.15594 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 20 client.15594 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b046d00 0x561a3b049190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 4 client.15594 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a3afa3250 con 0x561a3b046d00 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.622+0000 7f148be00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b046d00 0x561a3b049190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.623+0000 7f1482a00640 10 client.15594 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:59.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.623+0000 7f148be00640 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b046d00 0x561a3b049190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=30c7002b6e9d0468 server_cookie=8ee9c4d56f4e845a in_seq=0 out_seq=0 2024-03-27T08:35:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f1482a00640 1 -- 172.21.15.164:0/1664811172 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561a3afa3250 con 0x561a3b046d00 2024-03-27T08:35:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f1482a00640 10 client.15594 handle_command_reply: tid=0 2024-03-27T08:35:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 client.15594 shutdown 2024-03-27T08:35:59.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 msgr2=0x561a3b03aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f14840bded0 tx=0x7f14840bdd10 comp rx=0 tx=0).stop 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 shutdown_connections 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b046d00 0x561a3b049190 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b0366c0 0x561a3b0423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b03b410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f1482a00640 0 client.15594 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 --2- 172.21.15.164:0/1664811172 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03aed0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 >> 172.21.15.164:0/1664811172 conn(0x561a3b02c0d0 msgr2=0x561a3b02b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 shutdown_connections 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.625+0000 7f149e60b740 1 -- 172.21.15.164:0/1664811172 wait complete. 2024-03-27T08:35:59.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.626+0000 7f149e60b740 20 client.15594 trim_cache size 0 max 16384 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.641+0000 7f149e60b740 1 Processor -- start 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.641+0000 7f149e60b740 1 -- start start 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.641+0000 7f149e60b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b030b60 0x561a3b02fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f149e60b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b0423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f149e60b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f149e60b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f14941ad890 con 0x561a3b0366c0 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f149e60b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14941ab160 con 0x561a3b030b60 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f149e60b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14941a8fb0 con 0x561a3b031550 2024-03-27T08:35:59.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58580/0 (socket says 172.21.15.164:58580) 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 -- 172.21.15.164:0/3080514560 learned_addr learned my addr 172.21.15.164:0/3080514560 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1498e00640 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b030b60 0x561a3b02fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f148be00640 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b0423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 -- 172.21.15.164:0/3080514560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 msgr2=0x561a3b0423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b0423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 -- 172.21.15.164:0/3080514560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b030b60 msgr2=0x561a3b02fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b030b60 0x561a3b02fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.642+0000 7f1499800640 1 -- 172.21.15.164:0/3080514560 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a3ad76620 con 0x561a3b0366c0 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.643+0000 7f1499800640 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f148c009d40 tx=0x7f148c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44353f9276eda469 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.643+0000 7f1489600640 1 -- 172.21.15.164:0/3080514560 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c01e7b0 con 0x561a3b0366c0 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.643+0000 7f1489600640 1 -- 172.21.15.164:0/3080514560 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f148c01ee20 con 0x561a3b0366c0 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.643+0000 7f1489600640 1 -- 172.21.15.164:0/3080514560 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f148c01fe40 con 0x561a3b0366c0 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- 172.21.15.164:0/3080514560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 msgr2=0x561a3b03aae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f148c009d40 tx=0x7f148c015000 comp rx=0 tx=0).stop 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- 172.21.15.164:0/3080514560 shutdown_connections 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b0366c0 0x561a3b03aae0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b031550 0x561a3b0423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.639 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 --2- 172.21.15.164:0/3080514560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b030b60 0x561a3b02fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- 172.21.15.164:0/3080514560 >> 172.21.15.164:0/3080514560 conn(0x561a3b02c0d0 msgr2=0x561a3b02f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- 172.21.15.164:0/3080514560 shutdown_connections 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- 172.21.15.164:0/3080514560 wait complete. 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 -- start start 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.644+0000 7f149e60b740 1 Processor -- start 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b031550 0x561a3b03f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b0366c0 0x561a3b0409e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f14941a9620 con 0x561a3b030b60 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14941aaa90 con 0x561a3b031550 2024-03-27T08:35:59.640 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f14941a9cf0 con 0x561a3b0366c0 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f149e60b740 10 client.0 _ll_register_callbacks cb 0x7f14840b9ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58590/0 (socket says 172.21.15.164:58590) 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 -- 172.21.15.164:0/3319163314 learned_addr learned my addr 172.21.15.164:0/3319163314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f148be00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b031550 0x561a3b03f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 -- 172.21.15.164:0/3319163314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b0366c0 msgr2=0x561a3b0409e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b0366c0 0x561a3b0409e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 -- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b031550 msgr2=0x561a3b03f9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b031550 0x561a3b03f9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.645+0000 7f1498e00640 1 -- 172.21.15.164:0/3319163314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a3b040fd0 con 0x561a3b030b60 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f1498e00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f14840096c0 tx=0x7f148402bc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de961773a5669857 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:35:59.641 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f1482a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14840db020 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f148c01ee20 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f14840bd390 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f148404b070 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f149e60b740 10 client.15600 fetch_fsmap learned FSMap version 24 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.646+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561a3b042350 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f148c01ee20 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f14840bce00 con 0x561a3b030b60 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 10 client.15600 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 20 client.15600 populate_metadata read hostname 'smithi164' 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b0ad320 0x561a3b0af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:35:59.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 4 client.15600 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:35:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561a3af9d5a0 con 0x561a3b0ad320 2024-03-27T08:35:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.647+0000 7f148be00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b0ad320 0x561a3b0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:35:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.648+0000 7f148be00640 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b0ad320 0x561a3b0af710 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=baaf10478bf217d9 server_cookie=f7850ec0a306d6d2 in_seq=0 out_seq=0 2024-03-27T08:35:59.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.648+0000 7f1482a00640 10 client.15600 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f1482a00640 1 -- 172.21.15.164:0/3319163314 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561a3af9d5a0 con 0x561a3b0ad320 2024-03-27T08:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f1482a00640 10 client.15600 handle_command_reply: tid=0 2024-03-27T08:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 client.15600 shutdown 2024-03-27T08:35:59.650 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 msgr2=0x561a3b03f490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f14840096c0 tx=0x7f148402bc50 comp rx=0 tx=0).stop 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 shutdown_connections 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x561a3b0ad320 0x561a3b0af710 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561a3b0366c0 0x561a3b0409e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a3b031550 0x561a3b03f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 --2- 172.21.15.164:0/3319163314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561a3b030b60 0x561a3b03f490 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f1482a00640 0 client.15600 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 >> 172.21.15.164:0/3319163314 conn(0x561a3b02c0d0 msgr2=0x561a3b02f330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.658+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 shutdown_connections 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149e60b740 1 -- 172.21.15.164:0/3319163314 wait complete. 2024-03-27T08:35:59.651 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149e60b740 20 client.15600 trim_cache size 0 max 16384 2024-03-27T08:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:35:59.652 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 msgr2=0x7f14780a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 0x7f14780a5ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x561a3b031db0 tx=0x7f148c0097e0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 msgr2=0x7f1494199ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f148402efd0 tx=0x7f1484004e90 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 shutdown_connections 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f14780a3600 0x7f14780a5ac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1494107680 0x7f14941a1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1494104d50 0x7f149419a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 --2- 172.21.15.164:0/953881762 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1494102420 0x7f1494199ed0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.659+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 >> 172.21.15.164:0/953881762 conn(0x7f14940fbe30 msgr2=0x7f1494106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.660+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 shutdown_connections 2024-03-27T08:35:59.653 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:35:59.660+0000 7f149a200640 1 -- 172.21.15.164:0/953881762 wait complete. 2024-03-27T08:36:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:00 smithi164 ceph-mon[31788]: pgmap v461: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:36:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:00 smithi167 ceph-mon[34903]: pgmap v461: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:36:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:00 smithi173 ceph-mon[35397]: pgmap v461: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-03-27T08:36:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:02 smithi164 ceph-mon[31788]: pgmap v462: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-27T08:36:02.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:02 smithi167 ceph-mon[34903]: pgmap v462: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-27T08:36:02.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:02 smithi173 ceph-mon[35397]: pgmap v462: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-03-27T08:36:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:04 smithi164 ceph-mon[31788]: pgmap v463: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-27T08:36:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:04 smithi167 ceph-mon[34903]: pgmap v463: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-27T08:36:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:04 smithi173 ceph-mon[35397]: pgmap v463: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 341 B/s wr, 7 op/s 2024-03-27T08:36:06.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:06 smithi164 ceph-mon[31788]: pgmap v464: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:06 smithi167 ceph-mon[34903]: pgmap v464: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:06 smithi173 ceph-mon[35397]: pgmap v464: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:08.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:08 smithi164 ceph-mon[31788]: pgmap v465: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:08.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:08 smithi167 ceph-mon[34903]: pgmap v465: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:08 smithi173 ceph-mon[35397]: pgmap v465: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:10.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:10 smithi164 ceph-mon[31788]: pgmap v466: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:10 smithi167 ceph-mon[34903]: pgmap v466: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:10 smithi173 ceph-mon[35397]: pgmap v466: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:12.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:12 smithi164 ceph-mon[31788]: pgmap v467: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:12 smithi167 ceph-mon[34903]: pgmap v467: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 -- 172.21.15.164:0/3953218335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4102420 msgr2=0x7f30b4104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 --2- 172.21.15.164:0/3953218335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4102420 0x7f30b4104810 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009900 tx=0x7f30a802bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 -- 172.21.15.164:0/3953218335 shutdown_connections 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 --2- 172.21.15.164:0/3953218335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 0x7f30b4109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 --2- 172.21.15.164:0/3953218335 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4104d50 0x7f30b4107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 --2- 172.21.15.164:0/3953218335 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4102420 0x7f30b4104810 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.832+0000 7f30ba200640 1 -- 172.21.15.164:0/3953218335 >> 172.21.15.164:0/3953218335 conn(0x7f30b40fbe30 msgr2=0x7f30b40fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.833+0000 7f30ba200640 1 -- 172.21.15.164:0/3953218335 shutdown_connections 2024-03-27T08:36:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.833+0000 7f30ba200640 1 -- 172.21.15.164:0/3953218335 wait complete. 2024-03-27T08:36:12.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:12 smithi173 ceph-mon[35397]: pgmap v467: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.834+0000 7f30ba200640 1 Processor -- start 2024-03-27T08:36:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.834+0000 7f30ba200640 1 -- start start 2024-03-27T08:36:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.834+0000 7f30ba200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4102420 0x7f30b4199e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.834+0000 7f30ba200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30ba200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 0x7f30b41a1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30ba200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f860 con 0x7f30b4104d50 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30ba200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f6e0 con 0x7f30b4107680 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30ba200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30b410f9e0 con 0x7f30b4102420 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59334/0 (socket says 172.21.15.164:59334) 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 -- 172.21.15.164:0/1412451401 learned_addr learned my addr 172.21.15.164:0/1412451401 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4102420 0x7f30b4199e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b9800640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 0x7f30b41a1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 -- 172.21.15.164:0/1412451401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4102420 msgr2=0x7f30b4199e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4102420 0x7f30b4199e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 -- 172.21.15.164:0/1412451401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 msgr2=0x7f30b41a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 0x7f30b41a1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.835+0000 7f30b3e00640 1 -- 172.21.15.164:0/1412451401 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30b41a1a70 con 0x7f30b4104d50 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c970 tx=0x7f30a000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30b1600640 1 -- 172.21.15.164:0/1412451401 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0014070 con 0x7f30b4104d50 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30b1600640 1 -- 172.21.15.164:0/1412451401 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30a0004440 con 0x7f30b4104d50 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30b1600640 1 -- 172.21.15.164:0/1412451401 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a000f450 con 0x7f30b4104d50 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30b41a1d60 con 0x7f30b4104d50 2024-03-27T08:36:12.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.836+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30b41a2270 con 0x7f30b4104d50 2024-03-27T08:36:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 Processor -- start 2024-03-27T08:36:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 -- start start 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813e550 0x563bc8143050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc8145b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563bc80a2d10 con 0x563bc813db60 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563bc804b260 con 0x563bc81436c0 2024-03-27T08:36:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.841+0000 7f30be5d5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563bc809ecc0 con 0x563bc813e550 2024-03-27T08:36:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59336/0 (socket says 172.21.15.164:59336) 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 -- 172.21.15.164:0/934610131 learned_addr learned my addr 172.21.15.164:0/934610131 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b1600640 1 -- 172.21.15.164:0/1412451401 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f30a0017070 con 0x7f30b4104d50 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 -- 172.21.15.164:0/934610131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813e550 msgr2=0x563bc8143050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813e550 0x563bc8143050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 -- 172.21.15.164:0/934610131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 msgr2=0x563bc8145b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc8145b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.842+0000 7f30b9800640 1 -- 172.21.15.164:0/934610131 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc8042aa0 con 0x563bc813db60 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.843+0000 7f30b9800640 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009ee0 tx=0x7f30ac010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a39878de4ff2530 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.843+0000 7f30a6000640 1 -- 172.21.15.164:0/934610131 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac016070 con 0x563bc813db60 2024-03-27T08:36:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.843+0000 7f30a6000640 1 -- 172.21.15.164:0/934610131 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30ac004d20 con 0x563bc813db60 2024-03-27T08:36:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.843+0000 7f30a6000640 1 -- 172.21.15.164:0/934610131 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30ac0127d0 con 0x563bc813db60 2024-03-27T08:36:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30b1600640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 0x7f309c0a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30b1600640 1 -- 172.21.15.164:0/1412451401 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f30a00cfb70 con 0x7f30b4104d50 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 -- 172.21.15.164:0/934610131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 msgr2=0x563bc813df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f30ac009ee0 tx=0x7f30ac010740 comp rx=0 tx=0).stop 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 -- 172.21.15.164:0/934610131 shutdown_connections 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc8145b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813e550 0x563bc8143050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 --2- 172.21.15.164:0/934610131 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc813df80 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30be5d5740 1 -- 172.21.15.164:0/934610131 >> 172.21.15.164:0/934610131 conn(0x563bc81390d0 msgr2=0x563bc81394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.844+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 0x7f309c0a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.845+0000 7f30be5d5740 1 -- 172.21.15.164:0/934610131 shutdown_connections 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.845+0000 7f30be5d5740 1 -- 172.21.15.164:0/934610131 wait complete. 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.845+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 0x7f309c0a5b40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006010 tx=0x7f30a8000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.845+0000 7f30be5d5740 1 -- start start 2024-03-27T08:36:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 Processor -- start 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc813db60 0x563bc8147ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563bc8146670 con 0x563bc813e550 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563bc805e630 con 0x563bc813db60 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563bc81467f0 con 0x563bc81436c0 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.846+0000 7f30be5d5740 10 client.0 _ll_register_callbacks cb 0x563bc8063c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59338/0 (socket says 172.21.15.164:59338) 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 -- 172.21.15.164:0/1250957990 learned_addr learned my addr 172.21.15.164:0/1250957990 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc813db60 0x563bc8147ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b9800640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 -- 172.21.15.164:0/1250957990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 msgr2=0x563bc814f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 -- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc813db60 msgr2=0x563bc8147ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc813db60 0x563bc8147ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.847+0000 7f30b3e00640 1 -- 172.21.15.164:0/1250957990 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc806a5f0 con 0x563bc813e550 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.848+0000 7f30b3e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007590 tx=0x7f30a009bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb91781e288721e8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.848+0000 7f309aa00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.848+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a009c050 con 0x563bc813e550 2024-03-27T08:36:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.848+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f30a00a00d0 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.848+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30ac004d20 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30a00a0400 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 10 client.15612 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563bc7db7210 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30ac004d20 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f30a00cdb40 con 0x563bc813e550 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 10 client.15612 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 10 client.15612 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 20 client.15612 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc8153cb0 0x563bc81560a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 4 client.15612 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.849+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563bc80b0250 con 0x563bc8153cb0 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.850+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc8153cb0 0x563bc81560a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.851+0000 7f30b8e00640 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc8153cb0 0x563bc81560a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2627a9e8d369c124 server_cookie=30a35dd1283bc69a in_seq=0 out_seq=0 2024-03-27T08:36:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.851+0000 7f309aa00640 10 client.15612 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.852+0000 7f309aa00640 1 -- 172.21.15.164:0/1250957990 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563bc80b0250 con 0x563bc8153cb0 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.852+0000 7f309aa00640 10 client.15612 handle_command_reply: tid=0 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 client.15612 shutdown 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 msgr2=0x563bc8148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f30a0007590 tx=0x7f30a009bf10 comp rx=0 tx=0).stop 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 shutdown_connections 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc8153cb0 0x563bc81560a0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc8148400 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 --2- 172.21.15.164:0/1250957990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc813db60 0x563bc8147ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 >> 172.21.15.164:0/1250957990 conn(0x563bc81390d0 msgr2=0x563bc8138310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f309aa00640 0 client.15612 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 shutdown_connections 2024-03-27T08:36:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 1 -- 172.21.15.164:0/1250957990 wait complete. 2024-03-27T08:36:12.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.853+0000 7f30be5d5740 20 client.15612 trim_cache size 0 max 16384 2024-03-27T08:36:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 Processor -- start 2024-03-27T08:36:12.860 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 -- start start 2024-03-27T08:36:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813db60 0x563bc8138190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc815a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41ad870 con 0x563bc813e550 2024-03-27T08:36:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41ab140 con 0x563bc81436c0 2024-03-27T08:36:12.862 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30be5d5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41a8f90 con 0x563bc813db60 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30b3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59354/0 (socket says 172.21.15.164:59354) 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.869+0000 7f30b3e00640 1 -- 172.21.15.164:0/3763081396 learned_addr learned my addr 172.21.15.164:0/3763081396 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b9800640 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc815a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b8e00640 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813db60 0x563bc8138190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 -- 172.21.15.164:0/3763081396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813db60 msgr2=0x563bc8138190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.863 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813db60 0x563bc8138190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 -- 172.21.15.164:0/3763081396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 msgr2=0x563bc815a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc815a930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 -- 172.21.15.164:0/3763081396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bc7e83620 con 0x563bc813e550 2024-03-27T08:36:12.864 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.870+0000 7f30b3e00640 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f30a009bfe0 tx=0x7f30a009a560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84c046544393a3fe server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.871+0000 7f30a5600640 1 -- 172.21.15.164:0/3763081396 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a009b9b0 con 0x563bc813e550 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.871+0000 7f30a5600640 1 -- 172.21.15.164:0/3763081396 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30a000ec00 con 0x563bc813e550 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.871+0000 7f30a5600640 1 -- 172.21.15.164:0/3763081396 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a00a00c0 con 0x563bc813e550 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- 172.21.15.164:0/3763081396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 msgr2=0x563bc814f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f30a009bfe0 tx=0x7f30a009a560 comp rx=0 tx=0).stop 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- 172.21.15.164:0/3763081396 shutdown_connections 2024-03-27T08:36:12.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc81436c0 0x563bc815a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813e550 0x563bc814f400 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 --2- 172.21.15.164:0/3763081396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc813db60 0x563bc8138190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- 172.21.15.164:0/3763081396 >> 172.21.15.164:0/3763081396 conn(0x563bc81390d0 msgr2=0x563bc8137a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- 172.21.15.164:0/3763081396 shutdown_connections 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- 172.21.15.164:0/3763081396 wait complete. 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.872+0000 7f30be5d5740 1 -- start start 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 Processor -- start 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc814e360 0x563bc814e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41a9600 con 0x563bc813db60 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41aaa70 con 0x563bc814e360 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30b41a9cd0 con 0x563bc81436c0 2024-03-27T08:36:12.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30be5d5740 10 client.0 _ll_register_callbacks cb 0x7f30a00038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.873+0000 7f30b8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:59362/0 (socket says 172.21.15.164:59362) 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 -- 172.21.15.164:0/722919422 learned_addr learned my addr 172.21.15.164:0/722919422 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b9800640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc814e360 0x563bc814e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b3e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 -- 172.21.15.164:0/722919422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 msgr2=0x563bc814d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 -- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc814e360 msgr2=0x563bc814e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc814e360 0x563bc814e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 -- 172.21.15.164:0/722919422 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bc814ed20 con 0x563bc813db60 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b3e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:12.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f30b8e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f30a802c880 tx=0x7f30a802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1822fa27e01f21f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f309aa00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.874+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a805c060 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f30a80048c0 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30a000ec00 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f30a8005610 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 10 client.15618 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563bc81ba6f0 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30a000ec00 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f30a8056070 con 0x563bc813db60 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 10 client.15618 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:12.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 10 client.15618 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 20 client.15618 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc81bb080 0x563bc81bd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 4 client.15618 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:36:12.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.875+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563bc8147cb0 con 0x563bc81bb080 2024-03-27T08:36:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.876+0000 7f30b3e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc81bb080 0x563bc81bd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.877+0000 7f309aa00640 10 client.15618 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:12.872 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.877+0000 7f30b3e00640 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc81bb080 0x563bc81bd4a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3199d1060c99d2c server_cookie=b361f09878705ac6 in_seq=0 out_seq=0 2024-03-27T08:36:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f309aa00640 1 -- 172.21.15.164:0/722919422 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563bc8147cb0 con 0x563bc81bb080 2024-03-27T08:36:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f309aa00640 10 client.15618 handle_command_reply: tid=0 2024-03-27T08:36:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 client.15618 shutdown 2024-03-27T08:36:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 msgr2=0x563bc814ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f30a802c880 tx=0x7f30a802bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 shutdown_connections 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563bc81bb080 0x563bc81bd4a0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563bc814e360 0x563bc814e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563bc81436c0 0x563bc814d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 --2- 172.21.15.164:0/722919422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563bc813db60 0x563bc814ce10 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 >> 172.21.15.164:0/722919422 conn(0x563bc81390d0 msgr2=0x563bc813cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.885+0000 7f309aa00640 0 client.15618 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.886+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 shutdown_connections 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.886+0000 7f30be5d5740 1 -- 172.21.15.164:0/722919422 wait complete. 2024-03-27T08:36:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.886+0000 7f30be5d5740 20 client.15618 trim_cache size 0 max 16384 2024-03-27T08:36:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:36:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:36:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:36:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.886+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 msgr2=0x7f309c0a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 0x7f309c0a5b40 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f30a8006010 tx=0x7f30a8000bc0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 msgr2=0x7f30b419a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c970 tx=0x7f30a000ce30 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 shutdown_connections 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f309c0a3680 0x7f309c0a5b40 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30b4107680 0x7f30b41a1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f30b4104d50 0x7f30b419a390 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 --2- 172.21.15.164:0/1412451401 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30b4102420 0x7f30b4199e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 >> 172.21.15.164:0/1412451401 conn(0x7f30b40fbe30 msgr2=0x7f30b4102d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 shutdown_connections 2024-03-27T08:36:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:12.887+0000 7f30ba200640 1 -- 172.21.15.164:0/1412451401 wait complete. 2024-03-27T08:36:14.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:14 smithi164 ceph-mon[31788]: pgmap v468: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:14 smithi167 ceph-mon[34903]: pgmap v468: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:14 smithi173 ceph-mon[35397]: pgmap v468: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:16.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:16 smithi164 ceph-mon[31788]: pgmap v469: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-03-27T08:36:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:16 smithi167 ceph-mon[34903]: pgmap v469: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-03-27T08:36:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:16 smithi173 ceph-mon[35397]: pgmap v469: 97 pgs: 97 active+clean; 659 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 0 B/s wr, 5 op/s 2024-03-27T08:36:18.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:18 smithi164 ceph-mon[31788]: pgmap v470: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:18 smithi167 ceph-mon[34903]: pgmap v470: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:18 smithi173 ceph-mon[35397]: pgmap v470: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:20.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:20 smithi164 ceph-mon[31788]: pgmap v471: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:20 smithi167 ceph-mon[34903]: pgmap v471: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:20.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:20 smithi173 ceph-mon[35397]: pgmap v471: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:36:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:22 smithi164 ceph-mon[31788]: pgmap v472: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:22 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:36:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:22 smithi167 ceph-mon[34903]: pgmap v472: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:22 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:36:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:22 smithi173 ceph-mon[35397]: pgmap v472: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:22 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:36:23.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:36:23.697 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:36:23.793 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:36:23.793 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:36:23.793 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:23 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:36:23.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:36:23.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:36:23.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:23 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:36:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:36:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:36:23.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:23 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.995+0000 7f3016c00640 1 -- 172.21.15.164:0/132266431 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010074550 msgr2=0x7f30100749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.995+0000 7f3016c00640 1 --2- 172.21.15.164:0/132266431 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010074550 0x7f30100749b0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009900 tx=0x7f2ffc02bcc0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 -- 172.21.15.164:0/132266431 shutdown_connections 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 --2- 172.21.15.164:0/132266431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30101099f0 0x7f301010be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 --2- 172.21.15.164:0/132266431 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010074550 0x7f30100749b0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 --2- 172.21.15.164:0/132266431 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3010075b30 0x7f3010073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 -- 172.21.15.164:0/132266431 >> 172.21.15.164:0/132266431 conn(0x7f30100fd0f0 msgr2=0x7f30100ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:23.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 -- 172.21.15.164:0/132266431 shutdown_connections 2024-03-27T08:36:23.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.996+0000 7f3016c00640 1 -- 172.21.15.164:0/132266431 wait complete. 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.997+0000 7f3016c00640 1 Processor -- start 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 -- start start 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 0x7f3010070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30101099f0 0x7f30101aa120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f301010fa10 con 0x7f3010075b30 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f301010f890 con 0x7f3010074550 2024-03-27T08:36:23.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f3016c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f301010fb90 con 0x7f30101099f0 2024-03-27T08:36:23.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f300fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.998+0000 7f300f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 0x7f3010070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36728/0 (socket says 172.21.15.164:36728) 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 -- 172.21.15.164:0/2106043291 learned_addr learned my addr 172.21.15.164:0/2106043291 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f3014c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30101099f0 0x7f30101aa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 -- 172.21.15.164:0/2106043291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30101099f0 msgr2=0x7f30101aa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30101099f0 0x7f30101aa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 -- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 msgr2=0x7f3010070b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 0x7f3010070b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300fe00640 1 -- 172.21.15.164:0/2106043291 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30101aa660 con 0x7f3010074550 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:23.999+0000 7f300f400640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 0x7f3010070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f300fe00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f300000d770 tx=0x7f300000dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f300cc00640 1 -- 172.21.15.164:0/2106043291 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000017070 con 0x7f3010074550 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30101aa830 con 0x7f3010074550 2024-03-27T08:36:23.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f300cc00640 1 -- 172.21.15.164:0/2106043291 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30000054f0 con 0x7f3010074550 2024-03-27T08:36:23.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f300cc00640 1 -- 172.21.15.164:0/2106043291 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000004d60 con 0x7f3010074550 2024-03-27T08:36:23.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.000+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30101aacf0 con 0x7f3010074550 2024-03-27T08:36:23.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.005+0000 7f30197e2740 1 Processor -- start 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.005+0000 7f30197e2740 1 -- start start 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a6331b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a635cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f58a58b6b0 con 0x55f58a62e6b0 2024-03-27T08:36:23.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f58a533750 con 0x55f58a62dcc0 2024-03-27T08:36:23.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f30197e2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f58a587660 con 0x55f58a633820 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f300cc00640 1 -- 172.21.15.164:0/2106043291 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3000004f00 con 0x7f3010074550 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36736/0 (socket says 172.21.15.164:36736) 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.006+0000 7f3014c00640 1 -- 172.21.15.164:0/3212148262 learned_addr learned my addr 172.21.15.164:0/3212148262 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f300fe00640 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a6331b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f300f400640 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a635cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 -- 172.21.15.164:0/3212148262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 msgr2=0x55f58a635cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a635cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 -- 172.21.15.164:0/3212148262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 msgr2=0x55f58a6331b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:23.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a6331b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 -- 172.21.15.164:0/3212148262 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58a3697d0 con 0x55f58a62dcc0 2024-03-27T08:36:24.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.007+0000 7f3014c00640 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3008009fd0 tx=0x7f30080118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17aa32b26f245906 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f3005200640 1 -- 172.21.15.164:0/3212148262 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008004d20 con 0x55f58a62dcc0 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f3005200640 1 -- 172.21.15.164:0/3212148262 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3008004050 con 0x55f58a62dcc0 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f3005200640 1 -- 172.21.15.164:0/3212148262 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008005260 con 0x55f58a62dcc0 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f300cc00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 0x7f2ff40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f300cc00640 1 -- 172.21.15.164:0/2106043291 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f30000cf720 con 0x7f3010074550 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.008+0000 7f300fe00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 0x7f2ff40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 -- 172.21.15.164:0/3212148262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 msgr2=0x55f58a62e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3008009fd0 tx=0x7f30080118d0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 -- 172.21.15.164:0/3212148262 shutdown_connections 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a635cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a6331b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 --2- 172.21.15.164:0/3212148262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a62e0e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 -- 172.21.15.164:0/3212148262 >> 172.21.15.164:0/3212148262 conn(0x55f58a620a20 msgr2=0x55f58a620e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f300fe00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 0x7f2ff40a5ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f300009b990 tx=0x7f30000bc040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.009+0000 7f30197e2740 1 -- 172.21.15.164:0/3212148262 shutdown_connections 2024-03-27T08:36:24.002 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.010+0000 7f30197e2740 1 -- 172.21.15.164:0/3212148262 wait complete. 2024-03-27T08:36:24.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.010+0000 7f30197e2740 1 -- start start 2024-03-27T08:36:24.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.010+0000 7f30197e2740 1 Processor -- start 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a638750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a63f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f58a6367d0 con 0x55f58a62e6b0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f58a546a80 con 0x55f58a62dcc0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f58a636950 con 0x55f58a633820 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f30197e2740 10 client.0 _ll_register_callbacks cb 0x55f58a546470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36738/0 (socket says 172.21.15.164:36738) 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f3014c00640 1 -- 172.21.15.164:0/4060188893 learned_addr learned my addr 172.21.15.164:0/4060188893 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.011+0000 7f300f400640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a638750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a63f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 -- 172.21.15.164:0/4060188893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 msgr2=0x55f58a63f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a63f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 -- 172.21.15.164:0/4060188893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 msgr2=0x55f58a638750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a638750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 -- 172.21.15.164:0/4060188893 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58a29f3f0 con 0x55f58a62dcc0 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f300f400640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a638750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f3014c00640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3008000f80 tx=0x7f3008004740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42d64aff7a53b783 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.012+0000 7f2ff9600640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300802d060 con 0x55f58a62dcc0 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3008004c00 con 0x55f58a62dcc0 2024-03-27T08:36:24.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3008004050 con 0x55f58a62dcc0 2024-03-27T08:36:24.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3008004e00 con 0x55f58a62dcc0 2024-03-27T08:36:24.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f30197e2740 10 client.35327 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:24.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.013+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f58a25f0f0 con 0x55f58a62dcc0 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3008004050 con 0x55f58a62dcc0 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f300800f6e0 con 0x55f58a62dcc0 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 10 client.35327 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 10 client.35327 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 20 client.35327 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a643e30 0x55f58a646220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 4 client.35327 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.014+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58a598bf0 con 0x55f58a643e30 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.015+0000 7f300f400640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a643e30 0x55f58a646220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.016+0000 7f2ff9600640 10 client.35327 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:24.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.016+0000 7f300f400640 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a643e30 0x55f58a646220 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe17a6cc8d34f508 server_cookie=5318775e0a28f701 in_seq=0 out_seq=0 2024-03-27T08:36:24.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f2ff9600640 1 -- 172.21.15.164:0/4060188893 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f58a598bf0 con 0x55f58a643e30 2024-03-27T08:36:24.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f2ff9600640 10 client.35327 handle_command_reply: tid=0 2024-03-27T08:36:24.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 client.35327 shutdown 2024-03-27T08:36:24.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 msgr2=0x55f58a638210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3008000f80 tx=0x7f3008004740 comp rx=0 tx=0).stop 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 shutdown_connections 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a643e30 0x55f58a646220 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a633820 0x55f58a63f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a638750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 --2- 172.21.15.164:0/4060188893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62dcc0 0x55f58a638210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f2ff9600640 0 client.35327 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.017+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 >> 172.21.15.164:0/4060188893 conn(0x55f58a620a20 msgr2=0x55f58a61fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.018+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 shutdown_connections 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.018+0000 7f30197e2740 1 -- 172.21.15.164:0/4060188893 wait complete. 2024-03-27T08:36:24.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.018+0000 7f30197e2740 20 client.35327 trim_cache size 0 max 16384 2024-03-27T08:36:24.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 Processor -- start 2024-03-27T08:36:24.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 -- start start 2024-03-27T08:36:24.031 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a638530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62e6b0 0x55f58a63f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30101b1f10 con 0x55f58a633820 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30101af7e0 con 0x55f58a62e6b0 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.036+0000 7f30197e2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30101ad650 con 0x55f58a62dcc0 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33224/0 (socket says 172.21.15.164:33224) 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 -- 172.21.15.164:0/1338135110 learned_addr learned my addr 172.21.15.164:0/1338135110 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f300f400640 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62e6b0 0x55f58a63f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a638530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 -- 172.21.15.164:0/1338135110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 msgr2=0x55f58a638530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a638530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.032 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 -- 172.21.15.164:0/1338135110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62e6b0 msgr2=0x55f58a63f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62e6b0 0x55f58a63f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.037+0000 7f3014c00640 1 -- 172.21.15.164:0/1338135110 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58a62f6b0 con 0x55f58a633820 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.038+0000 7f3014c00640 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f300800fff0 tx=0x7f3008003ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2df554dbd357ce09 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.038+0000 7f2ffbe00640 1 -- 172.21.15.164:0/1338135110 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300802d030 con 0x55f58a633820 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.038+0000 7f2ffbe00640 1 -- 172.21.15.164:0/1338135110 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3008009c60 con 0x55f58a633820 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.038+0000 7f2ffbe00640 1 -- 172.21.15.164:0/1338135110 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3008038070 con 0x55f58a633820 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 -- 172.21.15.164:0/1338135110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 msgr2=0x55f58a61f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f300800fff0 tx=0x7f3008003ab0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 -- 172.21.15.164:0/1338135110 shutdown_connections 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a633820 0x55f58a61f390 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a62e6b0 0x55f58a63f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 --2- 172.21.15.164:0/1338135110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a638530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 -- 172.21.15.164:0/1338135110 >> 172.21.15.164:0/1338135110 conn(0x55f58a620a20 msgr2=0x55f58a637e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.039+0000 7f30197e2740 1 -- 172.21.15.164:0/1338135110 shutdown_connections 2024-03-27T08:36:24.033 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.040+0000 7f30197e2740 1 -- 172.21.15.164:0/1338135110 wait complete. 2024-03-27T08:36:24.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.040+0000 7f30197e2740 1 -- start start 2024-03-27T08:36:24.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.040+0000 7f30197e2740 1 Processor -- start 2024-03-27T08:36:24.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a63d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a63d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f30101adca0 con 0x55f58a62e6b0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30101af110 con 0x55f58a633820 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f30101ae370 con 0x55f58a62dcc0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f30197e2740 10 client.0 _ll_register_callbacks cb 0x7f3008003cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f3014c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36750/0 (socket says 172.21.15.164:36750) 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f3014c00640 1 -- 172.21.15.164:0/1284101588 learned_addr learned my addr 172.21.15.164:0/1284101588 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.041+0000 7f300f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a63d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f3014c00640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a63d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f300f400640 1 -- 172.21.15.164:0/1284101588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 msgr2=0x55f58a63d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f300f400640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a63d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f300f400640 1 -- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 msgr2=0x55f58a63e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f300f400640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f300f400640 1 -- 172.21.15.164:0/1284101588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58a63ec40 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.042+0000 7f3014c00640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f300f400640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a63d640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc036040 tx=0x7f2ffc02c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=553b71640e3650ee server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f2ff9600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc04f060 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2ffc02cbc0 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3008009c60 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.043+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2ffc02cdc0 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 10 client.15636 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f58a6aa350 con 0x55f58a62e6b0 2024-03-27T08:36:24.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3008009c60 con 0x55f58a62e6b0 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2ffc0346d0 con 0x55f58a62e6b0 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 10 client.15636 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 10 client.15636 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 20 client.15636 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a6aad30 0x55f58a6ad150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 4 client.15636 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.044+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f58a592f40 con 0x55f58a6aad30 2024-03-27T08:36:24.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.045+0000 7f3014c00640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a6aad30 0x55f58a6ad150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f3014c00640 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a6aad30 0x55f58a6ad150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3cc8ee91642a2c35 server_cookie=b45b471357c44c54 in_seq=0 out_seq=0 2024-03-27T08:36:24.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f2ff9600640 10 client.15636 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:24.040 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f2ff9600640 1 -- 172.21.15.164:0/1284101588 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f58a592f40 con 0x55f58a6aad30 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f2ff9600640 10 client.15636 handle_command_reply: tid=0 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 client.15636 shutdown 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 msgr2=0x55f58a63d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a63d640 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc036040 tx=0x7f2ffc02c8b0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 shutdown_connections 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f58a6aad30 0x55f58a6ad150 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f58a633820 0x55f58a63e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f58a62e6b0 0x55f58a63d640 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 --2- 172.21.15.164:0/1284101588 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f58a62dcc0 0x55f58a63d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.046+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 >> 172.21.15.164:0/1284101588 conn(0x55f58a620a20 msgr2=0x55f58a61f390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.047+0000 7f2ff9600640 0 client.15636 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.047+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 shutdown_connections 2024-03-27T08:36:24.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.047+0000 7f30197e2740 1 -- 172.21.15.164:0/1284101588 wait complete. 2024-03-27T08:36:24.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.047+0000 7f30197e2740 20 client.15636 trim_cache size 0 max 16384 2024-03-27T08:36:24.042 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:36:24.042 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "no active scrubs running", 2024-03-27T08:36:24.042 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": {} 2024-03-27T08:36:24.042 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 msgr2=0x7f2ff40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 0x7f2ff40a5ad0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f300009b990 tx=0x7f30000bc040 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 msgr2=0x7f30100705e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f300000d770 tx=0x7f300000dc30 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 shutdown_connections 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2ff40a3610 0x7f2ff40a5ad0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f30101099f0 0x7f30101aa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3010075b30 0x7f3010070b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 --2- 172.21.15.164:0/2106043291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3010074550 0x7f30100705e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 >> 172.21.15.164:0/2106043291 conn(0x7f30100fd0f0 msgr2=0x7f3010105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 shutdown_connections 2024-03-27T08:36:24.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.048+0000 7f3016c00640 1 -- 172.21.15.164:0/2106043291 wait complete. 2024-03-27T08:36:24.064 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T08:36:24.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:36:24.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 -- 172.21.15.164:0/3082420654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa958107910 msgr2=0x7fa958109d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.244 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 --2- 172.21.15.164:0/3082420654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa958107910 0x7fa958109d00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fa950009ca0 tx=0x7fa95002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 -- 172.21.15.164:0/3082420654 shutdown_connections 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 --2- 172.21.15.164:0/3082420654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa958107910 0x7fa958109d00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 --2- 172.21.15.164:0/3082420654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 0x7fa9581073d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 --2- 172.21.15.164:0/3082420654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa9581026b0 0x7fa958104aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.252+0000 7fa95d800640 1 -- 172.21.15.164:0/3082420654 >> 172.21.15.164:0/3082420654 conn(0x7fa9580fbfe0 msgr2=0x7fa9580fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.253+0000 7fa95d800640 1 -- 172.21.15.164:0/3082420654 shutdown_connections 2024-03-27T08:36:24.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.253+0000 7fa95d800640 1 -- 172.21.15.164:0/3082420654 wait complete. 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 Processor -- start 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 -- start start 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 0x7fa958196180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 0x7fa9581a5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810d800 con 0x7fa9581026b0 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810d680 con 0x7fa958104fe0 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa95d800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810d980 con 0x7fa958107910 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa956a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa956a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33260/0 (socket says 172.21.15.164:33260) 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.254+0000 7fa956a00640 1 -- 172.21.15.164:0/43831662 learned_addr learned my addr 172.21.15.164:0/43831662 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956000640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 0x7fa958196180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa957400640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 0x7fa9581a5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 -- 172.21.15.164:0/43831662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 msgr2=0x7fa9581a5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 0x7fa9581a5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 -- 172.21.15.164:0/43831662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 msgr2=0x7fa958196180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 0x7fa958196180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 -- 172.21.15.164:0/43831662 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9581a60a0 con 0x7fa9581026b0 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa957400640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 0x7fa9581a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:24.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa956a00640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d770 tx=0x7fa94800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.255+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948017070 con 0x7fa9581026b0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.256+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa9480054f0 con 0x7fa9581026b0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.256+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9581a6390 con 0x7fa9581026b0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.256+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa948004d60 con 0x7fa9581026b0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.256+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9581a68e0 con 0x7fa9581026b0 2024-03-27T08:36:24.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.257+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa958109400 con 0x7fa9581026b0 2024-03-27T08:36:24.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.261+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fa948004f00 con 0x7fa9581026b0 2024-03-27T08:36:24.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.263+0000 7fa94f400640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 0x7fa93c0a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.263+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa9480cfc00 con 0x7fa9581026b0 2024-03-27T08:36:24.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.263+0000 7fa956000640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 0x7fa93c0a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.256 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.264+0000 7fa956000640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 0x7fa93c0a5bd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa944005fd0 tx=0x7fa944005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.266+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fa94809c800 con 0x7fa9581026b0 2024-03-27T08:36:24.531 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.539+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa95802d370 con 0x7fa9581026b0 2024-03-27T08:36:24.532 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.541+0000 7fa94f400640 1 -- 172.21.15.164:0/43831662 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11888 (secure 0 0 0) 0x7fa94809c100 con 0x7fa9581026b0 2024-03-27T08:36:24.533 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:36:24.533 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:35:11.240118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34502,34430,34463]},"id":1}]} 2024-03-27T08:36:24.533 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-03-27T08:36:24.534 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 msgr2=0x7fa93c0a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 0x7fa93c0a5bd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa944005fd0 tx=0x7fa944005850 comp rx=0 tx=0).stop 2024-03-27T08:36:24.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 msgr2=0x7fa958195c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fa94800d770 tx=0x7fa94800dc30 comp rx=0 tx=0).stop 2024-03-27T08:36:24.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 shutdown_connections 2024-03-27T08:36:24.535 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa93c0a3710 0x7fa93c0a5bd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa958107910 0x7fa9581a5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958104fe0 0x7fa958196180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 --2- 172.21.15.164:0/43831662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa9581026b0 0x7fa958195c40 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.543+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 >> 172.21.15.164:0/43831662 conn(0x7fa9580fbfe0 msgr2=0x7fa958101df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.544+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 shutdown_connections 2024-03-27T08:36:24.536 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.544+0000 7fa95d800640 1 -- 172.21.15.164:0/43831662 wait complete. 2024-03-27T08:36:24.554 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T08:36:24.727 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 -- 172.21.15.164:0/1781562610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 msgr2=0x7f796c110410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 --2- 172.21.15.164:0/1781562610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c110410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f7964009cd0 tx=0x7f796402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 -- 172.21.15.164:0/1781562610 shutdown_connections 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 --2- 172.21.15.164:0/1781562610 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c110410 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 --2- 172.21.15.164:0/1781562610 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796c0745b0 0x7f796c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 --2- 172.21.15.164:0/1781562610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c075b90 0x7f796c073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 -- 172.21.15.164:0/1781562610 >> 172.21.15.164:0/1781562610 conn(0x7f796c0fcfc0 msgr2=0x7f796c0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.735+0000 7f7971800640 1 -- 172.21.15.164:0/1781562610 shutdown_connections 2024-03-27T08:36:24.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.736+0000 7f7971800640 1 -- 172.21.15.164:0/1781562610 wait complete. 2024-03-27T08:36:24.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.736+0000 7f7971800640 1 Processor -- start 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 -- start start 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c0745b0 0x7f796c19e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796c075b90 0x7f796c19e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f796c113cb0 con 0x7f796c10e020 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f796c113b30 con 0x7f796c0745b0 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7971800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f796c113e30 con 0x7f796c075b90 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33268/0 (socket says 172.21.15.164:33268) 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.737+0000 7f7970e00640 1 -- 172.21.15.164:0/3019453059 learned_addr learned my addr 172.21.15.164:0/3019453059 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f796be00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c0745b0 0x7f796c19e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 -- 172.21.15.164:0/3019453059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796c075b90 msgr2=0x7f796c19e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796c075b90 0x7f796c19e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 -- 172.21.15.164:0/3019453059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c0745b0 msgr2=0x7f796c19e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c0745b0 0x7f796c19e300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 -- 172.21.15.164:0/3019453059 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c1a5f20 con 0x7f796c10e020 2024-03-27T08:36:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.738+0000 7f7970e00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f796402c630 tx=0x7f7964032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.739+0000 7f7968c00640 1 -- 172.21.15.164:0/3019453059 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964039050 con 0x7f796c10e020 2024-03-27T08:36:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.739+0000 7f7968c00640 1 -- 172.21.15.164:0/3019453059 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f796403a040 con 0x7f796c10e020 2024-03-27T08:36:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.739+0000 7f7968c00640 1 -- 172.21.15.164:0/3019453059 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964040450 con 0x7f796c10e020 2024-03-27T08:36:24.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.741+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c1a61b0 con 0x7f796c10e020 2024-03-27T08:36:24.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.741+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1a6620 con 0x7f796c10e020 2024-03-27T08:36:24.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.745+0000 7f7975ba1740 1 Processor -- start 2024-03-27T08:36:24.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.745+0000 7f7968c00640 1 -- 172.21.15.164:0/3019453059 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7964003b70 con 0x7f796c10e020 2024-03-27T08:36:24.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 -- start start 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e74a0 0x5555c01ebfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01ec610 0x5555c01eeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5555c01ae7b0 con 0x5555c01e6ab0 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5555c014b670 con 0x5555c01e74a0 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f7975ba1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5555c00f3970 con 0x5555c01ec610 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f796b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.738 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f796b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33284/0 (socket says 172.21.15.164:33284) 2024-03-27T08:36:24.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.746+0000 7f796b400640 1 -- 172.21.15.164:0/3846943740 learned_addr learned my addr 172.21.15.164:0/3846943740 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.739 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796be00640 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e74a0 0x5555c01ebfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01ec610 0x5555c01eeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 -- 172.21.15.164:0/3846943740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01ec610 msgr2=0x5555c01eeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01ec610 0x5555c01eeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 -- 172.21.15.164:0/3846943740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e74a0 msgr2=0x5555c01ebfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e74a0 0x5555c01ebfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 -- 172.21.15.164:0/3846943740 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555bfe5f3f0 con 0x5555c01e6ab0 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.747+0000 7f796b400640 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7958005fd0 tx=0x7f795800b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42410c0e6ff9f09a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.740 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f7968c00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 0x7f79500a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f7961600640 1 -- 172.21.15.164:0/3846943740 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f795801a070 con 0x5555c01e6ab0 2024-03-27T08:36:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f7961600640 1 -- 172.21.15.164:0/3846943740 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f79580035f0 con 0x5555c01e6ab0 2024-03-27T08:36:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f7961600640 1 -- 172.21.15.164:0/3846943740 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7958012710 con 0x5555c01e6ab0 2024-03-27T08:36:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f7968c00640 1 -- 172.21.15.164:0/3019453059 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f79640f25c0 con 0x7f796c10e020 2024-03-27T08:36:24.741 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.748+0000 7f796be00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 0x7f79500a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 -- 172.21.15.164:0/3846943740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 msgr2=0x5555c01e6ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f7958005fd0 tx=0x7f795800b590 comp rx=0 tx=0).stop 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 -- 172.21.15.164:0/3846943740 shutdown_connections 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01ec610 0x5555c01eeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e74a0 0x5555c01ebfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 --2- 172.21.15.164:0/3846943740 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e6ab0 0x5555c01e6ed0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.744 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 -- 172.21.15.164:0/3846943740 >> 172.21.15.164:0/3846943740 conn(0x5555c01e2020 msgr2=0x5555c01e2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 -- 172.21.15.164:0/3846943740 shutdown_connections 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f796be00640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 0x7f79500a5ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5555c01e78a0 tx=0x7f795c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.749+0000 7f7975ba1740 1 -- 172.21.15.164:0/3846943740 wait complete. 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 -- start start 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 Processor -- start 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e74a0 0x5555c01f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.745 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5555c0106ca0 con 0x5555c01ec610 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5555c0147620 con 0x5555c01e6ab0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5555c01ef5c0 con 0x5555c01e74a0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.750+0000 7f7975ba1740 10 client.0 _ll_register_callbacks cb 0x5555c0143160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33294/0 (socket says 172.21.15.164:33294) 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 -- 172.21.15.164:0/2103242430 learned_addr learned my addr 172.21.15.164:0/2103242430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f796be00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f796b400640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e74a0 0x5555c01f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.746 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 -- 172.21.15.164:0/2103242430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e74a0 msgr2=0x5555c01f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e74a0 0x5555c01f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 -- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 msgr2=0x5555c01f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.751+0000 7f7970e00640 1 -- 172.21.15.164:0/2103242430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555bff297d0 con 0x5555c01ec610 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7970e00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79640bb4a0 tx=0x7f79640be610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5196b795b583ec00 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7956000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640bf1d0 con 0x5555c01ec610 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f79640c7220 con 0x5555c01ec610 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79580035f0 con 0x5555c01ec610 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f79640bead0 con 0x5555c01ec610 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7975ba1740 10 client.15654 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:24.747 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.752+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555c01fb550 con 0x5555c01ec610 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.753+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f79580035f0 con 0x5555c01ec610 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f79640d4020 con 0x5555c01ec610 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 10 client.15654 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 10 client.15654 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 20 client.15654 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01fcc30 0x5555c01ff0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 4 client.15654 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5555c0158bb0 con 0x5555c01fcc30 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.754+0000 7f796be00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01fcc30 0x5555c01ff0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.750 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.755+0000 7f796be00640 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01fcc30 0x5555c01ff0f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5213b4fccf5122ec server_cookie=aca45153fd203c8f in_seq=0 out_seq=0 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.755+0000 7f7956000640 10 client.15654 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7956000640 1 -- 172.21.15.164:0/2103242430 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5555c0158bb0 con 0x5555c01fcc30 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7956000640 10 client.15654 handle_command_reply: tid=0 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 client.15654 shutdown 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 msgr2=0x5555c01f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f79640bb4a0 tx=0x7f79640be610 comp rx=0 tx=0).stop 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 shutdown_connections 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01fcc30 0x5555c01ff0f0 crc :-1 s=READY pgs=22 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01ec610 0x5555c01f81c0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e74a0 0x5555c01f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2103242430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 >> 172.21.15.164:0/2103242430 conn(0x5555c01e2020 msgr2=0x5555c01e1240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.751 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.757+0000 7f7956000640 0 client.15654 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:24.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.758+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 shutdown_connections 2024-03-27T08:36:24.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.758+0000 7f7975ba1740 1 -- 172.21.15.164:0/2103242430 wait complete. 2024-03-27T08:36:24.752 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.758+0000 7f7975ba1740 20 client.15654 trim_cache size 0 max 16384 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 Processor -- start 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 -- start start 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f0c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f11c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1b1cf0 con 0x5555c01e74a0 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1af5c0 con 0x5555c01e6ab0 2024-03-27T08:36:24.764 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.772+0000 7f7975ba1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1ad410 con 0x5555c01e2020 2024-03-27T08:36:24.765 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33310/0 (socket says 172.21.15.164:33310) 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 -- 172.21.15.164:0/850274914 learned_addr learned my addr 172.21.15.164:0/850274914 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f796b400640 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f796be00640 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f0c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 -- 172.21.15.164:0/850274914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 msgr2=0x5555c01f0c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f0c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 -- 172.21.15.164:0/850274914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 msgr2=0x5555c01f11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.766 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 -- 172.21.15.164:0/850274914 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5555c01e7d30 con 0x5555c01e74a0 2024-03-27T08:36:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.773+0000 7f7970e00640 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f79640323f0 tx=0x7f79640bcfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56e73d2b732650d0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.774+0000 7f7960c00640 1 -- 172.21.15.164:0/850274914 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640be430 con 0x5555c01e74a0 2024-03-27T08:36:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.774+0000 7f7960c00640 1 -- 172.21.15.164:0/850274914 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f79640bf1d0 con 0x5555c01e74a0 2024-03-27T08:36:24.767 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.774+0000 7f7960c00640 1 -- 172.21.15.164:0/850274914 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640c7480 con 0x5555c01e74a0 2024-03-27T08:36:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.774+0000 7f7975ba1740 1 -- 172.21.15.164:0/850274914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 msgr2=0x5555c01f8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.774+0000 7f7975ba1740 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f79640323f0 tx=0x7f79640bcfe0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 -- 172.21.15.164:0/850274914 shutdown_connections 2024-03-27T08:36:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c01f8090 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.770 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 --2- 172.21.15.164:0/850274914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f0c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 -- 172.21.15.164:0/850274914 >> 172.21.15.164:0/850274914 conn(0x5555c01ec150 msgr2=0x5555c01e2400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 -- 172.21.15.164:0/850274914 shutdown_connections 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 -- 172.21.15.164:0/850274914 wait complete. 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 -- start start 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.775+0000 7f7975ba1740 1 Processor -- start 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f5060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1ada80 con 0x5555c01e74a0 2024-03-27T08:36:24.771 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1aeef0 con 0x5555c01e6ab0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f796c1ae150 con 0x5555c01e2020 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7975ba1740 10 client.0 _ll_register_callbacks cb 0x7f7964032340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33312/0 (socket says 172.21.15.164:33312) 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 -- 172.21.15.164:0/2272224346 learned_addr learned my addr 172.21.15.164:0/2272224346 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f796be00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 -- 172.21.15.164:0/2272224346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 msgr2=0x5555c01f5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f796b400640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f5060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 -- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 msgr2=0x5555c01f55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.776+0000 7f7970e00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7970e00640 1 -- 172.21.15.164:0/2272224346 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5555c0261590 con 0x5555c01e74a0 2024-03-27T08:36:24.772 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7970e00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7964004dc0 tx=0x7f79640be1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9847aa3730d4024a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7956000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79640be430 con 0x5555c01e74a0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79640bf1d0 con 0x5555c01e74a0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f79640bfe00 con 0x5555c01e74a0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f79640be430 con 0x5555c01e74a0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7975ba1740 10 client.15660 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.777+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5555c0261590 con 0x5555c01e74a0 2024-03-27T08:36:24.773 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f79640bf1d0 con 0x5555c01e74a0 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f79640d4030 con 0x5555c01e74a0 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 10 client.15660 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 10 client.15660 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 20 client.15660 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01ec610 0x5555c0264de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 4 client.15660 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:24.774 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.778+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5555c0152f00 con 0x5555c01ec610 2024-03-27T08:36:24.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.779+0000 7f796be00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01ec610 0x5555c0264de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.780+0000 7f796be00640 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01ec610 0x5555c0264de0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=109d4ee84cda1b67 server_cookie=664b0ca5792c0983 in_seq=0 out_seq=0 2024-03-27T08:36:24.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.780+0000 7f7956000640 10 client.15660 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:24.775 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.780+0000 7f7956000640 1 -- 172.21.15.164:0/2272224346 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5555c0152f00 con 0x5555c01ec610 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.780+0000 7f7956000640 10 client.15660 handle_command_reply: tid=0 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.780+0000 7f7975ba1740 1 client.15660 shutdown 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 msgr2=0x5555c0261020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f7964004dc0 tx=0x7f79640be1d0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 shutdown_connections 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x5555c01ec610 0x5555c0264de0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5555c01e74a0 0x5555c0261020 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5555c01e6ab0 0x5555c01f55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 --2- 172.21.15.164:0/2272224346 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5555c01e2020 0x5555c01f5060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 >> 172.21.15.164:0/2272224346 conn(0x5555c01ec150 msgr2=0x5555c01eb9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7956000640 0 client.15660 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 shutdown_connections 2024-03-27T08:36:24.776 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 1 -- 172.21.15.164:0/2272224346 wait complete. 2024-03-27T08:36:24.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.781+0000 7f7975ba1740 20 client.15660 trim_cache size 0 max 16384 2024-03-27T08:36:24.777 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:24.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 msgr2=0x7f79500a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 0x7f79500a5ad0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x5555c01e78a0 tx=0x7f795c005f90 comp rx=0 tx=0).stop 2024-03-27T08:36:24.777 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 msgr2=0x7f796c1a58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f796402c630 tx=0x7f7964032900 comp rx=0 tx=0).stop 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 shutdown_connections 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f79500a3610 0x7f79500a5ad0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f796c10e020 0x7f796c1a58b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f796c075b90 0x7f796c19e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 --2- 172.21.15.164:0/3019453059 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f796c0745b0 0x7f796c19e300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 >> 172.21.15.164:0/3019453059 conn(0x7f796c0fcfc0 msgr2=0x7f796c1012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 shutdown_connections 2024-03-27T08:36:24.778 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.782+0000 7f7971800640 1 -- 172.21.15.164:0/3019453059 wait complete. 2024-03-27T08:36:24.795 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:24 smithi164 ceph-mon[31788]: pgmap v473: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:24.797 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T08:36:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:24 smithi167 ceph-mon[34903]: pgmap v473: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:24 smithi173 ceph-mon[35397]: pgmap v473: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:24.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 -- 172.21.15.164:0/708403914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc101a50 msgr2=0x7f23fc101e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 --2- 172.21.15.164:0/708403914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc101a50 0x7f23fc101e70 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f002bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:24.977 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 -- 172.21.15.164:0/708403914 shutdown_connections 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 --2- 172.21.15.164:0/708403914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 0x7f23fc109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 --2- 172.21.15.164:0/708403914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc102c40 0x7f23fc1030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 --2- 172.21.15.164:0/708403914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc101a50 0x7f23fc101e70 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.985+0000 7f2401e00640 1 -- 172.21.15.164:0/708403914 >> 172.21.15.164:0/708403914 conn(0x7f23fc0fcfc0 msgr2=0x7f23fc0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.986+0000 7f2401e00640 1 -- 172.21.15.164:0/708403914 shutdown_connections 2024-03-27T08:36:24.978 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.986+0000 7f2401e00640 1 -- 172.21.15.164:0/708403914 wait complete. 2024-03-27T08:36:24.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.986+0000 7f2401e00640 1 Processor -- start 2024-03-27T08:36:24.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 -- start start 2024-03-27T08:36:24.979 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 0x7f23fc197d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 0x7f23fc19f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc10d6b0 con 0x7f23fc102c40 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc10d530 con 0x7f23fc101a50 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f2401e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc10d830 con 0x7f23fc103600 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f23fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f23fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33326/0 (socket says 172.21.15.164:33326) 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.987+0000 7f23fbe00640 1 -- 172.21.15.164:0/747566509 learned_addr learned my addr 172.21.15.164:0/747566509 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f2400a00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 0x7f23fc197d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f2401400640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 0x7f23fc19f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 -- 172.21.15.164:0/747566509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 msgr2=0x7f23fc19f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 0x7f23fc19f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 -- 172.21.15.164:0/747566509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 msgr2=0x7f23fc197d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 0x7f23fc197d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 -- 172.21.15.164:0/747566509 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23fc19f970 con 0x7f23fc102c40 2024-03-27T08:36:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f2400a00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 0x7f23fc197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.988+0000 7f23fbe00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f23e800d950 tx=0x7f23e800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.989+0000 7f23f9600640 1 -- 172.21.15.164:0/747566509 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8017070 con 0x7f23fc102c40 2024-03-27T08:36:24.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.989+0000 7f23f9600640 1 -- 172.21.15.164:0/747566509 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23e8009c30 con 0x7f23fc102c40 2024-03-27T08:36:24.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.989+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23fc19fc60 con 0x7f23fc102c40 2024-03-27T08:36:24.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.989+0000 7f23f9600640 1 -- 172.21.15.164:0/747566509 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e800f6b0 con 0x7f23fc102c40 2024-03-27T08:36:24.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.990+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23fc073d80 con 0x7f23fc102c40 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 Processor -- start 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 -- start start 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a843ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a849610 0x563c9a84baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563c9a80b7b0 con 0x563c9a849610 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c9a7a8670 con 0x563c9a8444a0 2024-03-27T08:36:24.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.993+0000 7f240620f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c9a750970 con 0x563c9a843ab0 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f23f9600640 1 -- 172.21.15.164:0/747566509 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f23e8010a50 con 0x7f23fc102c40 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f2401400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a843ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f2400a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f2400a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36846/0 (socket says 172.21.15.164:36846) 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f2400a00640 1 -- 172.21.15.164:0/109881744 learned_addr learned my addr 172.21.15.164:0/109881744 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.994+0000 7f23fbe00640 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a849610 0x563c9a84baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 -- 172.21.15.164:0/109881744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 msgr2=0x563c9a843ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a843ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 -- 172.21.15.164:0/109881744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a849610 msgr2=0x563c9a84baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a849610 0x563c9a84baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 -- 172.21.15.164:0/109881744 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c9a4bc3f0 con 0x563c9a8444a0 2024-03-27T08:36:24.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.995+0000 7f2400a00640 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f00095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0f7cb12748ded90 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.996+0000 7f23edc00640 1 -- 172.21.15.164:0/109881744 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f002cb20 con 0x563c9a8444a0 2024-03-27T08:36:24.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.996+0000 7f23edc00640 1 -- 172.21.15.164:0/109881744 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23f0005070 con 0x563c9a8444a0 2024-03-27T08:36:24.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.996+0000 7f23f9600640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 0x7f23e40a9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.996+0000 7f23f9600640 1 -- 172.21.15.164:0/747566509 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23e80cf320 con 0x7f23fc102c40 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f23edc00640 1 -- 172.21.15.164:0/109881744 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004900 con 0x563c9a8444a0 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f2401400640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 0x7f23e40a9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 -- 172.21.15.164:0/109881744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 msgr2=0x563c9a848fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23f0009900 tx=0x7f23f00095e0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 -- 172.21.15.164:0/109881744 shutdown_connections 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a849610 0x563c9a84baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a848fa0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 --2- 172.21.15.164:0/109881744 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a843ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.997+0000 7f240620f740 1 -- 172.21.15.164:0/109881744 >> 172.21.15.164:0/109881744 conn(0x563c9a83f020 msgr2=0x563c9a83f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.998+0000 7f240620f740 1 -- 172.21.15.164:0/109881744 shutdown_connections 2024-03-27T08:36:24.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.998+0000 7f240620f740 1 -- 172.21.15.164:0/109881744 wait complete. 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.998+0000 7f2401400640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 0x7f23e40a9f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x563c9a844d00 tx=0x7f23f4009740 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.998+0000 7f240620f740 1 -- start start 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.998+0000 7f240620f740 1 Processor -- start 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a856380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a85d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563c9a763ca0 con 0x563c9a8444a0 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c9a7a4620 con 0x563c9a849610 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563c9a84c5b0 con 0x563c9a843ab0 2024-03-27T08:36:24.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f240620f740 10 client.0 _ll_register_callbacks cb 0x563c9a7a0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f23fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f23fbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33344/0 (socket says 172.21.15.164:33344) 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f23fbe00640 1 -- 172.21.15.164:0/2195627963 learned_addr learned my addr 172.21.15.164:0/2195627963 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:24.999+0000 7f2400a00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a856380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f2401400640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a85d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 -- 172.21.15.164:0/2195627963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 msgr2=0x563c9a856380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.993 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a856380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 -- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 msgr2=0x563c9a85d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a85d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 -- 172.21.15.164:0/2195627963 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c9a5867d0 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f23e809b770 tx=0x7f23e8097480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7f6442432123089 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23e2000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.000+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23e8020040 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23e809ac30 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f0005070 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23e809b140 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 10 client.15672 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563c9a860d30 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23e8009de0 con 0x563c9a8444a0 2024-03-27T08:36:24.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f23e8097530 con 0x563c9a8444a0 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 10 client.15672 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 10 client.15672 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 20 client.15672 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.001+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8623f0 0x563c9a864820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.002+0000 7f240620f740 4 client.15672 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.002+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f23f0005070 con 0x563c9a8623f0 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.002+0000 7f2400a00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8623f0 0x563c9a864820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:24.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.003+0000 7f23e2000640 10 client.15672 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:24.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.003+0000 7f2400a00640 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8623f0 0x563c9a864820 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3e42f067405f3795 server_cookie=fae1503d51347dc1 in_seq=0 out_seq=0 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f23e2000640 1 -- 172.21.15.164:0/2195627963 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f23f0005070 con 0x563c9a8623f0 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f23e2000640 10 client.15672 handle_command_reply: tid=0 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 client.15672 shutdown 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 msgr2=0x563c9a8568c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f23e809b770 tx=0x7f23e8097480 comp rx=0 tx=0).stop 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 shutdown_connections 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8623f0 0x563c9a864820 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a85d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a8444a0 0x563c9a8568c0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 --2- 172.21.15.164:0/2195627963 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a843ab0 0x563c9a856380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 >> 172.21.15.164:0/2195627963 conn(0x563c9a83f020 msgr2=0x563c9a83e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f23e2000640 0 client.15672 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 shutdown_connections 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 1 -- 172.21.15.164:0/2195627963 wait complete. 2024-03-27T08:36:24.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.006+0000 7f240620f740 20 client.15672 trim_cache size 0 max 16384 2024-03-27T08:36:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 Processor -- start 2024-03-27T08:36:25.012 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 -- start start 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a8444a0 0x563c9a85d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a845c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a9490 con 0x563c9a843ab0 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a6d60 con 0x563c9a849610 2024-03-27T08:36:25.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f240620f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a4bb0 con 0x563c9a8444a0 2024-03-27T08:36:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f2400a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f2400a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33360/0 (socket says 172.21.15.164:33360) 2024-03-27T08:36:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.021+0000 7f2400a00640 1 -- 172.21.15.164:0/2295573396 learned_addr learned my addr 172.21.15.164:0/2295573396 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2401400640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a845c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a8444a0 0x563c9a85d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 -- 172.21.15.164:0/2295573396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a8444a0 msgr2=0x563c9a85d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a8444a0 0x563c9a85d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 -- 172.21.15.164:0/2295573396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 msgr2=0x563c9a845c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a845c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 -- 172.21.15.164:0/2295573396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c9a83aa90 con 0x563c9a843ab0 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2401400640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a845c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.022+0000 7f2400a00640 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005ec0 tx=0x7f23f0005e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8319c8c5173329f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f23ed200640 1 -- 172.21.15.164:0/2295573396 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00054a0 con 0x563c9a843ab0 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f23ed200640 1 -- 172.21.15.164:0/2295573396 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23f004f070 con 0x563c9a843ab0 2024-03-27T08:36:25.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f23ed200640 1 -- 172.21.15.164:0/2295573396 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f00038e0 con 0x563c9a843ab0 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 -- 172.21.15.164:0/2295573396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 msgr2=0x563c9a8456c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005ec0 tx=0x7f23f0005e50 comp rx=0 tx=0).stop 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 -- 172.21.15.164:0/2295573396 shutdown_connections 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a849610 0x563c9a845c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a8444a0 0x563c9a85d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.023+0000 7f240620f740 1 --2- 172.21.15.164:0/2295573396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a8456c0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.024+0000 7f240620f740 1 -- 172.21.15.164:0/2295573396 >> 172.21.15.164:0/2295573396 conn(0x563c9a83f020 msgr2=0x563c9a848cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.024+0000 7f240620f740 1 -- 172.21.15.164:0/2295573396 shutdown_connections 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.024+0000 7f240620f740 1 -- 172.21.15.164:0/2295573396 wait complete. 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.024+0000 7f240620f740 1 -- start start 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.024+0000 7f240620f740 1 Processor -- start 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a85b290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a849610 0x563c9a85c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a5220 con 0x563c9a843ab0 2024-03-27T08:36:25.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a6690 con 0x563c9a8444a0 2024-03-27T08:36:25.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23fc1a58f0 con 0x563c9a849610 2024-03-27T08:36:25.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f240620f740 10 client.0 _ll_register_callbacks cb 0x7f23e80d2a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:25.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f2400a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.019 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f2400a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33362/0 (socket says 172.21.15.164:33362) 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f2400a00640 1 -- 172.21.15.164:0/2721265791 learned_addr learned my addr 172.21.15.164:0/2721265791 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.025+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a85b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 -- 172.21.15.164:0/2721265791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a849610 msgr2=0x563c9a85c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a849610 0x563c9a85c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 -- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 msgr2=0x563c9a85b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a85b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 -- 172.21.15.164:0/2721265791 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c9a85c840 con 0x563c9a843ab0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f2400a00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f002c2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afeacb0fffdd1b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f23e2000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0004240 con 0x563c9a843ab0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23f00043e0 con 0x563c9a843ab0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.026+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f004f070 con 0x563c9a843ab0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23f0003660 con 0x563c9a843ab0 2024-03-27T08:36:25.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 10 client.15678 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x563c9a85db40 con 0x563c9a843ab0 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23f004f070 con 0x563c9a843ab0 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f23f0004a30 con 0x563c9a843ab0 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 10 client.15678 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 10 client.15678 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 20 client.15678 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8c89c0 0x563c9a8cadb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 4 client.15678 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.027+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c9a7b5bb0 con 0x563c9a8c89c0 2024-03-27T08:36:25.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.028+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8c89c0 0x563c9a8cadb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.029+0000 7f23fbe00640 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8c89c0 0x563c9a8cadb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adedc749f3b938fd server_cookie=886009e310d45c0c in_seq=0 out_seq=0 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.029+0000 7f23e2000640 10 client.15678 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.029+0000 7f23e2000640 1 -- 172.21.15.164:0/2721265791 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c9a7b5bb0 con 0x563c9a8c89c0 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.029+0000 7f23e2000640 10 client.15678 handle_command_reply: tid=0 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.029+0000 7f240620f740 1 client.15678 shutdown 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 msgr2=0x563c9a85ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f23f0000c00 tx=0x7f23f002c2b0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 shutdown_connections 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x563c9a8c89c0 0x563c9a8cadb0 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563c9a849610 0x563c9a85c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c9a8444a0 0x563c9a85b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 --2- 172.21.15.164:0/2721265791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563c9a843ab0 0x563c9a85ad50 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 >> 172.21.15.164:0/2721265791 conn(0x563c9a83f020 msgr2=0x563c9a8562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f23e2000640 0 client.15678 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:25.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 shutdown_connections 2024-03-27T08:36:25.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 1 -- 172.21.15.164:0/2721265791 wait complete. 2024-03-27T08:36:25.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.030+0000 7f240620f740 20 client.15678 trim_cache size 0 max 16384 2024-03-27T08:36:25.024 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 msgr2=0x7f23e40a9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 0x7f23e40a9f60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x563c9a844d00 tx=0x7f23f4009740 comp rx=0 tx=0).stop 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 msgr2=0x7f23fc198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f23e800d950 tx=0x7f23e800de10 comp rx=0 tx=0).stop 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 shutdown_connections 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23e40a7aa0 0x7f23e40a9f60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23fc103600 0x7f23fc19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23fc102c40 0x7f23fc198290 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 --2- 172.21.15.164:0/747566509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23fc101a50 0x7f23fc197d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 >> 172.21.15.164:0/747566509 conn(0x7f23fc0fcfc0 msgr2=0x7f23fc105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 shutdown_connections 2024-03-27T08:36:25.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.031+0000 7f2401e00640 1 -- 172.21.15.164:0/747566509 wait complete. 2024-03-27T08:36:25.038 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.281+0000 7f4fcf200640 1 -- 172.21.15.164:0/1691909858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 msgr2=0x7f4fd0101a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.281+0000 7f4fcf200640 1 --2- 172.21.15.164:0/1691909858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd0101a80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009ca0 tx=0x7f4fc802c100 comp rx=0 tx=0).stop 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.281+0000 7f4fcf200640 1 -- 172.21.15.164:0/1691909858 shutdown_connections 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.281+0000 7f4fcf200640 1 --2- 172.21.15.164:0/1691909858 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd0101a80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.282+0000 7f4fcf200640 1 --2- 172.21.15.164:0/1691909858 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100c60 0x7f4fd01010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.282+0000 7f4fcf200640 1 --2- 172.21.15.164:0/1691909858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100300 0x7f4fd0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.282+0000 7f4fcf200640 1 -- 172.21.15.164:0/1691909858 >> 172.21.15.164:0/1691909858 conn(0x7f4fd00fbec0 msgr2=0x7f4fd00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.282+0000 7f4fcf200640 1 -- 172.21.15.164:0/1691909858 shutdown_connections 2024-03-27T08:36:25.274 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.282+0000 7f4fcf200640 1 -- 172.21.15.164:0/1691909858 wait complete. 2024-03-27T08:36:25.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.284+0000 7f4fcf200640 1 Processor -- start 2024-03-27T08:36:25.276 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.284+0000 7f4fcf200640 1 -- start start 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100300 0x7f4fd00704b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 0x7f4fd00709f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010f8a0 con 0x7f4fd0101600 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010f720 con 0x7f4fd0100c60 2024-03-27T08:36:25.277 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.285+0000 7f4fcf200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd010fa20 con 0x7f4fd0100300 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33382/0 (socket says 172.21.15.164:33382) 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 -- 172.21.15.164:0/2388489199 learned_addr learned my addr 172.21.15.164:0/2388489199 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fcd400640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 0x7f4fd00709f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fcde00640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100300 0x7f4fd00704b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 -- 172.21.15.164:0/2388489199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100300 msgr2=0x7f4fd00704b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100300 0x7f4fd00704b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 -- 172.21.15.164:0/2388489199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 msgr2=0x7f4fd00709f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 0x7f4fd00709f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fce800640 1 -- 172.21.15.164:0/2388489199 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fd0071090 con 0x7f4fd0101600 2024-03-27T08:36:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.286+0000 7f4fcd400640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 0x7f4fd00709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.287+0000 7f4fce800640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009bf0 tx=0x7f4fc8034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.287+0000 7f4fc6a00640 1 -- 172.21.15.164:0/2388489199 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc8039050 con 0x7f4fd0101600 2024-03-27T08:36:25.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.287+0000 7f4fc6a00640 1 -- 172.21.15.164:0/2388489199 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4fc803a040 con 0x7f4fd0101600 2024-03-27T08:36:25.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.287+0000 7f4fc6a00640 1 -- 172.21.15.164:0/2388489199 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc80046a0 con 0x7f4fd0101600 2024-03-27T08:36:25.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.287+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fd01aa570 con 0x7f4fd0101600 2024-03-27T08:36:25.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.288+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fd01aa9e0 con 0x7f4fd0101600 2024-03-27T08:36:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.292+0000 7f4fd776d740 1 Processor -- start 2024-03-27T08:36:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.292+0000 7f4fc6a00640 1 -- 172.21.15.164:0/2388489199 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4fc8003970 con 0x7f4fd0101600 2024-03-27T08:36:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.292+0000 7f4fd776d740 1 -- start start 2024-03-27T08:36:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff412c0 0x55d86ff416e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff467b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d86ff007b0 con 0x55d86ff46e20 2024-03-27T08:36:25.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d86fe9d670 con 0x55d86ff412c0 2024-03-27T08:36:25.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fd776d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d86fe45970 con 0x55d86ff41cb0 2024-03-27T08:36:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fcd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fcd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33396/0 (socket says 172.21.15.164:33396) 2024-03-27T08:36:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fcd400640 1 -- 172.21.15.164:0/1347479990 learned_addr learned my addr 172.21.15.164:0/1347479990 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fcde00640 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff467b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.293+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff412c0 0x55d86ff416e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 -- 172.21.15.164:0/1347479990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 msgr2=0x55d86ff467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff467b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 -- 172.21.15.164:0/1347479990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff412c0 msgr2=0x55d86ff416e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff412c0 0x55d86ff416e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 -- 172.21.15.164:0/1347479990 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d86fbb13f0 con 0x55d86ff46e20 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55d86ff42510 tx=0x7f4fbc00c570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=152f7aea6b9fdeab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.294+0000 7f4fc6a00640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 0x7f4fb40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.295+0000 7f4fc6a00640 1 -- 172.21.15.164:0/2388489199 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4fc80f2390 con 0x7f4fd0101600 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.295+0000 7f4fbb000640 1 -- 172.21.15.164:0/1347479990 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc0142d0 con 0x55d86ff46e20 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.295+0000 7f4fbb000640 1 -- 172.21.15.164:0/1347479990 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4fbc00f820 con 0x55d86ff46e20 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.295+0000 7f4fbb000640 1 -- 172.21.15.164:0/1347479990 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fbc003850 con 0x55d86ff46e20 2024-03-27T08:36:25.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.295+0000 7f4fcde00640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 0x7f4fb40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fcde00640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 0x7f4fb40a5b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55d86ff420b0 tx=0x7f4fc0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 -- 172.21.15.164:0/1347479990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 msgr2=0x55d86ff492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x55d86ff42510 tx=0x7f4fbc00c570 comp rx=0 tx=0).stop 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 -- 172.21.15.164:0/1347479990 shutdown_connections 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff46e20 0x55d86ff492b0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff467b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1347479990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff412c0 0x55d86ff416e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 -- 172.21.15.164:0/1347479990 >> 172.21.15.164:0/1347479990 conn(0x55d86ff34020 msgr2=0x55d86ff34420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 -- 172.21.15.164:0/1347479990 shutdown_connections 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.296+0000 7f4fd776d740 1 -- 172.21.15.164:0/1347479990 wait complete. 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.297+0000 7f4fd776d740 1 -- start start 2024-03-27T08:36:25.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.297+0000 7f4fd776d740 1 Processor -- start 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.297+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.297+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff41cb0 0x55d86ff4b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff46e20 0x55d86ff52a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fd776d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d86fe58ca0 con 0x55d86ff412c0 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fd776d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d86fe99620 con 0x55d86ff41cb0 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fd776d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d86ff49d70 con 0x55d86ff46e20 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fd776d740 10 client.0 _ll_register_callbacks cb 0x55d86fe95160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33410/0 (socket says 172.21.15.164:33410) 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 -- 172.21.15.164:0/1039595788 learned_addr learned my addr 172.21.15.164:0/1039595788 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 -- 172.21.15.164:0/1039595788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff46e20 msgr2=0x55d86ff52a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff46e20 0x55d86ff52a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 -- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff41cb0 msgr2=0x55d86ff4b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff41cb0 0x55d86ff4b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.298+0000 7f4fcde00640 1 -- 172.21.15.164:0/1039595788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d86fc7b7d0 con 0x55d86ff412c0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4fcde00640 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004630 tx=0x7f4fc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f25880945764f326 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4faf400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0010ce0 con 0x55d86ff412c0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4fc0028400 con 0x55d86ff412c0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4fbc00f820 con 0x55d86ff412c0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fc0010e80 con 0x55d86ff412c0 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.299+0000 7f4fd776d740 10 client.15690 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:25.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d86ff55e50 con 0x55d86ff412c0 2024-03-27T08:36:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4fbc00f820 con 0x55d86ff412c0 2024-03-27T08:36:25.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4fc0020740 con 0x55d86ff412c0 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 10 client.15690 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 10 client.15690 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 20 client.15690 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff575e0 0x55d86ff59a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 4 client.15690 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.300+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d86feaabb0 con 0x55d86ff575e0 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.301+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff575e0 0x55d86ff59a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.302+0000 7f4faf400640 10 client.15690 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:25.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.302+0000 7f4fcd400640 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff575e0 0x55d86ff59a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9d417d99f86f35b server_cookie=fc1f1b64cc09412 in_seq=0 out_seq=0 2024-03-27T08:36:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.303+0000 7f4faf400640 1 -- 172.21.15.164:0/1039595788 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d86feaabb0 con 0x55d86ff575e0 2024-03-27T08:36:25.295 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.303+0000 7f4faf400640 10 client.15690 handle_command_reply: tid=0 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 client.15690 shutdown 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 msgr2=0x55d86ff4b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0004630 tx=0x7f4fc00046c0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 shutdown_connections 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff575e0 0x55d86ff59a80 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff46e20 0x55d86ff52a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff41cb0 0x55d86ff4b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 --2- 172.21.15.164:0/1039595788 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b4a0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 >> 172.21.15.164:0/1039595788 conn(0x55d86ff34020 msgr2=0x55d86ff33240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4faf400640 0 client.15690 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 shutdown_connections 2024-03-27T08:36:25.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.304+0000 7f4fd776d740 1 -- 172.21.15.164:0/1039595788 wait complete. 2024-03-27T08:36:25.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.305+0000 7f4fd776d740 20 client.15690 trim_cache size 0 max 16384 2024-03-27T08:36:25.323 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 Processor -- start 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 -- start start 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff529e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff401a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01b1d20 con 0x55d86ff412c0 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01af5f0 con 0x55d86ff46e20 2024-03-27T08:36:25.324 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.332+0000 7f4fd776d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01ad460 con 0x55d86ff41cb0 2024-03-27T08:36:25.325 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33426/0 (socket says 172.21.15.164:33426) 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 -- 172.21.15.164:0/3792166103 learned_addr learned my addr 172.21.15.164:0/3792166103 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcd400640 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fce800640 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff401a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 -- 172.21.15.164:0/3792166103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 msgr2=0x55d86ff529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 -- 172.21.15.164:0/3792166103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 msgr2=0x55d86ff401a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff401a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.333+0000 7f4fcde00640 1 -- 172.21.15.164:0/3792166103 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d86ff2f8a0 con 0x55d86ff412c0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.334+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000a010 tx=0x7f4fc0010820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8353f2cd6b856882 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.334+0000 7f4fba600640 1 -- 172.21.15.164:0/3792166103 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0010ce0 con 0x55d86ff412c0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.334+0000 7f4fba600640 1 -- 172.21.15.164:0/3792166103 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4fc00117f0 con 0x55d86ff412c0 2024-03-27T08:36:25.326 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.334+0000 7f4fba600640 1 -- 172.21.15.164:0/3792166103 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004730 con 0x55d86ff412c0 2024-03-27T08:36:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 -- 172.21.15.164:0/3792166103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 msgr2=0x55d86ff4b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f4fc000a010 tx=0x7f4fc0010820 comp rx=0 tx=0).stop 2024-03-27T08:36:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 -- 172.21.15.164:0/3792166103 shutdown_connections 2024-03-27T08:36:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff401a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.327 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff41cb0 0x55d86ff529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3792166103 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff412c0 0x55d86ff4b940 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 -- 172.21.15.164:0/3792166103 >> 172.21.15.164:0/3792166103 conn(0x55d86ff34020 msgr2=0x55d86ff3fa90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 -- 172.21.15.164:0/3792166103 shutdown_connections 2024-03-27T08:36:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.335+0000 7f4fd776d740 1 -- 172.21.15.164:0/3792166103 wait complete. 2024-03-27T08:36:25.328 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.336+0000 7f4fd776d740 1 -- start start 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.336+0000 7f4fd776d740 1 Processor -- start 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff50d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 0x55d86ff521e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01adab0 con 0x55d86ff41cb0 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01aef20 con 0x55d86ff46e20 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4fd01ae180 con 0x55d86ff51d60 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fd776d740 10 client.0 _ll_register_callbacks cb 0x7f4fc0009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:33430/0 (socket says 172.21.15.164:33430) 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fcd400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff50d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.329 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.337+0000 7f4fcde00640 1 -- 172.21.15.164:0/3809659397 learned_addr learned my addr 172.21.15.164:0/3809659397 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 -- 172.21.15.164:0/3809659397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 msgr2=0x55d86ff521e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fce800640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 0x55d86ff521e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 0x55d86ff521e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 -- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 msgr2=0x55d86ff50d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff50d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 -- 172.21.15.164:0/3809659397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d86ff52720 con 0x55d86ff41cb0 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fce800640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 0x55d86ff521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4fcde00640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0022040 tx=0x7f4fc0005520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=197e24f3eb5fe655 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:25.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.338+0000 7f4faf400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fc0004230 con 0x55d86ff41cb0 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4fc00043d0 con 0x55d86ff41cb0 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d86fea4f00 con 0x55d86ff41cb0 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4fc00203f0 con 0x55d86ff41cb0 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4fd776d740 10 client.15696 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:25.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.339+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55d86ff35d30 con 0x55d86ff41cb0 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.340+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55d86fea4f00 con 0x55d86ff41cb0 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f4fc00035f0 con 0x55d86ff41cb0 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 10 client.15696 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 10 client.15696 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 20 client.15696 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff365f0 0x55d86ff38a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 4 client.15696 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d86fe22560 con 0x55d86ff365f0 2024-03-27T08:36:25.333 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.341+0000 7f4fcd400640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff365f0 0x55d86ff38a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:25.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.342+0000 7f4fcd400640 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff365f0 0x55d86ff38a10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0737707974c00da server_cookie=1f85e9f6236f26be in_seq=0 out_seq=0 2024-03-27T08:36:25.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4faf400640 10 client.15696 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:25.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4faf400640 1 -- 172.21.15.164:0/3809659397 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d86fe22560 con 0x55d86ff365f0 2024-03-27T08:36:25.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4faf400640 10 client.15696 handle_command_reply: tid=0 2024-03-27T08:36:25.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4fd776d740 1 client.15696 shutdown 2024-03-27T08:36:25.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 msgr2=0x55d86ff50810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f4fc0022040 tx=0x7f4fc0005520 comp rx=0 tx=0).stop 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.343+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 shutdown_connections 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d86ff365f0 0x55d86ff38a10 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d86ff51d60 0x55d86ff521e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d86ff46e20 0x55d86ff50d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 --2- 172.21.15.164:0/3809659397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d86ff41cb0 0x55d86ff50810 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 >> 172.21.15.164:0/3809659397 conn(0x55d86ff34020 msgr2=0x55d86ff40320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4faf400640 0 client.15696 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 shutdown_connections 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 1 -- 172.21.15.164:0/3809659397 wait complete. 2024-03-27T08:36:25.336 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.344+0000 7f4fd776d740 20 client.15696 trim_cache size 0 max 16384 2024-03-27T08:36:25.337 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:25.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 msgr2=0x7f4fb40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 0x7f4fb40a5b50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x55d86ff420b0 tx=0x7f4fc0005f90 comp rx=0 tx=0).stop 2024-03-27T08:36:25.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 msgr2=0x7f4fd01a9f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:25.337 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f4fc8009bf0 tx=0x7f4fc8034cd0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 shutdown_connections 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4fb40a3690 0x7f4fb40a5b50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4fd0101600 0x7f4fd01a9f70 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fd0100c60 0x7f4fd00709f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 --2- 172.21.15.164:0/2388489199 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4fd0100300 0x7f4fd00704b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 >> 172.21.15.164:0/2388489199 conn(0x7f4fd00fbec0 msgr2=0x7f4fd00fd570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 shutdown_connections 2024-03-27T08:36:25.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:25.345+0000 7f4fcf200640 1 -- 172.21.15.164:0/2388489199 wait complete. 2024-03-27T08:36:25.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:25 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/43831662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:25.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:25 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/43831662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:25.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:25 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/43831662' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 -- 172.21.15.164:0/2360022747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc102b80 msgr2=0x7fd2bc104ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 --2- 172.21.15.164:0/2360022747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc102b80 0x7fd2bc104ff0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4009900 tx=0x7fd2a402bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 -- 172.21.15.164:0/2360022747 shutdown_connections 2024-03-27T08:36:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 --2- 172.21.15.164:0/2360022747 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc105530 0x7fd2bc1059b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 --2- 172.21.15.164:0/2360022747 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc102b80 0x7fd2bc104ff0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 --2- 172.21.15.164:0/2360022747 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc100210 0x7fd2bc102640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 -- 172.21.15.164:0/2360022747 >> 172.21.15.164:0/2360022747 conn(0x7fd2bc0fbe30 msgr2=0x7fd2bc0fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 -- 172.21.15.164:0/2360022747 shutdown_connections 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.072+0000 7fd2c1800640 1 -- 172.21.15.164:0/2360022747 wait complete. 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 Processor -- start 2024-03-27T08:36:26.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 -- start start 2024-03-27T08:36:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.066 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 0x7fd2bc19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 0x7fd2bc1a5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc113c60 con 0x7fd2bc100210 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc113ae0 con 0x7fd2bc102b80 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.074+0000 7fd2c1800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd2bc113de0 con 0x7fd2bc105530 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40496/0 (socket says 172.21.15.164:40496) 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 -- 172.21.15.164:0/4010911960 learned_addr learned my addr 172.21.15.164:0/4010911960 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 0x7fd2bc1a5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2b3400640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 0x7fd2bc19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 -- 172.21.15.164:0/4010911960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 msgr2=0x7fd2bc1a5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 0x7fd2bc1a5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 -- 172.21.15.164:0/4010911960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 msgr2=0x7fd2bc19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 0x7fd2bc19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2bbe00640 1 -- 172.21.15.164:0/4010911960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2bc1a5ed0 con 0x7fd2bc100210 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 0x7fd2bc1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.075+0000 7fd2b3400640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 0x7fd2bc19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ea80 tx=0x7fd2ac00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2b9600640 1 -- 172.21.15.164:0/4010911960 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac00ce40 con 0x7fd2bc100210 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2b9600640 1 -- 172.21.15.164:0/4010911960 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2ac005020 con 0x7fd2bc100210 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2bc1a61c0 con 0x7fd2bc100210 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2bc1a6690 con 0x7fd2bc100210 2024-03-27T08:36:26.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.076+0000 7fd2b9600640 1 -- 172.21.15.164:0/4010911960 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0116d0 con 0x7fd2bc100210 2024-03-27T08:36:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 Processor -- start 2024-03-27T08:36:26.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 -- start start 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc866f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc86c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc7cbd10 con 0x55b2bc86c6c0 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc774260 con 0x55b2bc866b60 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc7c7cc0 con 0x55b2bc867550 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.080+0000 7fd2b3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40506/0 (socket says 172.21.15.164:40506) 2024-03-27T08:36:26.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 -- 172.21.15.164:0/3420698797 learned_addr learned my addr 172.21.15.164:0/3420698797 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc866f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 -- 172.21.15.164:0/3420698797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 msgr2=0x55b2bc86c050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc86c050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 -- 172.21.15.164:0/3420698797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 msgr2=0x55b2bc866f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc866f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 -- 172.21.15.164:0/3420698797 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bc76baa0 con 0x55b2bc86c6c0 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc866f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b9600640 1 -- 172.21.15.164:0/4010911960 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fd2ac0055b0 con 0x7fd2bc100210 2024-03-27T08:36:26.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.081+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4000c00 tx=0x7fd2a4009670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9147840397ea32 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.082+0000 7fd2b1600640 1 -- 172.21.15.164:0/3420698797 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a402cb20 con 0x55b2bc86c6c0 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.082+0000 7fd2b1600640 1 -- 172.21.15.164:0/3420698797 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2a402ccc0 con 0x55b2bc86c6c0 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.082+0000 7fd2b1600640 1 -- 172.21.15.164:0/3420698797 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a40049b0 con 0x55b2bc86c6c0 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.082+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3420698797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 msgr2=0x55b2bc86eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.082+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4000c00 tx=0x7fd2a4009670 comp rx=0 tx=0).stop 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3420698797 shutdown_connections 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc86c6c0 0x55b2bc86eb50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc86c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3420698797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc866f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3420698797 >> 172.21.15.164:0/3420698797 conn(0x55b2bc8620d0 msgr2=0x55b2bc8624d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3420698797 shutdown_connections 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3420698797 wait complete. 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.083+0000 7fd2c5bd6740 1 -- start start 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 Processor -- start 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2b9600640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 0x7fd2a00a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc870ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2b9600640 1 -- 172.21.15.164:0/4010911960 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd2ac0d0140 con 0x7fd2bc100210 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc8783e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc86f610 con 0x55b2bc867550 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc787630 con 0x55b2bc866b60 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b2bc86f790 con 0x55b2bc86c6c0 2024-03-27T08:36:26.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2c5bd6740 10 client.0 _ll_register_callbacks cb 0x55b2bc78cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2b3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.084+0000 7fd2b3400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40508/0 (socket says 172.21.15.164:40508) 2024-03-27T08:36:26.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 -- 172.21.15.164:0/3517748572 learned_addr learned my addr 172.21.15.164:0/3517748572 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 0x7fd2a00a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc870ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 -- 172.21.15.164:0/3517748572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 msgr2=0x55b2bc8783e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc8783e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 -- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 msgr2=0x55b2bc870ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc870ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 -- 172.21.15.164:0/3517748572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bc7935f0 con 0x55b2bc867550 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2b3400640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4036040 tx=0x7fd2a40044a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=937f5a3a4dfe6740 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.085+0000 7fd2aa000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a404e070 con 0x55b2bc867550 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd2a4003ac0 con 0x55b2bc867550 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55b2bc7d9250 con 0x55b2bc867550 2024-03-27T08:36:26.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 0x7fd2a00a5a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b2bc867db0 tx=0x7fd2b4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd2a4003cc0 con 0x55b2bc867550 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2c5bd6740 10 client.15708 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.086+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b2bc4e0210 con 0x55b2bc867550 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2a405a070 con 0x55b2bc867550 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd2a403e470 con 0x55b2bc867550 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 10 client.15708 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 10 client.15708 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 20 client.15708 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc87c8d0 0x55b2bc87ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 4 client.15708 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b2bc7d35a0 con 0x55b2bc87c8d0 2024-03-27T08:36:26.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.087+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc87c8d0 0x55b2bc87ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.082 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.088+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc87c8d0 0x55b2bc87ecc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a98ea7ab830bf530 server_cookie=2917f1dd21b0ae55 in_seq=0 out_seq=0 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.088+0000 7fd2aa000640 10 client.15708 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2aa000640 1 -- 172.21.15.164:0/3517748572 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b2bc7d35a0 con 0x55b2bc87c8d0 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2aa000640 10 client.15708 handle_command_reply: tid=0 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 client.15708 shutdown 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 msgr2=0x55b2bc871410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fd2a4036040 tx=0x7fd2a40044a0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 shutdown_connections 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc87c8d0 0x55b2bc87ecc0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc8783e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc867550 0x55b2bc871410 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/3517748572 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc866b60 0x55b2bc870ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 >> 172.21.15.164:0/3517748572 conn(0x55b2bc8620d0 msgr2=0x55b2bc861310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2aa000640 0 client.15708 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 shutdown_connections 2024-03-27T08:36:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.090+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/3517748572 wait complete. 2024-03-27T08:36:26.084 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.091+0000 7fd2c5bd6740 20 client.15708 trim_cache size 0 max 16384 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.119+0000 7fd2c5bd6740 1 Processor -- start 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 -- start start 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc8783a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc86c6c0 0x55b2bc85d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd298010db0 con 0x55b2bc866b60 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd29800e680 con 0x55b2bc86c6c0 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd29800c4d0 con 0x55b2bc867550 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40510/0 (socket says 172.21.15.164:40510) 2024-03-27T08:36:26.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.120+0000 7fd2bbe00640 1 -- 172.21.15.164:0/1339030553 learned_addr learned my addr 172.21.15.164:0/1339030553 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc86c6c0 0x55b2bc85d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2b3400640 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc8783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 -- 172.21.15.164:0/1339030553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 msgr2=0x55b2bc8783a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc8783a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 -- 172.21.15.164:0/1339030553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc86c6c0 msgr2=0x55b2bc85d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc86c6c0 0x55b2bc85d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 -- 172.21.15.164:0/1339030553 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b2bc5ac620 con 0x55b2bc866b60 2024-03-27T08:36:26.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac09c550 tx=0x7fd2ac087050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77bbd44dba1ce58 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2b0c00640 1 -- 172.21.15.164:0/1339030553 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0ba070 con 0x55b2bc866b60 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2b0c00640 1 -- 172.21.15.164:0/1339030553 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2ac0a5230 con 0x55b2bc866b60 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.121+0000 7fd2b0c00640 1 -- 172.21.15.164:0/1339030553 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac01f040 con 0x55b2bc866b60 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/1339030553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 msgr2=0x55b2bc865a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac09c550 tx=0x7fd2ac087050 comp rx=0 tx=0).stop 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/1339030553 shutdown_connections 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc86c6c0 0x55b2bc85d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc867550 0x55b2bc8783a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/1339030553 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc865a40 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/1339030553 >> 172.21.15.164:0/1339030553 conn(0x55b2bc8620d0 msgr2=0x55b2bc865330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/1339030553 shutdown_connections 2024-03-27T08:36:26.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.122+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/1339030553 wait complete. 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.123+0000 7fd2c5bd6740 1 -- start start 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.123+0000 7fd2c5bd6740 1 Processor -- start 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc867550 0x55b2bc8766d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc877690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd29800cb40 con 0x55b2bc866b60 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd29800dfb0 con 0x55b2bc867550 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd29800d210 con 0x55b2bc86c6c0 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c5bd6740 10 client.0 _ll_register_callbacks cb 0x7fd2a4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40514/0 (socket says 172.21.15.164:40514) 2024-03-27T08:36:26.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2bbe00640 1 -- 172.21.15.164:0/2494823138 learned_addr learned my addr 172.21.15.164:0/2494823138 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2c0e00640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc877690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.124+0000 7fd2b3400640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc867550 0x55b2bc8766d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 -- 172.21.15.164:0/2494823138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 msgr2=0x55b2bc877690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc877690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 -- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc867550 msgr2=0x55b2bc8766d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc867550 0x55b2bc8766d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 -- 172.21.15.164:0/2494823138 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b2bc877c80 con 0x55b2bc866b60 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2bbe00640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac087180 tx=0x7fd2ac005240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bbeefd619ee30bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2aa000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ac0ba050 con 0x55b2bc866b60 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd2ac0cdc70 con 0x55b2bc866b60 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.125+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd2ac0a5230 con 0x55b2bc866b60 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.126+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd2ac01f040 con 0x55b2bc866b60 2024-03-27T08:36:26.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.126+0000 7fd2c5bd6740 10 client.15714 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.126+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b2bc8e3200 con 0x55b2bc866b60 2024-03-27T08:36:26.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.126+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2ac0a5230 con 0x55b2bc866b60 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.126+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fd2ac00f040 con 0x55b2bc866b60 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 10 client.15714 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 10 client.15714 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 20 client.15714 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc8e3aa0 0x55b2bc8e5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 4 client.15714 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b2bc751630 con 0x55b2bc8e3aa0 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.127+0000 7fd2b3400640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc8e3aa0 0x55b2bc8e5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.128+0000 7fd2b3400640 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc8e3aa0 0x55b2bc8e5ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=495a517aebced065 server_cookie=f08c1a4739f5b666 in_seq=0 out_seq=0 2024-03-27T08:36:26.121 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.128+0000 7fd2aa000640 10 client.15714 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2aa000640 1 -- 172.21.15.164:0/2494823138 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b2bc751630 con 0x55b2bc8e3aa0 2024-03-27T08:36:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2aa000640 10 client.15714 handle_command_reply: tid=0 2024-03-27T08:36:26.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 client.15714 shutdown 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 msgr2=0x55b2bc876190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac087180 tx=0x7fd2ac005240 comp rx=0 tx=0).stop 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 shutdown_connections 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b2bc8e3aa0 0x55b2bc8e5ec0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b2bc86c6c0 0x55b2bc877690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b2bc867550 0x55b2bc8766d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.136+0000 7fd2c5bd6740 1 --2- 172.21.15.164:0/2494823138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b2bc866b60 0x55b2bc876190 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.137+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 >> 172.21.15.164:0/2494823138 conn(0x55b2bc8620d0 msgr2=0x55b2bc8701c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.137+0000 7fd2aa000640 0 client.15714 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.137+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 shutdown_connections 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.137+0000 7fd2c5bd6740 1 -- 172.21.15.164:0/2494823138 wait complete. 2024-03-27T08:36:26.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.137+0000 7fd2c5bd6740 20 client.15714 trim_cache size 0 max 16384 2024-03-27T08:36:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:36:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:36:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:36:26.130 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 msgr2=0x7fd2a00a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 0x7fd2a00a5a60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x55b2bc867db0 tx=0x7fd2b4005f90 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 msgr2=0x7fd2bc19e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fd2ac00ea80 tx=0x7fd2ac00ef40 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 shutdown_connections 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd2a00a35a0 0x7fd2a00a5a60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd2bc105530 0x7fd2bc1a5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2bc102b80 0x7fd2bc19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 --2- 172.21.15.164:0/4010911960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd2bc100210 0x7fd2bc19e2b0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 >> 172.21.15.164:0/4010911960 conn(0x7fd2bc0fbe30 msgr2=0x7fd2bc100ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.131 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 shutdown_connections 2024-03-27T08:36:26.132 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:26.138+0000 7fd2c1800640 1 -- 172.21.15.164:0/4010911960 wait complete. 2024-03-27T08:36:26.361 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T08:36:26.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:36:26.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T08:36:26.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 -- 172.21.15.164:0/1214551276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c103c50 msgr2=0x7f563c104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 --2- 172.21.15.164:0/1214551276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c103c50 0x7f563c104070 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f5630009900 tx=0x7f563002bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:26.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 -- 172.21.15.164:0/1214551276 shutdown_connections 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 --2- 172.21.15.164:0/1214551276 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f563c105800 0x7f563c10c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 --2- 172.21.15.164:0/1214551276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c104e40 0x7f563c1052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 --2- 172.21.15.164:0/1214551276 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c103c50 0x7f563c104070 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 -- 172.21.15.164:0/1214551276 >> 172.21.15.164:0/1214551276 conn(0x7f563c0ff1c0 msgr2=0x7f563c101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.581+0000 7f5642800640 1 -- 172.21.15.164:0/1214551276 shutdown_connections 2024-03-27T08:36:26.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.582+0000 7f5642800640 1 -- 172.21.15.164:0/1214551276 wait complete. 2024-03-27T08:36:26.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.582+0000 7f5642800640 1 Processor -- start 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 -- start start 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 0x7f563c199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f563c105800 0x7f563c1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f563c10f8f0 con 0x7f563c104e40 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f563c10f770 con 0x7f563c103c50 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5642800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f563c10fa70 con 0x7f563c105800 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5640a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5640a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40532/0 (socket says 172.21.15.164:40532) 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.583+0000 7f5640a00640 1 -- 172.21.15.164:0/3534530925 learned_addr learned my addr 172.21.15.164:0/3534530925 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5641400640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 0x7f563c199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 -- 172.21.15.164:0/3534530925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f563c105800 msgr2=0x7f563c1a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f563c105800 0x7f563c1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 -- 172.21.15.164:0/3534530925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 msgr2=0x7f563c199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 0x7f563c199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 -- 172.21.15.164:0/3534530925 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f563c1a1b50 con 0x7f563c104e40 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5641400640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 0x7f563c199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.584+0000 7f5640a00640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f562800e9f0 tx=0x7f562800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.585+0000 7f563a000640 1 -- 172.21.15.164:0/3534530925 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562800cd80 con 0x7f563c104e40 2024-03-27T08:36:26.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.585+0000 7f563a000640 1 -- 172.21.15.164:0/3534530925 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5628010900 con 0x7f563c104e40 2024-03-27T08:36:26.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.585+0000 7f563a000640 1 -- 172.21.15.164:0/3534530925 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56280189e0 con 0x7f563c104e40 2024-03-27T08:36:26.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.585+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f563c1a1e40 con 0x7f563c104e40 2024-03-27T08:36:26.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.585+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f563c1a22b0 con 0x7f563c104e40 2024-03-27T08:36:26.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.588+0000 7f563a000640 1 -- 172.21.15.164:0/3534530925 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f5628010ab0 con 0x7f563c104e40 2024-03-27T08:36:26.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.589+0000 7f5646a76740 1 Processor -- start 2024-03-27T08:36:26.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.589+0000 7f5646a76740 1 -- start start 2024-03-27T08:36:26.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 0x55ac060ebcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060ecf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 0x55ac060f3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ac06048280 con 0x55ac060ed460 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ac05ff06f0 con 0x55ac060eb8d0 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5646a76740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ac06044230 con 0x55ac060ecaa0 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f563a000640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 0x7f56240a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f563a000640 1 -- 172.21.15.164:0/3534530925 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f56280d0160 con 0x7f563c104e40 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.590+0000 7f5641400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060ecf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5641e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 0x55ac060ebcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5641e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 0x55ac060ebcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:52838/0 (socket says 172.21.15.164:52838) 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5641e00640 1 -- 172.21.15.164:0/2181971803 learned_addr learned my addr 172.21.15.164:0/2181971803 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5641e00640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 0x7f56240a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 0x55ac060f3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 -- 172.21.15.164:0/2181971803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 msgr2=0x55ac060ecf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060ecf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 -- 172.21.15.164:0/2181971803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 msgr2=0x55ac060ebcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 0x55ac060ebcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.591+0000 7f5640a00640 1 -- 172.21.15.164:0/2181971803 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac05e247e0 con 0x55ac060ed460 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.592+0000 7f5641e00640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 0x7f56240a5b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5634009fd0 tx=0x7f56340098c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.593+0000 7f5640a00640 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 0x55ac060f3cf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5628000c00 tx=0x7f562809c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f0857eb9d694ad5 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.593+0000 7f562e600640 1 -- 172.21.15.164:0/2181971803 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f562809c5e0 con 0x55ac060ed460 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.593+0000 7f562e600640 1 -- 172.21.15.164:0/2181971803 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f56280a0990 con 0x55ac060ed460 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.593+0000 7f562e600640 1 -- 172.21.15.164:0/2181971803 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5628098de0 con 0x55ac060ed460 2024-03-27T08:36:26.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.594+0000 7f5646a76740 1 -- 172.21.15.164:0/2181971803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 msgr2=0x55ac060f3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.594+0000 7f5646a76740 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 0x55ac060f3cf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f5628000c00 tx=0x7f562809c4e0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 -- 172.21.15.164:0/2181971803 shutdown_connections 2024-03-27T08:36:26.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060ed460 0x55ac060f3cf0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060ecf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 --2- 172.21.15.164:0/2181971803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060eb8d0 0x55ac060ebcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 -- 172.21.15.164:0/2181971803 >> 172.21.15.164:0/2181971803 conn(0x55ac060e6cc0 msgr2=0x55ac060e70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 -- 172.21.15.164:0/2181971803 shutdown_connections 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 -- 172.21.15.164:0/2181971803 wait complete. 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.595+0000 7f5646a76740 1 -- start start 2024-03-27T08:36:26.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 Processor -- start 2024-03-27T08:36:26.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ac060f43b0 con 0x55ac060eb8d0 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ac06003aa0 con 0x55ac060ecaa0 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ac060f4530 con 0x55ac060ed460 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.596+0000 7f5646a76740 10 client.0 _ll_register_callbacks cb 0x55ac06003490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5640a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40556/0 (socket says 172.21.15.164:40556) 2024-03-27T08:36:26.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 -- 172.21.15.164:0/1391178687 learned_addr learned my addr 172.21.15.164:0/1391178687 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 -- 172.21.15.164:0/1391178687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 msgr2=0x55ac060fd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 -- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 msgr2=0x55ac060f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060f62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.597+0000 7f5641400640 1 -- 172.21.15.164:0/1391178687 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac05e84f70 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5641400640 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5630009900 tx=0x7f5630004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760afadc3d8d1a91 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5622a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630005240 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f56300053e0 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56280a0990 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f56300055e0 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5646a76740 10 client.15726 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.598+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ac05d1c170 con 0x55ac060eb8d0 2024-03-27T08:36:26.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f56280a0990 con 0x55ac060eb8d0 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f56300039a0 con 0x55ac060eb8d0 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 10 client.15726 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 10 client.15726 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 20 client.15726 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06101c30 0x55ac061040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 4 client.15726 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:26.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.599+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac060557c0 con 0x55ac06101c30 2024-03-27T08:36:26.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.600+0000 7f5640a00640 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06101c30 0x55ac061040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.600+0000 7f5640a00640 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06101c30 0x55ac061040d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c94331488fa7b764 server_cookie=7adf71b15bc67817 in_seq=0 out_seq=0 2024-03-27T08:36:26.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.601+0000 7f5622a00640 10 client.15726 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.602+0000 7f5622a00640 1 -- 172.21.15.164:0/1391178687 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ac060557c0 con 0x55ac06101c30 2024-03-27T08:36:26.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.602+0000 7f5622a00640 10 client.15726 handle_command_reply: tid=0 2024-03-27T08:36:26.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 client.15726 shutdown 2024-03-27T08:36:26.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 msgr2=0x55ac060f5d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5630009900 tx=0x7f5630004270 comp rx=0 tx=0).stop 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 shutdown_connections 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06101c30 0x55ac061040d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 --2- 172.21.15.164:0/1391178687 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f5d80 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 >> 172.21.15.164:0/1391178687 conn(0x55ac060e6cc0 msgr2=0x55ac060dd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5622a00640 0 client.15726 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 shutdown_connections 2024-03-27T08:36:26.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 1 -- 172.21.15.164:0/1391178687 wait complete. 2024-03-27T08:36:26.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.603+0000 7f5646a76740 20 client.15726 trim_cache size 0 max 16384 2024-03-27T08:36:26.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 Processor -- start 2024-03-27T08:36:26.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 -- start start 2024-03-27T08:36:26.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.614 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ed460 0x55ac060f58e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a9550 con 0x55ac060eb8d0 2024-03-27T08:36:26.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a6e20 con 0x55ac060ed460 2024-03-27T08:36:26.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.622+0000 7f5646a76740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a4c70 con 0x55ac060ecaa0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40562/0 (socket says 172.21.15.164:40562) 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 -- 172.21.15.164:0/3766996385 learned_addr learned my addr 172.21.15.164:0/3766996385 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5640a00640 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641e00640 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ed460 0x55ac060f58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 -- 172.21.15.164:0/3766996385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 msgr2=0x55ac060fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 -- 172.21.15.164:0/3766996385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ed460 msgr2=0x55ac060f58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ed460 0x55ac060f58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 -- 172.21.15.164:0/3766996385 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac060eb700 con 0x55ac060eb8d0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.623+0000 7f5641400640 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5630006010 tx=0x7f5630000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31489d5e67858eab server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.624+0000 7f562dc00640 1 -- 172.21.15.164:0/3766996385 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630058070 con 0x55ac060eb8d0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.624+0000 7f562dc00640 1 -- 172.21.15.164:0/3766996385 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5630009520 con 0x55ac060eb8d0 2024-03-27T08:36:26.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.624+0000 7f562dc00640 1 -- 172.21.15.164:0/3766996385 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630034e60 con 0x55ac060eb8d0 2024-03-27T08:36:26.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- 172.21.15.164:0/3766996385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 msgr2=0x55ac060f53a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5630006010 tx=0x7f5630000bc0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- 172.21.15.164:0/3766996385 shutdown_connections 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ed460 0x55ac060f58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ecaa0 0x55ac060fd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 --2- 172.21.15.164:0/3766996385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060f53a0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- 172.21.15.164:0/3766996385 >> 172.21.15.164:0/3766996385 conn(0x55ac060e6cc0 msgr2=0x55ac060dd7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- 172.21.15.164:0/3766996385 shutdown_connections 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- 172.21.15.164:0/3766996385 wait complete. 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.625+0000 7f5646a76740 1 -- start start 2024-03-27T08:36:26.618 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 Processor -- start 2024-03-27T08:36:26.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060fb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fc770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a52e0 con 0x55ac060eb8d0 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a6750 con 0x55ac060ecaa0 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f563c1a59b0 con 0x55ac060ed460 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.626+0000 7f5646a76740 10 client.0 _ll_register_callbacks cb 0x7f563002cd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40568/0 (socket says 172.21.15.164:40568) 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 -- 172.21.15.164:0/227129203 learned_addr learned my addr 172.21.15.164:0/227129203 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 -- 172.21.15.164:0/227129203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 msgr2=0x55ac060fc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fc770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5640a00640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060fb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 -- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 msgr2=0x55ac060fb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060fb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 -- 172.21.15.164:0/227129203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac060e7730 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5641400640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f563002c170 tx=0x7f5630034dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5cbacce666ae2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.627+0000 7f5622a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5630060020 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f56300037f0 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5630009520 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5630058040 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5646a76740 10 client.15732 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ac061686b0 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.628+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5630009520 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f563003f410 con 0x55ac060eb8d0 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 10 client.15732 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 10 client.15732 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 20 client.15732 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06168fa0 0x55ac0616b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 4 client.15732 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.629+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ac0604fb10 con 0x55ac06168fa0 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.630+0000 7f5640a00640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06168fa0 0x55ac0616b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.630+0000 7f5640a00640 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06168fa0 0x55ac0616b3c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a58e8f7fcea6705d server_cookie=ec5038355bf76480 in_seq=0 out_seq=0 2024-03-27T08:36:26.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.630+0000 7f5622a00640 10 client.15732 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.632+0000 7f5622a00640 1 -- 172.21.15.164:0/227129203 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ac0604fb10 con 0x55ac06168fa0 2024-03-27T08:36:26.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.632+0000 7f5622a00640 10 client.15732 handle_command_reply: tid=0 2024-03-27T08:36:26.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.632+0000 7f5646a76740 1 client.15732 shutdown 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 msgr2=0x55ac060fb270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f563002c170 tx=0x7f5630034dd0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 shutdown_connections 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ac06168fa0 0x55ac0616b3c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ac060ed460 0x55ac060fc770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ac060ecaa0 0x55ac060fb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 --2- 172.21.15.164:0/227129203 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ac060eb8d0 0x55ac060fb270 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 >> 172.21.15.164:0/227129203 conn(0x55ac060e6cc0 msgr2=0x55ac060e9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.625 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5622a00640 0 client.15732 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 shutdown_connections 2024-03-27T08:36:26.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.633+0000 7f5646a76740 1 -- 172.21.15.164:0/227129203 wait complete. 2024-03-27T08:36:26.626 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.634+0000 7f5646a76740 20 client.15732 trim_cache size 0 max 16384 2024-03-27T08:36:26.627 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:36:26.627 INFO:teuthology.orchestra.run.smithi164.stdout: "return_code": 0, 2024-03-27T08:36:26.627 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_tag": "8b2b5954-6acb-4961-897a-ecb31f054e7d", 2024-03-27T08:36:26.627 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": "asynchronous" 2024-03-27T08:36:26.627 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.634+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 msgr2=0x7f56240a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.634+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 0x7f56240a5b50 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f5634009fd0 tx=0x7f56340098c0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.634+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 msgr2=0x7f563c19a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.634+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f562800e9f0 tx=0x7f562800eeb0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 shutdown_connections 2024-03-27T08:36:26.628 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56240a3690 0x7f56240a5b50 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f563c105800 0x7f563c1a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f563c104e40 0x7f563c19a470 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 --2- 172.21.15.164:0/3534530925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f563c103c50 0x7f563c199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 >> 172.21.15.164:0/3534530925 conn(0x7f563c0ff1c0 msgr2=0x7f563c1081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 shutdown_connections 2024-03-27T08:36:26.629 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.635+0000 7f5642800640 1 -- 172.21.15.164:0/3534530925 wait complete. 2024-03-27T08:36:26.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:36:26.648 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:36:26.708 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:26 smithi164 ceph-mon[31788]: pgmap v474: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:26 smithi167 ceph-mon[34903]: pgmap v474: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:26 smithi173 ceph-mon[35397]: pgmap v474: 97 pgs: 97 active+clean; 660 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.834+0000 7f8a1fc00640 1 -- 172.21.15.164:0/4233935116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18107840 msgr2=0x7f8a18109c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.834+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/4233935116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18107840 0x7f8a18109c90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009ca0 tx=0x7f8a1002c100 comp rx=0 tx=0).stop 2024-03-27T08:36:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 -- 172.21.15.164:0/4233935116 shutdown_connections 2024-03-27T08:36:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/4233935116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18107840 0x7f8a18109c90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.826 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/4233935116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18104f10 0x7f8a18107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/4233935116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 0x7f8a181049d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 -- 172.21.15.164:0/4233935116 >> 172.21.15.164:0/4233935116 conn(0x7f8a180fbff0 msgr2=0x7f8a180fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 -- 172.21.15.164:0/4233935116 shutdown_connections 2024-03-27T08:36:26.827 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 -- 172.21.15.164:0/4233935116 wait complete. 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.835+0000 7f8a1fc00640 1 Processor -- start 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 -- start start 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 0x7f8a1819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18107840 0x7f8a181a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810d7c0 con 0x7f8a18104f10 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810d640 con 0x7f8a181025e0 2024-03-27T08:36:26.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1fc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8a1810d940 con 0x7f8a18107840 2024-03-27T08:36:26.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.829 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40582/0 (socket says 172.21.15.164:40582) 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 0x7f8a1819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.836+0000 7f8a17e00640 1 -- 172.21.15.164:0/1590180250 learned_addr learned my addr 172.21.15.164:0/1590180250 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18107840 0x7f8a181a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 -- 172.21.15.164:0/1590180250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18107840 msgr2=0x7f8a181a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18107840 0x7f8a181a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 -- 172.21.15.164:0/1590180250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 msgr2=0x7f8a1819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 0x7f8a1819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 -- 172.21.15.164:0/1590180250 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a181a1cb0 con 0x7f8a18104f10 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c970 tx=0x7f8a0400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.837+0000 7f8a15600640 1 -- 172.21.15.164:0/1590180250 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04007bb0 con 0x7f8a18104f10 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.838+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a181a1fa0 con 0x7f8a18104f10 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.838+0000 7f8a15600640 1 -- 172.21.15.164:0/1590180250 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a04007d50 con 0x7f8a18104f10 2024-03-27T08:36:26.830 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.838+0000 7f8a15600640 1 -- 172.21.15.164:0/1590180250 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0400f450 con 0x7f8a18104f10 2024-03-27T08:36:26.831 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.838+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a181a2460 con 0x7f8a18104f10 2024-03-27T08:36:26.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.842+0000 7f8a2298e740 1 Processor -- start 2024-03-27T08:36:26.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.842+0000 7f8a2298e740 1 -- start start 2024-03-27T08:36:26.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1ea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56109a1506b0 con 0x56109a1eaea0 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56109a0f8750 con 0x56109a1f0010 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a2298e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56109a14c660 con 0x56109a1ea4b0 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40584/0 (socket says 172.21.15.164:40584) 2024-03-27T08:36:26.835 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a1d200640 1 -- 172.21.15.164:0/3730947900 learned_addr learned my addr 172.21.15.164:0/3730947900 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.843+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1ea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 -- 172.21.15.164:0/3730947900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 msgr2=0x56109a1ea8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1ea8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 -- 172.21.15.164:0/3730947900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 msgr2=0x56109a1f24a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f24a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 -- 172.21.15.164:0/3730947900 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561099f2e7d0 con 0x56109a1eaea0 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a15600640 1 -- 172.21.15.164:0/1590180250 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8a04004f40 con 0x7f8a18104f10 2024-03-27T08:36:26.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a1d200640 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009cf0 tx=0x7f8a0c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8199ddf5333cb23 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a0a000640 1 -- 172.21.15.164:0/3730947900 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c004230 con 0x56109a1eaea0 2024-03-27T08:36:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a0a000640 1 -- 172.21.15.164:0/3730947900 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a0c0043d0 con 0x56109a1eaea0 2024-03-27T08:36:26.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.844+0000 7f8a0a000640 1 -- 172.21.15.164:0/3730947900 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c019920 con 0x56109a1eaea0 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 -- 172.21.15.164:0/3730947900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 msgr2=0x56109a1ef9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009cf0 tx=0x7f8a0c011810 comp rx=0 tx=0).stop 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 -- 172.21.15.164:0/3730947900 shutdown_connections 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f24a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1ef9a0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3730947900 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1ea8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.845+0000 7f8a2298e740 1 -- 172.21.15.164:0/3730947900 >> 172.21.15.164:0/3730947900 conn(0x56109a1e5a20 msgr2=0x56109a1e5e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.846+0000 7f8a15600640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 0x7f8a000a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.846+0000 7f8a15600640 1 -- 172.21.15.164:0/1590180250 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8a040cfa60 con 0x7f8a18104f10 2024-03-27T08:36:26.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.846+0000 7f8a2298e740 1 -- 172.21.15.164:0/3730947900 shutdown_connections 2024-03-27T08:36:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.846+0000 7f8a2298e740 1 -- 172.21.15.164:0/3730947900 wait complete. 2024-03-27T08:36:26.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.846+0000 7f8a1d200640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 0x7f8a000a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.847+0000 7f8a2298e740 1 -- start start 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.847+0000 7f8a2298e740 1 Processor -- start 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.847+0000 7f8a1d200640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 0x7f8a000a5b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009ab0 tx=0x7f8a0c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1fbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56109a1f2fc0 con 0x56109a1f0010 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56109a10ba80 con 0x56109a1ea4b0 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56109a1f3140 con 0x56109a1eaea0 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a2298e740 10 client.0 _ll_register_callbacks cb 0x56109a10b470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.840 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:52878/0 (socket says 172.21.15.164:52878) 2024-03-27T08:36:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a1d200640 1 -- 172.21.15.164:0/1894861249 learned_addr learned my addr 172.21.15.164:0/1894861249 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.841 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.848+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1fbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 -- 172.21.15.164:0/1894861249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 msgr2=0x56109a1f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 -- 172.21.15.164:0/1894861249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 msgr2=0x56109a1fbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1fbf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 -- 172.21.15.164:0/1894861249 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561099e643f0 con 0x56109a1ea4b0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f8a1d200640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56109a1eb910 tx=0x7f8a0c011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=621b8b21f42a090f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.849+0000 7f89fea00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c033070 con 0x56109a1ea4b0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8a0c0035f0 con 0x56109a1ea4b0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a0c0043d0 con 0x56109a1ea4b0 2024-03-27T08:36:26.843 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a0c03f050 con 0x56109a1ea4b0 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f8a2298e740 10 client.35426 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x561099e240f0 con 0x56109a1ea4b0 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.850+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a0c0043d0 con 0x56109a1ea4b0 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8a0c02e070 con 0x56109a1ea4b0 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 10 client.35426 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 10 client.35426 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 20 client.35426 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a200620 0x56109a202ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 4 client.35426 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:26.844 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.851+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56109a15dbf0 con 0x56109a200620 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.852+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a200620 0x56109a202ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.852+0000 7f8a17e00640 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a200620 0x56109a202ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f25a26792fc2d4b4 server_cookie=4620225436dc36cf in_seq=0 out_seq=0 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.852+0000 7f89fea00640 10 client.35426 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f89fea00640 1 -- 172.21.15.164:0/1894861249 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56109a15dbf0 con 0x56109a200620 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f89fea00640 10 client.35426 handle_command_reply: tid=0 2024-03-27T08:36:26.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 client.35426 shutdown 2024-03-27T08:36:26.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 msgr2=0x56109a1f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.846 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x56109a1eb910 tx=0x7f8a0c011810 comp rx=0 tx=0).stop 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 shutdown_connections 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a200620 0x56109a202ac0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1fbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 --2- 172.21.15.164:0/1894861249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f4a10 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 >> 172.21.15.164:0/1894861249 conn(0x56109a1e5a20 msgr2=0x56109a1e4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f89fea00640 0 client.35426 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 shutdown_connections 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.854+0000 7f8a2298e740 1 -- 172.21.15.164:0/1894861249 wait complete. 2024-03-27T08:36:26.847 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.855+0000 7f8a2298e740 20 client.35426 trim_cache size 0 max 16384 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 Processor -- start 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 -- start start 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1f4620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f4b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181adc30 con 0x56109a1eaea0 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181ab500 con 0x56109a1f0010 2024-03-27T08:36:26.865 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a2298e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181a9350 con 0x56109a1ea4b0 2024-03-27T08:36:26.866 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.873+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a1dc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40602/0 (socket says 172.21.15.164:40602) 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 -- 172.21.15.164:0/3677563757 learned_addr learned my addr 172.21.15.164:0/3677563757 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a1d200640 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1f4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 -- 172.21.15.164:0/3677563757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 msgr2=0x56109a1f4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1f4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 -- 172.21.15.164:0/3677563757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 msgr2=0x56109a1f4b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f4b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 -- 172.21.15.164:0/3677563757 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56109a1eb280 con 0x56109a1eaea0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.874+0000 7f8a17e00640 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8a0409be70 tx=0x7f8a040cd3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=337b5e1402ce25e3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.875+0000 7f8a09600640 1 -- 172.21.15.164:0/3677563757 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0401d040 con 0x56109a1eaea0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.875+0000 7f8a09600640 1 -- 172.21.15.164:0/3677563757 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a040a4b50 con 0x56109a1eaea0 2024-03-27T08:36:26.867 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.875+0000 7f8a09600640 1 -- 172.21.15.164:0/3677563757 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a04098550 con 0x56109a1eaea0 2024-03-27T08:36:26.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 -- 172.21.15.164:0/3677563757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 msgr2=0x56109a1fbf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.868 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f8a0409be70 tx=0x7f8a040cd3e0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 -- 172.21.15.164:0/3677563757 shutdown_connections 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1f0010 0x56109a1f4b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1eaea0 0x56109a1fbf50 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 --2- 172.21.15.164:0/3677563757 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1ea4b0 0x56109a1f4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 -- 172.21.15.164:0/3677563757 >> 172.21.15.164:0/3677563757 conn(0x56109a1e5a20 msgr2=0x56109a1f34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 -- 172.21.15.164:0/3677563757 shutdown_connections 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.876+0000 7f8a2298e740 1 -- 172.21.15.164:0/3677563757 wait complete. 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.877+0000 7f8a2298e740 1 -- start start 2024-03-27T08:36:26.869 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.877+0000 7f8a2298e740 1 Processor -- start 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.877+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.877+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.877+0000 7f8a2298e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1faa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a2298e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181a99c0 con 0x56109a1f0010 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a2298e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181aae30 con 0x56109a1ea4b0 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a2298e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8a181aa090 con 0x56109a1eaea0 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a2298e740 10 client.0 _ll_register_callbacks cb 0x7f8a0c0041e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:52894/0 (socket says 172.21.15.164:52894) 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 -- 172.21.15.164:0/502395040 learned_addr learned my addr 172.21.15.164:0/502395040 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1faa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.871 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a17e00640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 -- 172.21.15.164:0/502395040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 msgr2=0x56109a1f9a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f9a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 -- 172.21.15.164:0/502395040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 msgr2=0x56109a1faa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1faa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1d200640 1 -- 172.21.15.164:0/502395040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56109a1fb050 con 0x56109a1ea4b0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.878+0000 7f8a1dc00640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.879+0000 7f8a1d200640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009730 tx=0x7f8a0c025700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d9afda4e698eb5f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.879+0000 7f89fea00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.879+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c048060 con 0x56109a1ea4b0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.879+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8a0c025d00 con 0x56109a1ea4b0 2024-03-27T08:36:26.872 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.879+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8a040a4b50 con 0x56109a1ea4b0 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8a0c033040 con 0x56109a1ea4b0 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 10 client.35432 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56109a2669c0 con 0x56109a1ea4b0 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8a040a4b50 con 0x56109a1ea4b0 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8a0c02e040 con 0x56109a1ea4b0 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 10 client.35432 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:26.874 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 10 client.35432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 20 client.35432 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a267130 0x56109a269550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 4 client.35432 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.880+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56109a157f40 con 0x56109a267130 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.881+0000 7f8a17e00640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a267130 0x56109a269550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.881+0000 7f8a17e00640 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a267130 0x56109a269550 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ceb2423bf76f3dda server_cookie=c8c59d43a89c5e71 in_seq=0 out_seq=0 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.881+0000 7f89fea00640 10 client.35432 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.881+0000 7f89fea00640 1 -- 172.21.15.164:0/502395040 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56109a157f40 con 0x56109a267130 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.881+0000 7f89fea00640 10 client.35432 handle_command_reply: tid=0 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 client.35432 shutdown 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 msgr2=0x56109a1f9510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009730 tx=0x7f8a0c025700 comp rx=0 tx=0).stop 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 shutdown_connections 2024-03-27T08:36:26.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56109a267130 0x56109a269550 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56109a1f0010 0x56109a1faa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56109a1eaea0 0x56109a1f9a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 --2- 172.21.15.164:0/502395040 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56109a1ea4b0 0x56109a1f9510 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 >> 172.21.15.164:0/502395040 conn(0x56109a1e5a20 msgr2=0x56109a1f4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f89fea00640 0 client.35432 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 shutdown_connections 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 1 -- 172.21.15.164:0/502395040 wait complete. 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.882+0000 7f8a2298e740 20 client.35432 trim_cache size 0 max 16384 2024-03-27T08:36:26.876 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": { 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "8b2b5954-6acb-4961-897a-ecb31f054e7d": { 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/", 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "tag": "8b2b5954-6acb-4961-897a-ecb31f054e7d", 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: "options": "recursive,force" 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:36:26.877 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 msgr2=0x7f8a000a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 0x7f8a000a5b50 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c009ab0 tx=0x7f8a0c000bc0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 msgr2=0x7f8a1819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f8a0400c970 tx=0x7f8a0400ce30 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 shutdown_connections 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8a000a3690 0x7f8a000a5b50 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8a18107840 0x7f8a181a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8a18104f10 0x7f8a1819a5d0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 --2- 172.21.15.164:0/1590180250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8a181025e0 0x7f8a1819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:26.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 >> 172.21.15.164:0/1590180250 conn(0x7f8a180fbff0 msgr2=0x7f8a18101d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:26.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 shutdown_connections 2024-03-27T08:36:26.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:26.884+0000 7f8a1fc00640 1 -- 172.21.15.164:0/1590180250 wait complete. 2024-03-27T08:36:26.893 INFO:tasks.cephfs.filesystem:scrub status for tag:8b2b5954-6acb-4961-897a-ecb31f054e7d - {'path': '/', 'tag': '8b2b5954-6acb-4961-897a-ecb31f054e7d', 'options': 'recursive,force'} 2024-03-27T08:36:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:27 smithi167 ceph-mon[34903]: scrub queued for path: / 2024-03-27T08:36:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:27 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:27 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:36:27.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:27 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:27 smithi173 ceph-mon[35397]: scrub queued for path: / 2024-03-27T08:36:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:27 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:27 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:36:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:27 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:27 smithi164 ceph-mon[31788]: scrub queued for path: / 2024-03-27T08:36:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:27 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:27 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:36:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:27 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:36:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:28 smithi167 ceph-mon[34903]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T08:36:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:28 smithi173 ceph-mon[35397]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T08:36:28.905 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:28 smithi164 ceph-mon[31788]: pgmap v475: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 511 B/s wr, 7 op/s 2024-03-27T08:36:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:30 smithi167 ceph-mon[34903]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:30 smithi173 ceph-mon[35397]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:31.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:30 smithi164 ceph-mon[31788]: pgmap v476: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:31.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:31 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:36:31.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:31 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:36:32.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:31 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:36:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:32 smithi167 ceph-mon[34903]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:32 smithi173 ceph-mon[35397]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:32 smithi164 ceph-mon[31788]: pgmap v477: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:34 smithi167 ceph-mon[34903]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:34.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:34 smithi173 ceph-mon[35397]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:34 smithi164 ceph-mon[31788]: pgmap v478: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:36 smithi167 ceph-mon[34903]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:36 smithi173 ceph-mon[35397]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:37.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:36 smithi164 ceph-mon[31788]: pgmap v479: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 255 B/s wr, 7 op/s 2024-03-27T08:36:38.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:38 smithi167 ceph-mon[34903]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:36:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:38 smithi173 ceph-mon[35397]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:36:39.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:38 smithi164 ceph-mon[31788]: pgmap v480: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 255 B/s wr, 8 op/s 2024-03-27T08:36:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 -- 172.21.15.164:0/328546510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70105950 msgr2=0x7f2d7010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 --2- 172.21.15.164:0/328546510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70105950 0x7f2d7010c1e0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009ca0 tx=0x7f2d6802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 -- 172.21.15.164:0/328546510 shutdown_connections 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 --2- 172.21.15.164:0/328546510 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70105950 0x7f2d7010c1e0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 --2- 172.21.15.164:0/328546510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70104f90 0x7f2d70105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 --2- 172.21.15.164:0/328546510 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 0x7f2d701041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.310+0000 7f2d76c00640 1 -- 172.21.15.164:0/328546510 >> 172.21.15.164:0/328546510 conn(0x7f2d700ff310 msgr2=0x7f2d70101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.311+0000 7f2d76c00640 1 -- 172.21.15.164:0/328546510 shutdown_connections 2024-03-27T08:36:39.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.311+0000 7f2d76c00640 1 -- 172.21.15.164:0/328546510 wait complete. 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 Processor -- start 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 -- start start 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 0x7f2d70199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 0x7f2d701a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010fa00 con 0x7f2d70104f90 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010f880 con 0x7f2d70105950 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.312+0000 7f2d76c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d7010fb80 con 0x7f2d70103da0 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44050/0 (socket says 172.21.15.164:44050) 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 -- 172.21.15.164:0/23561708 learned_addr learned my addr 172.21.15.164:0/23561708 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:39.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 0x7f2d70199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 -- 172.21.15.164:0/23561708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 msgr2=0x7f2d70199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d74c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 0x7f2d701a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 0x7f2d70199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 -- 172.21.15.164:0/23561708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 msgr2=0x7f2d701a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 0x7f2d701a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 -- 172.21.15.164:0/23561708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d701a1c10 con 0x7f2d70104f90 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d74c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 0x7f2d701a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:39.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.313+0000 7f2d6f400640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9f0 tx=0x7f2d5c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.314+0000 7f2d6cc00640 1 -- 172.21.15.164:0/23561708 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c00cd80 con 0x7f2d70104f90 2024-03-27T08:36:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.314+0000 7f2d6cc00640 1 -- 172.21.15.164:0/23561708 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d5c010900 con 0x7f2d70104f90 2024-03-27T08:36:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.314+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d701a1f00 con 0x7f2d70104f90 2024-03-27T08:36:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.314+0000 7f2d6cc00640 1 -- 172.21.15.164:0/23561708 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c0189e0 con 0x7f2d70104f90 2024-03-27T08:36:39.307 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.314+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d701a2410 con 0x7f2d70104f90 2024-03-27T08:36:39.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.318+0000 7f2d6cc00640 1 -- 172.21.15.164:0/23561708 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f2d5c010ab0 con 0x7f2d70104f90 2024-03-27T08:36:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.318+0000 7f2d799be740 1 Processor -- start 2024-03-27T08:36:39.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 -- start start 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df302da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 0x5571df30a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5571df267d10 con 0x5571df303370 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571df210260 con 0x5571df302980 2024-03-27T08:36:39.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d799be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571df263cc0 con 0x5571df3084e0 2024-03-27T08:36:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.319+0000 7f2d74c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df302da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44064/0 (socket says 172.21.15.164:44064) 2024-03-27T08:36:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 -- 172.21.15.164:0/2128389281 learned_addr learned my addr 172.21.15.164:0/2128389281 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:39.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6f400640 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 0x5571df30a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6cc00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 0x7f2d540a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 -- 172.21.15.164:0/2128389281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 msgr2=0x5571df30a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 0x5571df30a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 -- 172.21.15.164:0/2128389281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 msgr2=0x5571df302da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df302da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6fe00640 1 -- 172.21.15.164:0/2128389281 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571df207aa0 con 0x5571df303370 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6f400640 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 0x5571df30a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d6cc00640 1 -- 172.21.15.164:0/23561708 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d5c0d0130 con 0x7f2d70104f90 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.320+0000 7f2d74c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 0x7f2d540a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.321+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000bc80 tx=0x7f2d6000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d0f635ba64ce72f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.321+0000 7f2d74c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 0x7f2d540a5bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d68004af0 tx=0x7f2d6802e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.322+0000 7f2d65200640 1 -- 172.21.15.164:0/2128389281 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d60015070 con 0x5571df303370 2024-03-27T08:36:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.322+0000 7f2d65200640 1 -- 172.21.15.164:0/2128389281 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d6001a930 con 0x5571df303370 2024-03-27T08:36:39.314 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.322+0000 7f2d65200640 1 -- 172.21.15.164:0/2128389281 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d600119e0 con 0x5571df303370 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 -- 172.21.15.164:0/2128389281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 msgr2=0x5571df307e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f2d6000bc80 tx=0x7f2d6000f730 comp rx=0 tx=0).stop 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 -- 172.21.15.164:0/2128389281 shutdown_connections 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df3084e0 0x5571df30a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df307e70 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 --2- 172.21.15.164:0/2128389281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df302da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 -- 172.21.15.164:0/2128389281 >> 172.21.15.164:0/2128389281 conn(0x5571df2fdef0 msgr2=0x5571df2fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.315 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 -- 172.21.15.164:0/2128389281 shutdown_connections 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.323+0000 7f2d799be740 1 -- 172.21.15.164:0/2128389281 wait complete. 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.324+0000 7f2d799be740 1 -- start start 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.324+0000 7f2d799be740 1 Processor -- start 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df30cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df30d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5571df30b490 con 0x5571df3084e0 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5571df223630 con 0x5571df302980 2024-03-27T08:36:39.317 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5571df30b610 con 0x5571df303370 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d799be740 10 client.0 _ll_register_callbacks cb 0x5571df228c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d74c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d74c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44076/0 (socket says 172.21.15.164:44076) 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d74c00640 1 -- 172.21.15.164:0/4016668222 learned_addr learned my addr 172.21.15.164:0/4016668222 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.325+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df30cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.318 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d6f400640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df30d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.319 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 -- 172.21.15.164:0/4016668222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 msgr2=0x5571df30d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df30d250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 -- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 msgr2=0x5571df30cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df30cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 -- 172.21.15.164:0/4016668222 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571df22f5f0 con 0x5571df3084e0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d6802c700 tx=0x7f2d68005d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc22ef54c2958256 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.326+0000 7f2d59600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68051060 con 0x5571df3084e0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d68004040 con 0x5571df3084e0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6001a930 con 0x5571df3084e0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d68039040 con 0x5571df3084e0 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d799be740 10 client.15759 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:39.320 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.327+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571def7c210 con 0x5571df3084e0 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d6001a930 con 0x5571df3084e0 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2d68054050 con 0x5571df3084e0 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 10 client.15759 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 10 client.15759 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 20 client.15759 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df318b70 0x5571df31afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 4 client.15759 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:39.321 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.328+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5571df275250 con 0x5571df318b70 2024-03-27T08:36:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.329+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df318b70 0x5571df31afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.330+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df318b70 0x5571df31afe0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e5c173c1682af698 server_cookie=abb6d80bb36b1326 in_seq=0 out_seq=0 2024-03-27T08:36:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.330+0000 7f2d59600640 10 client.15759 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:39.322 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d59600640 1 -- 172.21.15.164:0/4016668222 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5571df275250 con 0x5571df318b70 2024-03-27T08:36:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d59600640 10 client.15759 handle_command_reply: tid=0 2024-03-27T08:36:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 client.15759 shutdown 2024-03-27T08:36:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 msgr2=0x5571df314290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f2d6802c700 tx=0x7f2d68005d80 comp rx=0 tx=0).stop 2024-03-27T08:36:39.323 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 shutdown_connections 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df318b70 0x5571df31afe0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df314290 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df30d250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d799be740 1 --2- 172.21.15.164:0/4016668222 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df30cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.331+0000 7f2d59600640 0 client.15759 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.332+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 >> 172.21.15.164:0/4016668222 conn(0x5571df2fdef0 msgr2=0x5571df2fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.332+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 shutdown_connections 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.332+0000 7f2d799be740 1 -- 172.21.15.164:0/4016668222 wait complete. 2024-03-27T08:36:39.324 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.332+0000 7f2d799be740 20 client.15759 trim_cache size 0 max 16384 2024-03-27T08:36:39.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.347+0000 7f2d799be740 1 Processor -- start 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.347+0000 7f2d799be740 1 -- start start 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.347+0000 7f2d799be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df301860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.347+0000 7f2d799be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df314250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d799be740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d799be740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701adaa0 con 0x5571df3084e0 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d799be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701ab370 con 0x5571df302980 2024-03-27T08:36:39.435 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d799be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701a91c0 con 0x5571df303370 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44084/0 (socket says 172.21.15.164:44084) 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 -- 172.21.15.164:0/4225383216 learned_addr learned my addr 172.21.15.164:0/4225383216 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df301860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d6f400640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df314250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 -- 172.21.15.164:0/4225383216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 msgr2=0x5571df314250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df314250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 -- 172.21.15.164:0/4225383216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 msgr2=0x5571df301860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df301860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d74c00640 1 -- 172.21.15.164:0/4225383216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571df048620 con 0x5571df3084e0 2024-03-27T08:36:39.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.348+0000 7f2d6f400640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df314250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.349+0000 7f2d74c00640 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009a60 tx=0x7f2d68009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b47234a399f5a80b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.349+0000 7f2d5be00640 1 -- 172.21.15.164:0/4225383216 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6805b030 con 0x5571df3084e0 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.349+0000 7f2d5be00640 1 -- 172.21.15.164:0/4225383216 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d68047050 con 0x5571df3084e0 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.349+0000 7f2d5be00640 1 -- 172.21.15.164:0/4225383216 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68051030 con 0x5571df3084e0 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- 172.21.15.164:0/4225383216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 msgr2=0x5571df31f8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009a60 tx=0x7f2d68009650 comp rx=0 tx=0).stop 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- 172.21.15.164:0/4225383216 shutdown_connections 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df3084e0 0x5571df31f8e0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df303370 0x5571df314250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 --2- 172.21.15.164:0/4225383216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df302980 0x5571df301860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- 172.21.15.164:0/4225383216 >> 172.21.15.164:0/4225383216 conn(0x5571df2fdef0 msgr2=0x5571df301150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- 172.21.15.164:0/4225383216 shutdown_connections 2024-03-27T08:36:39.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- 172.21.15.164:0/4225383216 wait complete. 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.350+0000 7f2d799be740 1 -- start start 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 Processor -- start 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 0x5571df311be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 0x5571df313130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701a9830 con 0x5571df303370 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701aaca0 con 0x5571df3084e0 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d701a9f00 con 0x5571df302980 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.351+0000 7f2d799be740 10 client.0 _ll_register_callbacks cb 0x7f2d68043040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44098/0 (socket says 172.21.15.164:44098) 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 -- 172.21.15.164:0/2172195029 learned_addr learned my addr 172.21.15.164:0/2172195029 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:39.443 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d74c00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 0x5571df313130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 -- 172.21.15.164:0/2172195029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 msgr2=0x5571df311be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 0x5571df311be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 0x5571df311be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 -- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 msgr2=0x5571df313130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 0x5571df313130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 -- 172.21.15.164:0/2172195029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571df313720 con 0x5571df303370 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 0x5571df311be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d74c00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 0x5571df313130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d6f400640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c098a70 tx=0x7f2d5c09bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67e06bdcde12b608 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.352+0000 7f2d59600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d5c085da0 con 0x5571df303370 2024-03-27T08:36:39.444 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d5c018b80 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d68047050 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f2d5c09c610 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d799be740 10 client.15765 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5571df37f110 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.353+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d68047050 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f2d5c010430 con 0x5571df303370 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 10 client.15765 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 10 client.15765 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 20 client.15765 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df37fab0 0x5571df381ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 4 client.15765 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.354+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5571df26f5a0 con 0x5571df37fab0 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.355+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df37fab0 0x5571df381ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:39.445 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.355+0000 7f2d6fe00640 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df37fab0 0x5571df381ed0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5aaf1b2ad1863f0c server_cookie=7bc021509697db99 in_seq=0 out_seq=0 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.355+0000 7f2d59600640 10 client.15765 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.363+0000 7f2d59600640 1 -- 172.21.15.164:0/2172195029 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5571df26f5a0 con 0x5571df37fab0 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.363+0000 7f2d59600640 10 client.15765 handle_command_reply: tid=0 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.363+0000 7f2d799be740 1 client.15765 shutdown 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 msgr2=0x5571df312120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c098a70 tx=0x7f2d5c09bf70 comp rx=0 tx=0).stop 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 shutdown_connections 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5571df37fab0 0x5571df381ed0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5571df3084e0 0x5571df313130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5571df303370 0x5571df312120 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 --2- 172.21.15.164:0/2172195029 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5571df302980 0x5571df311be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 >> 172.21.15.164:0/2172195029 conn(0x5571df2fdef0 msgr2=0x5571df3019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d59600640 0 client.15765 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 shutdown_connections 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 1 -- 172.21.15.164:0/2172195029 wait complete. 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.364+0000 7f2d799be740 20 client.15765 trim_cache size 0 max 16384 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:36:39.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 msgr2=0x7f2d540a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 0x7f2d540a5bf0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2d68004af0 tx=0x7f2d6802e040 comp rx=0 tx=0).stop 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 msgr2=0x7f2d7019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c00e9f0 tx=0x7f2d5c00eeb0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 shutdown_connections 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d540a3730 0x7f2d540a5bf0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d70105950 0x7f2d701a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d70104f90 0x7f2d7019a530 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 --2- 172.21.15.164:0/23561708 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d70103da0 0x7f2d70199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 >> 172.21.15.164:0/23561708 conn(0x7f2d700ff310 msgr2=0x7f2d70108230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 shutdown_connections 2024-03-27T08:36:39.449 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:39.365+0000 7f2d76c00640 1 -- 172.21.15.164:0/23561708 wait complete. 2024-03-27T08:36:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:40 smithi173 ceph-mon[35397]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-03-27T08:36:41.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:40 smithi164 ceph-mon[31788]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-03-27T08:36:41.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:40 smithi167 ceph-mon[34903]: pgmap v481: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 0 B/s wr, 6 op/s 2024-03-27T08:36:43.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:42 smithi164 ceph-mon[31788]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T08:36:43.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:42 smithi167 ceph-mon[34903]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T08:36:43.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:42 smithi173 ceph-mon[35397]: pgmap v482: 97 pgs: 97 active+clean; 661 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 6 op/s 2024-03-27T08:36:44.153 INFO:tasks.workunit.client.0.smithi164.stderr:Updating files: 62% (7722/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-03-27T08:36:44.652 INFO:tasks.workunit.client.0.smithi164.stderr:Note: switching to '155268c4e432a12433aa833f174f9fe3b1016ae0'. 2024-03-27T08:36:44.652 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:state without impacting any branches by switching back to a branch. 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: git switch -c 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:Or undo this operation with: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: git switch - 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.653 INFO:tasks.workunit.client.0.smithi164.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-27T08:36:44.654 INFO:tasks.workunit.client.0.smithi164.stderr: 2024-03-27T08:36:44.654 INFO:tasks.workunit.client.0.smithi164.stderr:HEAD is now at 155268c4e43 Merge PR #51993 into wip-rishabh-testing-20240326.131558 2024-03-27T08:36:44.665 DEBUG:teuthology.orchestra.run.smithi164:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-27T08:36:44.721 INFO:tasks.workunit.client.0.smithi164.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-27T08:36:44.728 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-27T08:36:44.728 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-27T08:36:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:44 smithi164 ceph-mon[31788]: pgmap v483: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:45.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:44 smithi167 ceph-mon[34903]: pgmap v483: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:45.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:44 smithi173 ceph-mon[35397]: pgmap v483: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:45.691 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-27T08:36:45.804 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-27T08:36:45.884 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-27T08:36:45.889 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-27T08:36:45.890 INFO:tasks.workunit.client.0.smithi164.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-27T08:36:45.974 INFO:tasks.workunit.client.0.smithi164.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-27T08:36:45.983 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:36:45.983 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-27T08:36:46.031 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-03-27T08:36:46.032 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-03-27T08:36:46.033 DEBUG:teuthology.orchestra.run.smithi164:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=155268c4e432a12433aa833f174f9fe3b1016ae0 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-03-27T08:36:46.175 INFO:tasks.workunit.client.0.smithi164.stderr:+ KERNEL=linux-4.0.5 2024-03-27T08:36:46.175 INFO:tasks.workunit.client.0.smithi164.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-03-27T08:36:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:46 smithi164 ceph-mon[31788]: pgmap v484: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:47.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:46 smithi167 ceph-mon[34903]: pgmap v484: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:47.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:46 smithi173 ceph-mon[35397]: pgmap v484: 97 pgs: 97 active+clean; 662 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:36:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:48 smithi164 ceph-mon[31788]: pgmap v485: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:36:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:48 smithi167 ceph-mon[34903]: pgmap v485: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:36:49.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:48 smithi173 ceph-mon[35397]: pgmap v485: 97 pgs: 97 active+clean; 670 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-03-27T08:36:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:50 smithi164 ceph-mon[31788]: pgmap v486: 97 pgs: 97 active+clean; 4.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 342 KiB/s wr, 6 op/s 2024-03-27T08:36:51.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:50 smithi167 ceph-mon[34903]: pgmap v486: 97 pgs: 97 active+clean; 4.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 342 KiB/s wr, 6 op/s 2024-03-27T08:36:51.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:50 smithi173 ceph-mon[35397]: pgmap v486: 97 pgs: 97 active+clean; 4.7 MiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 342 KiB/s wr, 6 op/s 2024-03-27T08:36:52.502 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 -- 172.21.15.164:0/3069931221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac102640 msgr2=0x7f23ac108ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.502 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 --2- 172.21.15.164:0/3069931221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac102640 0x7f23ac108ed0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009ca0 tx=0x7f23a402c100 comp rx=0 tx=0).stop 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 -- 172.21.15.164:0/3069931221 shutdown_connections 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 --2- 172.21.15.164:0/3069931221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac102640 0x7f23ac108ed0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 --2- 172.21.15.164:0/3069931221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac101c80 0x7f23ac102100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 --2- 172.21.15.164:0/3069931221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac100a90 0x7f23ac100eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 -- 172.21.15.164:0/3069931221 >> 172.21.15.164:0/3069931221 conn(0x7f23ac0fc000 msgr2=0x7f23ac0fe440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 -- 172.21.15.164:0/3069931221 shutdown_connections 2024-03-27T08:36:52.503 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.509+0000 7f23b0a00640 1 -- 172.21.15.164:0/3069931221 wait complete. 2024-03-27T08:36:52.505 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 Processor -- start 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 -- start start 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 0x7f23ac197db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 0x7f23ac1982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac10c6f0 con 0x7f23ac102640 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac10c570 con 0x7f23ac101c80 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23b0a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac10c870 con 0x7f23ac100a90 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.511+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57204/0 (socket says 172.21.15.164:57204) 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 -- 172.21.15.164:0/581133996 learned_addr learned my addr 172.21.15.164:0/581133996 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23a9e00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 0x7f23ac197db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.506 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23a9400640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 0x7f23ac1982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 -- 172.21.15.164:0/581133996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 msgr2=0x7f23ac197db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 0x7f23ac197db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 -- 172.21.15.164:0/581133996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 msgr2=0x7f23ac1982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 0x7f23ac1982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 -- 172.21.15.164:0/581133996 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23ac19f9c0 con 0x7f23ac102640 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23a9e00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 0x7f23ac197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23a9400640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 0x7f23ac1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.512+0000 7f23aa800640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f23a4037040 tx=0x7f23a4034d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.513+0000 7f23a2a00640 1 -- 172.21.15.164:0/581133996 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4045070 con 0x7f23ac102640 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.513+0000 7f23a2a00640 1 -- 172.21.15.164:0/581133996 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23a403a040 con 0x7f23ac102640 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.513+0000 7f23a2a00640 1 -- 172.21.15.164:0/581133996 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a4039050 con 0x7f23ac102640 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.513+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23ac19fc50 con 0x7f23ac102640 2024-03-27T08:36:52.507 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.513+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23ac1a00f0 con 0x7f23ac102640 2024-03-27T08:36:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.517+0000 7f23b37f9740 1 Processor -- start 2024-03-27T08:36:52.509 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.517+0000 7f23a2a00640 1 -- 172.21.15.164:0/581133996 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f23a4048070 con 0x7f23ac102640 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.517+0000 7f23b37f9740 1 -- start start 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5e8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e94e0 0x55b5be5eb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b5be548d10 con 0x55b5be5e3980 2024-03-27T08:36:52.510 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5be4f1260 con 0x55b5be5e4370 2024-03-27T08:36:52.511 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23b37f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b5be544cc0 con 0x55b5be5e94e0 2024-03-27T08:36:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57220/0 (socket says 172.21.15.164:57220) 2024-03-27T08:36:52.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23a9400640 1 -- 172.21.15.164:0/3217313221 learned_addr learned my addr 172.21.15.164:0/3217313221 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23a9e00640 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5e8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.518+0000 7f23a9400640 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e94e0 0x55b5be5eb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 -- 172.21.15.164:0/3217313221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e94e0 msgr2=0x55b5be5eb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e94e0 0x55b5be5eb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 -- 172.21.15.164:0/3217313221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 msgr2=0x55b5be5e8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5e8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 -- 172.21.15.164:0/3217313221 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5be4e8aa0 con 0x55b5be5e3980 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a2a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 0x7f23900a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9400640 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f23980135e0 tx=0x7f2398009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afe7cbedf65e7e6c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a2a00640 1 -- 172.21.15.164:0/581133996 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23a40f1c80 con 0x7f23ac102640 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f23a9e00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 0x7f23900a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f2397000640 1 -- 172.21.15.164:0/3217313221 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2398011540 con 0x55b5be5e3980 2024-03-27T08:36:52.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f2397000640 1 -- 172.21.15.164:0/3217313221 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2398011bb0 con 0x55b5be5e3980 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.519+0000 7f2397000640 1 -- 172.21.15.164:0/3217313221 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239800faf0 con 0x55b5be5e3980 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23a9e00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 0x7f23900a5b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55b5be5e4770 tx=0x7f239c005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 -- 172.21.15.164:0/3217313221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 msgr2=0x55b5be5e3da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f23980135e0 tx=0x7f2398009800 comp rx=0 tx=0).stop 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 -- 172.21.15.164:0/3217313221 shutdown_connections 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e94e0 0x55b5be5eb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5e8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3217313221 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be5e3da0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 -- 172.21.15.164:0/3217313221 >> 172.21.15.164:0/3217313221 conn(0x55b5be5deef0 msgr2=0x55b5be5df2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.520+0000 7f23b37f9740 1 -- 172.21.15.164:0/3217313221 shutdown_connections 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.521+0000 7f23b37f9740 1 -- 172.21.15.164:0/3217313221 wait complete. 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.521+0000 7f23b37f9740 1 -- start start 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.521+0000 7f23b37f9740 1 Processor -- start 2024-03-27T08:36:52.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e3980 0x55b5be5f2070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b5be5ec490 con 0x55b5be5e94e0 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5be504630 con 0x55b5be5e3980 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b5be5ec610 con 0x55b5be5e4370 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23b37f9740 10 client.0 _ll_register_callbacks cb 0x55b5be509c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57234/0 (socket says 172.21.15.164:57234) 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23aa800640 1 -- 172.21.15.164:0/3531293345 learned_addr learned my addr 172.21.15.164:0/3531293345 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23a9e00640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e3980 0x55b5be5f2070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.522+0000 7f23a9400640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 -- 172.21.15.164:0/3531293345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 msgr2=0x55b5be5f25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 -- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e3980 msgr2=0x55b5be5f2070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e3980 0x55b5be5f2070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 -- 172.21.15.164:0/3531293345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5be5105f0 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23a9400640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23aa800640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f23a40ba4d0 tx=0x7f23a40bded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce02afb6ecb4d3b4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f238b400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a40bc240 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23a40c2120 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2398011bb0 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23a4034910 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23b37f9740 10 client.15777 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.523+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5be25d210 con 0x55b5be5e94e0 2024-03-27T08:36:52.522 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2398011bb0 con 0x55b5be5e94e0 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f23a40c68e0 con 0x55b5be5e94e0 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 10 client.15777 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 20 client.15777 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be5fe010 0x55b5be600490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 4 client.15777 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.524+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b5be556250 con 0x55b5be5fe010 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.525+0000 7f23a9e00640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be5fe010 0x55b5be600490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.526+0000 7f23a9e00640 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be5fe010 0x55b5be600490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9efdc122cf312bbf server_cookie=fc72868a93f7da44 in_seq=0 out_seq=0 2024-03-27T08:36:52.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.526+0000 7f238b400640 10 client.15777 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f238b400640 1 -- 172.21.15.164:0/3531293345 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b5be556250 con 0x55b5be5fe010 2024-03-27T08:36:52.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f238b400640 10 client.15777 handle_command_reply: tid=0 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 client.15777 shutdown 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 msgr2=0x55b5be5f95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f23a40ba4d0 tx=0x7f23a40bded0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 shutdown_connections 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be5fe010 0x55b5be600490 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f95f0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 --2- 172.21.15.164:0/3531293345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e3980 0x55b5be5f2070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 >> 172.21.15.164:0/3531293345 conn(0x55b5be5deef0 msgr2=0x55b5be5de0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f238b400640 0 client.15777 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 shutdown_connections 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.527+0000 7f23b37f9740 1 -- 172.21.15.164:0/3531293345 wait complete. 2024-03-27T08:36:52.525 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.528+0000 7f23b37f9740 20 client.15777 trim_cache size 0 max 16384 2024-03-27T08:36:52.537 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 Processor -- start 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 -- start start 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e94e0 0x55b5be605290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a9540 con 0x55b5be5e3980 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a6e10 con 0x55b5be5e94e0 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.544+0000 7f23b37f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a4c60 con 0x55b5be5e4370 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57236/0 (socket says 172.21.15.164:57236) 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 -- 172.21.15.164:0/1340494680 learned_addr learned my addr 172.21.15.164:0/1340494680 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:52.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9400640 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23aa800640 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e94e0 0x55b5be605290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 -- 172.21.15.164:0/1340494680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 msgr2=0x55b5be5f95b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f95b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 -- 172.21.15.164:0/1340494680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e94e0 msgr2=0x55b5be605290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e94e0 0x55b5be605290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 -- 172.21.15.164:0/1340494680 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5be329620 con 0x55b5be5e3980 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.545+0000 7f23a9e00640 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f23ac199280 tx=0x7f239c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec70b4f305306be8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.546+0000 7f2396600640 1 -- 172.21.15.164:0/1340494680 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c02b3b0 con 0x55b5be5e3980 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.546+0000 7f2396600640 1 -- 172.21.15.164:0/1340494680 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f239c02b550 con 0x55b5be5e3980 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.546+0000 7f2396600640 1 -- 172.21.15.164:0/1340494680 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f239c005610 con 0x55b5be5e3980 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- 172.21.15.164:0/1340494680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 msgr2=0x55b5be604d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f23ac199280 tx=0x7f239c017000 comp rx=0 tx=0).stop 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- 172.21.15.164:0/1340494680 shutdown_connections 2024-03-27T08:36:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e94e0 0x55b5be605290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e4370 0x55b5be5f95b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 --2- 172.21.15.164:0/1340494680 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e3980 0x55b5be604d50 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- 172.21.15.164:0/1340494680 >> 172.21.15.164:0/1340494680 conn(0x55b5be5deef0 msgr2=0x55b5be5de0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- 172.21.15.164:0/1340494680 shutdown_connections 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- 172.21.15.164:0/1340494680 wait complete. 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.547+0000 7f23b37f9740 1 -- start start 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 Processor -- start 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e3980 0x55b5be5f7520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5f7a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a52d0 con 0x55b5be5e94e0 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a6740 con 0x55b5be5e4370 2024-03-27T08:36:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f23ac1a59a0 con 0x55b5be5e3980 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23b37f9740 10 client.0 _ll_register_callbacks cb 0x7f23a4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57246/0 (socket says 172.21.15.164:57246) 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.548+0000 7f23aa800640 1 -- 172.21.15.164:0/2155329383 learned_addr learned my addr 172.21.15.164:0/2155329383 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23a9e00640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e3980 0x55b5be5f7520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23a9400640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5f7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 -- 172.21.15.164:0/2155329383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e3980 msgr2=0x55b5be5f7520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e3980 0x55b5be5f7520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 -- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 msgr2=0x55b5be5f7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5f7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 -- 172.21.15.164:0/2155329383 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5be5f8ff0 con 0x55b5be5e94e0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23aa800640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f23a4004580 tx=0x7f23a40099d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1743018f832b3b7e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f238b400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23a40ba310 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f23a4004b40 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.549+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f239c02b550 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f23a4034910 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 10 client.15783 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b5be664b00 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f239c02b550 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f23a40b9dc0 con 0x55b5be5e94e0 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 10 client.15783 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 10 client.15783 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 20 client.15783 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be665360 0x55b5be667750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 4 client.15783 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:36:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.550+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b5be5505a0 con 0x55b5be665360 2024-03-27T08:36:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.551+0000 7f23a9e00640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be665360 0x55b5be667750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.552+0000 7f23a9e00640 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be665360 0x55b5be667750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=656bacc7ea8bfa17 server_cookie=f88cc0bfdf5710e in_seq=0 out_seq=0 2024-03-27T08:36:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.552+0000 7f238b400640 10 client.15783 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f238b400640 1 -- 172.21.15.164:0/2155329383 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b5be5505a0 con 0x55b5be665360 2024-03-27T08:36:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f238b400640 10 client.15783 handle_command_reply: tid=0 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 client.15783 shutdown 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 msgr2=0x55b5be5f8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f23a4004580 tx=0x7f23a40099d0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 shutdown_connections 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5be665360 0x55b5be667750 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5be5e94e0 0x55b5be5f8a00 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5be5e4370 0x55b5be5f7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 --2- 172.21.15.164:0/2155329383 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5be5e3980 0x55b5be5f7520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 >> 172.21.15.164:0/2155329383 conn(0x55b5be5deef0 msgr2=0x55b5be5e2150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.571+0000 7f238b400640 0 client.15783 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:52.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.572+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 shutdown_connections 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.572+0000 7f23b37f9740 1 -- 172.21.15.164:0/2155329383 wait complete. 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.572+0000 7f23b37f9740 20 client.15783 trim_cache size 0 max 16384 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:36:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.572+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 msgr2=0x7f23900a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.572+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 0x7f23900a5b70 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55b5be5e4770 tx=0x7f239c005f90 comp rx=0 tx=0).stop 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 msgr2=0x7f23ac19f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f23a4037040 tx=0x7f23a4034d70 comp rx=0 tx=0).stop 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 shutdown_connections 2024-03-27T08:36:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f23900a36b0 0x7f23900a5b70 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f23ac102640 0x7f23ac19f320 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f23ac101c80 0x7f23ac1982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 --2- 172.21.15.164:0/581133996 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f23ac100a90 0x7f23ac197db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 >> 172.21.15.164:0/581133996 conn(0x7f23ac0fc000 msgr2=0x7f23ac0fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 shutdown_connections 2024-03-27T08:36:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:36:52.573+0000 7f23b0a00640 1 -- 172.21.15.164:0/581133996 wait complete. 2024-03-27T08:36:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:52 smithi164 ceph-mon[31788]: pgmap v487: 97 pgs: 97 active+clean; 8.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 683 KiB/s wr, 6 op/s 2024-03-27T08:36:53.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:52 smithi167 ceph-mon[34903]: pgmap v487: 97 pgs: 97 active+clean; 8.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 683 KiB/s wr, 6 op/s 2024-03-27T08:36:53.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:52 smithi173 ceph-mon[35397]: pgmap v487: 97 pgs: 97 active+clean; 8.7 MiB data, 390 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 683 KiB/s wr, 6 op/s 2024-03-27T08:36:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:54 smithi164 ceph-mon[31788]: pgmap v488: 97 pgs: 97 active+clean; 21 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-27T08:36:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:54 smithi167 ceph-mon[34903]: pgmap v488: 97 pgs: 97 active+clean; 21 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-27T08:36:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:54 smithi173 ceph-mon[35397]: pgmap v488: 97 pgs: 97 active+clean; 21 MiB data, 414 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-03-27T08:36:56.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:55 smithi164 ceph-mon[31788]: pgmap v489: 97 pgs: 97 active+clean; 29 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 8 op/s 2024-03-27T08:36:56.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:55 smithi167 ceph-mon[34903]: pgmap v489: 97 pgs: 97 active+clean; 29 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 8 op/s 2024-03-27T08:36:56.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:55 smithi173 ceph-mon[35397]: pgmap v489: 97 pgs: 97 active+clean; 29 MiB data, 454 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.3 MiB/s wr, 8 op/s 2024-03-27T08:36:56.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:36:56.895 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:36:57.139 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.147+0000 7ff89f200640 1 -- 172.21.15.164:0/2443281323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a0107710 msgr2=0x7ff8a0109b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.147+0000 7ff89f200640 1 --2- 172.21.15.164:0/2443281323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a0107710 0x7ff8a0109b60 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7ff898009ca0 tx=0x7ff89802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 -- 172.21.15.164:0/2443281323 shutdown_connections 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 --2- 172.21.15.164:0/2443281323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a0107710 0x7ff8a0109b60 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 --2- 172.21.15.164:0/2443281323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0104de0 0x7ff8a01071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 --2- 172.21.15.164:0/2443281323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a01024b0 0x7ff8a01048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 -- 172.21.15.164:0/2443281323 >> 172.21.15.164:0/2443281323 conn(0x7ff8a00fbec0 msgr2=0x7ff8a00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 -- 172.21.15.164:0/2443281323 shutdown_connections 2024-03-27T08:36:57.140 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.148+0000 7ff89f200640 1 -- 172.21.15.164:0/2443281323 wait complete. 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 Processor -- start 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 -- start start 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a0104de0 0x7ff8a0198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0107710 0x7ff8a019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010d690 con 0x7ff8a01024b0 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010d510 con 0x7ff8a0104de0 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a010d810 con 0x7ff8a0107710 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41524/0 (socket says 172.21.15.164:41524) 2024-03-27T08:36:57.142 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.149+0000 7ff89de00640 1 -- 172.21.15.164:0/3795272349 learned_addr learned my addr 172.21.15.164:0/3795272349 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89d400640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a0104de0 0x7ff8a0198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89e800640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0107710 0x7ff8a019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 -- 172.21.15.164:0/3795272349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0107710 msgr2=0x7ff8a019f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0107710 0x7ff8a019f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 -- 172.21.15.164:0/3795272349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a0104de0 msgr2=0x7ff8a0198260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a0104de0 0x7ff8a0198260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 -- 172.21.15.164:0/3795272349 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a019f930 con 0x7ff8a01024b0 2024-03-27T08:36:57.143 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.150+0000 7ff89de00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff89000d950 tx=0x7ff89000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.151+0000 7ff896a00640 1 -- 172.21.15.164:0/3795272349 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890017070 con 0x7ff8a01024b0 2024-03-27T08:36:57.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.151+0000 7ff896a00640 1 -- 172.21.15.164:0/3795272349 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff890009c30 con 0x7ff8a01024b0 2024-03-27T08:36:57.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.151+0000 7ff896a00640 1 -- 172.21.15.164:0/3795272349 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff89000f6b0 con 0x7ff8a01024b0 2024-03-27T08:36:57.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.151+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a019fc20 con 0x7ff8a01024b0 2024-03-27T08:36:57.144 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.151+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a01a0120 con 0x7ff8a01024b0 2024-03-27T08:36:57.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.154+0000 7ff8a77b7740 1 Processor -- start 2024-03-27T08:36:57.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.154+0000 7ff896a00640 1 -- 172.21.15.164:0/3795272349 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7ff890010a50 con 0x7ff8a01024b0 2024-03-27T08:36:57.146 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 -- start start 2024-03-27T08:36:57.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.147 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde4060 0x56333bde8b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde91d0 0x56333bdeb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56333bd496b0 con 0x56333bde3670 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56333bcf1750 con 0x56333bde91d0 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56333bd45660 con 0x56333bde4060 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41528/0 (socket says 172.21.15.164:41528) 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.155+0000 7ff89e800640 1 -- 172.21.15.164:0/3855696234 learned_addr learned my addr 172.21.15.164:0/3855696234 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89d400640 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde91d0 0x56333bdeb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89de00640 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde4060 0x56333bde8b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 -- 172.21.15.164:0/3855696234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde4060 msgr2=0x56333bde8b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde4060 0x56333bde8b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 -- 172.21.15.164:0/3855696234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde91d0 msgr2=0x56333bdeb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde91d0 0x56333bdeb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.148 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 -- 172.21.15.164:0/3855696234 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56333bb277d0 con 0x56333bde3670 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff89e800640 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff89802c630 tx=0x7ff8980323d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9717b872d06d714 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.156+0000 7ff896a00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 0x7ff8840a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.157+0000 7ff896a00640 1 -- 172.21.15.164:0/3795272349 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff8900cfac0 con 0x7ff8a01024b0 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.157+0000 7ff88b000640 1 -- 172.21.15.164:0/3855696234 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898044070 con 0x56333bde3670 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.157+0000 7ff89de00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 0x7ff8840a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.157+0000 7ff88b000640 1 -- 172.21.15.164:0/3855696234 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff898032c90 con 0x56333bde3670 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.157+0000 7ff88b000640 1 -- 172.21.15.164:0/3855696234 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898039040 con 0x56333bde3670 2024-03-27T08:36:57.150 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 -- 172.21.15.164:0/3855696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 msgr2=0x56333bde3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff89802c630 tx=0x7ff8980323d0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff89de00640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 0x7ff8840a5b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff890098880 tx=0x7ff890005880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 -- 172.21.15.164:0/3855696234 shutdown_connections 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde91d0 0x56333bdeb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde4060 0x56333bde8b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/3855696234 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bde3a90 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 -- 172.21.15.164:0/3855696234 >> 172.21.15.164:0/3855696234 conn(0x56333bddebe0 msgr2=0x56333bddefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 -- 172.21.15.164:0/3855696234 shutdown_connections 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.158+0000 7ff8a77b7740 1 -- 172.21.15.164:0/3855696234 wait complete. 2024-03-27T08:36:57.151 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.159+0000 7ff8a77b7740 1 -- start start 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.159+0000 7ff8a77b7740 1 Processor -- start 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde3670 0x56333bdedb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56333bdec120 con 0x56333bde91d0 2024-03-27T08:36:57.154 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56333bd04a80 con 0x56333bde4060 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56333bdec2a0 con 0x56333bde3670 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff8a77b7740 10 client.0 _ll_register_callbacks cb 0x56333bd04470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41534/0 (socket says 172.21.15.164:41534) 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff89e800640 1 -- 172.21.15.164:0/237259069 learned_addr learned my addr 172.21.15.164:0/237259069 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff89d400640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.160+0000 7ff89e800640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde3670 0x56333bdedb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 -- 172.21.15.164:0/237259069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde3670 msgr2=0x56333bdedb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde3670 0x56333bdedb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 -- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 msgr2=0x56333bdee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 -- 172.21.15.164:0/237259069 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56333ba5d3f0 con 0x56333bde91d0 2024-03-27T08:36:57.155 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89d400640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff89e800640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff898037040 tx=0x7ff898032ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93bd1146f480b69c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff87f400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898044030 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff898004320 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.161+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff898032c90 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff89805b050 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 10 client.15795 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56333ba1d0f0 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff898032c90 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff898049b40 con 0x56333bde91d0 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 10 client.15795 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 10 client.15795 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 20 client.15795 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333bdf95c0 0x56333bdfb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 4 client.15795 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:57.156 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.162+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56333bd56bf0 con 0x56333bdf95c0 2024-03-27T08:36:57.157 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.163+0000 7ff89d400640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333bdf95c0 0x56333bdfb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.164+0000 7ff89d400640 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333bdf95c0 0x56333bdfb9b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a7ca92512978293 server_cookie=55ffc2e03ca89535 in_seq=0 out_seq=0 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.164+0000 7ff87f400640 10 client.15795 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.165+0000 7ff87f400640 1 -- 172.21.15.164:0/237259069 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56333bd56bf0 con 0x56333bdf95c0 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.165+0000 7ff87f400640 10 client.15795 handle_command_reply: tid=0 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.165+0000 7ff8a77b7740 1 client.15795 shutdown 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 msgr2=0x56333bdf50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff898037040 tx=0x7ff898032ec0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 shutdown_connections 2024-03-27T08:36:57.158 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333bdf95c0 0x56333bdfb9b0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde91d0 0x56333bdf50d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/237259069 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde3670 0x56333bdedb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 >> 172.21.15.164:0/237259069 conn(0x56333bddebe0 msgr2=0x56333bddde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff87f400640 0 client.15795 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 shutdown_connections 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 1 -- 172.21.15.164:0/237259069 wait complete. 2024-03-27T08:36:57.159 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.166+0000 7ff8a77b7740 20 client.15795 trim_cache size 0 max 16384 2024-03-27T08:36:57.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.190+0000 7ff8a77b7740 1 Processor -- start 2024-03-27T08:36:57.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.190+0000 7ff8a77b7740 1 -- start start 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bddd5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a94e0 con 0x56333bde3670 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a6db0 con 0x56333bde4060 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a4c00 con 0x56333bde91d0 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41544/0 (socket says 172.21.15.164:41544) 2024-03-27T08:36:57.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.191+0000 7ff89e800640 1 -- 172.21.15.164:0/1068184160 learned_addr learned my addr 172.21.15.164:0/1068184160 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89d400640 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 -- 172.21.15.164:0/1068184160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 msgr2=0x56333bddd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bddd5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 -- 172.21.15.164:0/1068184160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 msgr2=0x56333bdf4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 -- 172.21.15.164:0/1068184160 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56333bddf950 con 0x56333bde3670 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89d400640 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff89e800640 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff898033000 tx=0x7ff898009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a87385b5cee8068 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.192+0000 7ff88a600640 1 -- 172.21.15.164:0/1068184160 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898039070 con 0x56333bde3670 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.193+0000 7ff88a600640 1 -- 172.21.15.164:0/1068184160 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff89803fe00 con 0x56333bde3670 2024-03-27T08:36:57.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.193+0000 7ff88a600640 1 -- 172.21.15.164:0/1068184160 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898044070 con 0x56333bde3670 2024-03-27T08:36:57.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.193+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1068184160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 msgr2=0x56333bdd9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.193+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff898033000 tx=0x7ff898009800 comp rx=0 tx=0).stop 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1068184160 shutdown_connections 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bddd5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1068184160 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdd9cd0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1068184160 >> 172.21.15.164:0/1068184160 conn(0x56333bddebe0 msgr2=0x56333bdec640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1068184160 shutdown_connections 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1068184160 wait complete. 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 -- start start 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.194+0000 7ff8a77b7740 1 Processor -- start 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bdf39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a5270 con 0x56333bde3670 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a66e0 con 0x56333bde4060 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a01a5940 con 0x56333bde91d0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff8a77b7740 10 client.0 _ll_register_callbacks cb 0x7ff898009900 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff89e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41550/0 (socket says 172.21.15.164:41550) 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff89e800640 1 -- 172.21.15.164:0/1293653417 learned_addr learned my addr 172.21.15.164:0/1293653417 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.195+0000 7ff89d400640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 -- 172.21.15.164:0/1293653417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 msgr2=0x56333bdf39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bdf39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 -- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 msgr2=0x56333bdf29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 -- 172.21.15.164:0/1293653417 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56333bdf3fc0 con 0x56333bde3670 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff89e800640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff898049f10 tx=0x7ff898032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa7156b66460bf2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff87f400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:57.189 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff898039040 con 0x56333bde3670 2024-03-27T08:36:57.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff89803fb30 con 0x56333bde3670 2024-03-27T08:36:57.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff89803fe00 con 0x56333bde3670 2024-03-27T08:36:57.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7ff898044040 con 0x56333bde3670 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff8a77b7740 10 client.15801 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.196+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56333bdf52d0 con 0x56333bde3670 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff89803fe00 con 0x56333bde3670 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7ff8980346a0 con 0x56333bde3670 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 10 client.15801 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 10 client.15801 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 20 client.15801 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333be5fe50 0x56333be62240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 4 client.15801 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.197+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56333bd50f40 con 0x56333be5fe50 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.198+0000 7ff89d400640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333be5fe50 0x56333be62240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff89d400640 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333be5fe50 0x56333be62240 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f955fab7122bbb6 server_cookie=3da119f140d8d6d3 in_seq=0 out_seq=0 2024-03-27T08:36:57.192 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff87f400640 10 client.15801 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff87f400640 1 -- 172.21.15.164:0/1293653417 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56333bd50f40 con 0x56333be5fe50 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff87f400640 10 client.15801 handle_command_reply: tid=0 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 client.15801 shutdown 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 msgr2=0x56333bdf2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7ff898049f10 tx=0x7ff898032c90 comp rx=0 tx=0).stop 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 shutdown_connections 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56333be5fe50 0x56333be62240 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56333bde91d0 0x56333bdf39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56333bde4060 0x56333bdf29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 --2- 172.21.15.164:0/1293653417 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56333bde3670 0x56333bdf2480 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 >> 172.21.15.164:0/1293653417 conn(0x56333bddebe0 msgr2=0x56333bde1e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.199+0000 7ff87f400640 0 client.15801 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.200+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 shutdown_connections 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.200+0000 7ff8a77b7740 1 -- 172.21.15.164:0/1293653417 wait complete. 2024-03-27T08:36:57.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.200+0000 7ff8a77b7740 20 client.15801 trim_cache size 0 max 16384 2024-03-27T08:36:57.194 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:36:57.194 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "no active scrubs running", 2024-03-27T08:36:57.194 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": {} 2024-03-27T08:36:57.194 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.200+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 msgr2=0x7ff8840a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.200+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 0x7ff8840a5b50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7ff890098880 tx=0x7ff890005880 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 msgr2=0x7ff8a0197d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7ff89000d950 tx=0x7ff89000de10 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 shutdown_connections 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff8840a3690 0x7ff8840a5b50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff8a0107710 0x7ff8a019f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff8a0104de0 0x7ff8a0198260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 --2- 172.21.15.164:0/3795272349 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff8a01024b0 0x7ff8a0197d20 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 >> 172.21.15.164:0/3795272349 conn(0x7ff8a00fbec0 msgr2=0x7ff8a0102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 shutdown_connections 2024-03-27T08:36:57.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.201+0000 7ff89f200640 1 -- 172.21.15.164:0/3795272349 wait complete. 2024-03-27T08:36:57.212 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T08:36:57.212 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1752795403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb81019a0 msgr2=0x7f7cb8101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1752795403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb81019a0 0x7f7cb8101dc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f7ca800fb10 tx=0x7f7ca802fdc0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1752795403 shutdown_connections 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1752795403 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb8103550 0x7f7cb8109de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1752795403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 0x7f7cb8103010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1752795403 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb81019a0 0x7f7cb8101dc0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1752795403 >> 172.21.15.164:0/1752795403 conn(0x7f7cb80fcf30 msgr2=0x7f7cb80ff350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1752795403 shutdown_connections 2024-03-27T08:36:57.441 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.449+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1752795403 wait complete. 2024-03-27T08:36:57.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.450+0000 7f7cb7e00640 1 Processor -- start 2024-03-27T08:36:57.442 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.450+0000 7f7cb7e00640 1 -- start start 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb81019a0 0x7f7cb8195a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 0x7f7cb8195f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810b410 con 0x7f7cb8103550 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810b290 con 0x7f7cb8102b90 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb810b590 con 0x7f7cb81019a0 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41568/0 (socket says 172.21.15.164:41568) 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb7400640 1 -- 172.21.15.164:0/1458325532 learned_addr learned my addr 172.21.15.164:0/1458325532 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb6000640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 0x7f7cb8195f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.443 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.451+0000 7f7cb6a00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb81019a0 0x7f7cb8195a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.444 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 -- 172.21.15.164:0/1458325532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb81019a0 msgr2=0x7f7cb8195a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb81019a0 0x7f7cb8195a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 -- 172.21.15.164:0/1458325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 msgr2=0x7f7cb8195f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 0x7f7cb8195f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 -- 172.21.15.164:0/1458325532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb819d650 con 0x7f7cb8103550 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cb7400640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000eb10 tx=0x7f7cb000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.452+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0004b20 con 0x7f7cb8103550 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.453+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7cb0004cc0 con 0x7f7cb8103550 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.453+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb819d940 con 0x7f7cb8103550 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.453+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0010700 con 0x7f7cb8103550 2024-03-27T08:36:57.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.453+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb819de90 con 0x7f7cb8103550 2024-03-27T08:36:57.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.454+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb8108c60 con 0x7f7cb8103550 2024-03-27T08:36:57.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.460+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7cb0004e70 con 0x7f7cb8103550 2024-03-27T08:36:57.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.461+0000 7f7cbca00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 0x7f7c9c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.461+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7cb00d05e0 con 0x7f7cb8103550 2024-03-27T08:36:57.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.462+0000 7f7cb6a00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 0x7f7c9c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:57.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.463+0000 7f7cb6a00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 0x7f7c9c0a5ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca800f800 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:57.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.464+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7cb0053cb0 con 0x7f7cb8103550 2024-03-27T08:36:57.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.733+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7cb802d370 con 0x7f7cb8103550 2024-03-27T08:36:57.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.734+0000 7f7cbca00640 1 -- 172.21.15.164:0/1458325532 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11888 (secure 0 0 0) 0x7f7cb009d160 con 0x7f7cb8103550 2024-03-27T08:36:57.727 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:36:57.727 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":24,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:35:11.240118+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34502,34430,34463]},"id":1}]} 2024-03-27T08:36:57.727 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 24 2024-03-27T08:36:57.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 msgr2=0x7f7c9c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 0x7f7c9c0a5ad0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8000c00 tx=0x7f7ca800f800 comp rx=0 tx=0).stop 2024-03-27T08:36:57.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 msgr2=0x7f7cb819cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000eb10 tx=0x7f7cb000c2d0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 shutdown_connections 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c9c0a3610 0x7f7c9c0a5ad0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7cb8103550 0x7f7cb819cfe0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7cb8102b90 0x7f7cb8195f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 --2- 172.21.15.164:0/1458325532 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7cb81019a0 0x7f7cb8195a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 >> 172.21.15.164:0/1458325532 conn(0x7f7cb80fcf30 msgr2=0x7f7cb8105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 shutdown_connections 2024-03-27T08:36:57.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:57.737+0000 7f7cb7e00640 1 -- 172.21.15.164:0/1458325532 wait complete. 2024-03-27T08:36:57.749 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 -- 172.21.15.164:0/1882618151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80102c40 msgr2=0x7fbb801030c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 --2- 172.21.15.164:0/1882618151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80102c40 0x7fbb801030c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbb68009900 tx=0x7fbb6802bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 -- 172.21.15.164:0/1882618151 shutdown_connections 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 --2- 172.21.15.164:0/1882618151 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80103600 0x7fbb80109e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 --2- 172.21.15.164:0/1882618151 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80102c40 0x7fbb801030c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 --2- 172.21.15.164:0/1882618151 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80101a50 0x7fbb80101e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:57.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 -- 172.21.15.164:0/1882618151 >> 172.21.15.164:0/1882618151 conn(0x7fbb800fcfc0 msgr2=0x7fbb800ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:57.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 -- 172.21.15.164:0/1882618151 shutdown_connections 2024-03-27T08:36:57.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.005+0000 7fbb7f200640 1 -- 172.21.15.164:0/1882618151 wait complete. 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.006+0000 7fbb7f200640 1 Processor -- start 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 -- start start 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80102c40 0x7fbb80073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80103600 0x7fbb80074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8010d700 con 0x7fbb80101a50 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8010d580 con 0x7fbb80102c40 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8010d880 con 0x7fbb80103600 2024-03-27T08:36:57.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41588/0 (socket says 172.21.15.164:41588) 2024-03-27T08:36:58.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb7de00640 1 -- 172.21.15.164:0/2625283477 learned_addr learned my addr 172.21.15.164:0/2625283477 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.007+0000 7fbb77e00640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80102c40 0x7fbb80073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.000 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7e800640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80103600 0x7fbb80074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 -- 172.21.15.164:0/2625283477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80103600 msgr2=0x7fbb80074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80103600 0x7fbb80074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 -- 172.21.15.164:0/2625283477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80102c40 msgr2=0x7fbb80073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80102c40 0x7fbb80073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 -- 172.21.15.164:0/2625283477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb80074d10 con 0x7fbb80101a50 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.008+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000d950 tx=0x7fbb7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.009+0000 7fbb76a00640 1 -- 172.21.15.164:0/2625283477 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70017070 con 0x7fbb80101a50 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.009+0000 7fbb76a00640 1 -- 172.21.15.164:0/2625283477 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb70009c30 con 0x7fbb80101a50 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.009+0000 7fbb76a00640 1 -- 172.21.15.164:0/2625283477 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7000f620 con 0x7fbb80101a50 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.009+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb801a1e70 con 0x7fbb80101a50 2024-03-27T08:36:58.001 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.009+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb801a2220 con 0x7fbb80101a50 2024-03-27T08:36:58.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb76a00640 1 -- 172.21.15.164:0/2625283477 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fbb7001a070 con 0x7fbb80101a50 2024-03-27T08:36:58.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 Processor -- start 2024-03-27T08:36:58.004 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 -- start start 2024-03-27T08:36:58.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7bab0 0x560a5bf7bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.005 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 0x560a5bf80fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf83aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560a5bf437b0 con 0x560a5bf81610 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560a5bee0670 con 0x560a5bf7c4a0 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.013+0000 7fbb87979740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560a5be88970 con 0x560a5bf7bab0 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 0x560a5bf80fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf83aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 0x560a5bf80fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36630/0 (socket says 172.21.15.164:36630) 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb7de00640 1 -- 172.21.15.164:0/20719997 learned_addr learned my addr 172.21.15.164:0/20719997 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.006 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb7e800640 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7bab0 0x560a5bf7bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb77e00640 1 -- 172.21.15.164:0/20719997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7bab0 msgr2=0x560a5bf7bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb77e00640 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7bab0 0x560a5bf7bed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb77e00640 1 -- 172.21.15.164:0/20719997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 msgr2=0x560a5bf80fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.014+0000 7fbb77e00640 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 0x560a5bf80fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb77e00640 1 -- 172.21.15.164:0/20719997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5bbf43f0 con 0x560a5bf81610 2024-03-27T08:36:58.007 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb76a00640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 0x7fbb640a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb77e00640 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf83aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036040 tx=0x7fbb68005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1421eef92f442be server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb76a00640 1 -- 172.21.15.164:0/2625283477 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbb700cf700 con 0x7fbb80101a50 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb7e800640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 0x7fbb640a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.015+0000 7fbb6f000640 1 -- 172.21.15.164:0/20719997 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68045020 con 0x560a5bf81610 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.016+0000 7fbb6f000640 1 -- 172.21.15.164:0/20719997 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb6802c9e0 con 0x560a5bf81610 2024-03-27T08:36:58.008 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.016+0000 7fbb6f000640 1 -- 172.21.15.164:0/20719997 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb680046c0 con 0x560a5bf81610 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.016+0000 7fbb87979740 1 -- 172.21.15.164:0/20719997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 msgr2=0x560a5bf83aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.016+0000 7fbb7e800640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 0x7fbb640a5ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560a5bf7cd00 tx=0x7fbb78009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.016+0000 7fbb87979740 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf83aa0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fbb68036040 tx=0x7fbb68005be0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 -- 172.21.15.164:0/20719997 shutdown_connections 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf83aa0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7c4a0 0x560a5bf80fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 --2- 172.21.15.164:0/20719997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7bab0 0x560a5bf7bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 -- 172.21.15.164:0/20719997 >> 172.21.15.164:0/20719997 conn(0x560a5bf77020 msgr2=0x560a5bf77420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 -- 172.21.15.164:0/20719997 shutdown_connections 2024-03-27T08:36:58.009 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 -- 172.21.15.164:0/20719997 wait complete. 2024-03-27T08:36:58.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 -- start start 2024-03-27T08:36:58.010 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.017+0000 7fbb87979740 1 Processor -- start 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf85bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf81610 0x560a5bf8d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x560a5be9bca0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560a5bedc620 con 0x560a5bf7bab0 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x560a5bf84560 con 0x560a5bf81610 2024-03-27T08:36:58.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb87979740 10 client.0 _ll_register_callbacks cb 0x560a5bed8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb77e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41598/0 (socket says 172.21.15.164:41598) 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb77e00640 1 -- 172.21.15.164:0/2547336380 learned_addr learned my addr 172.21.15.164:0/2547336380 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf85bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.018+0000 7fbb7e800640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf81610 0x560a5bf8d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 -- 172.21.15.164:0/2547336380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf81610 msgr2=0x560a5bf8d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf81610 0x560a5bf8d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 -- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 msgr2=0x560a5bf85bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf85bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 -- 172.21.15.164:0/2547336380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a5bcbe7d0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb77e00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbb68004630 tx=0x7fbb68005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c887e13f7f8fc4a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb63400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:58.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb68045040 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.019+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbb680037f0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb6802c9e0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb68059050 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 10 client.15819 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a5bf904a0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb6802c9e0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fbb68041ad0 con 0x560a5bf7c4a0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 10 client.15819 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 10 client.15819 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 20 client.15819 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bf917f0 0x560a5bf93be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 4 client.15819 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.020+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560a5beedbb0 con 0x560a5bf917f0 2024-03-27T08:36:58.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.021+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bf917f0 0x560a5bf93be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.022+0000 7fbb7de00640 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bf917f0 0x560a5bf93be0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b30f2c0885edd8d1 server_cookie=fb81ad4d8f2e9505 in_seq=0 out_seq=0 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.022+0000 7fbb63400640 10 client.15819 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb63400640 1 -- 172.21.15.164:0/2547336380 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x560a5beedbb0 con 0x560a5bf917f0 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb63400640 10 client.15819 handle_command_reply: tid=0 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 client.15819 shutdown 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 msgr2=0x560a5bf860f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fbb68004630 tx=0x7fbb68005850 comp rx=0 tx=0).stop 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 shutdown_connections 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf81610 0x560a5bf8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bf917f0 0x560a5bf93be0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7c4a0 0x560a5bf860f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 --2- 172.21.15.164:0/2547336380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf85bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.017 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb63400640 0 client.15819 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:58.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 >> 172.21.15.164:0/2547336380 conn(0x560a5bf77020 msgr2=0x560a5bf76240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 shutdown_connections 2024-03-27T08:36:58.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 1 -- 172.21.15.164:0/2547336380 wait complete. 2024-03-27T08:36:58.018 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.024+0000 7fbb87979740 20 client.15819 trim_cache size 0 max 16384 2024-03-27T08:36:58.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.043+0000 7fbb87979740 1 Processor -- start 2024-03-27T08:36:58.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.043+0000 7fbb87979740 1 -- start start 2024-03-27T08:36:58.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.035 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 0x560a5bf98340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801ad830 con 0x560a5bf7bab0 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801ab100 con 0x560a5bf81610 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb87979740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801a8f50 con 0x560a5bf7c4a0 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41612/0 (socket says 172.21.15.164:41612) 2024-03-27T08:36:58.036 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 -- 172.21.15.164:0/3945724292 learned_addr learned my addr 172.21.15.164:0/3945724292 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7e800640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 0x560a5bf98340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb77e00640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 -- 172.21.15.164:0/3945724292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 msgr2=0x560a5bf8d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.037 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 -- 172.21.15.164:0/3945724292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 msgr2=0x560a5bf98340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 0x560a5bf98340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7de00640 1 -- 172.21.15.164:0/3945724292 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560a5bf86ba0 con 0x560a5bf7bab0 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb7e800640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 0x560a5bf98340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.044+0000 7fbb77e00640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.045+0000 7fbb7de00640 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb70098040 tx=0x7fbb700bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5573d992fc07423 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.045+0000 7fbb6e600640 1 -- 172.21.15.164:0/3945724292 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70021040 con 0x560a5bf7bab0 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.045+0000 7fbb6e600640 1 -- 172.21.15.164:0/3945724292 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb70009de0 con 0x560a5bf7bab0 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.045+0000 7fbb6e600640 1 -- 172.21.15.164:0/3945724292 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb70086040 con 0x560a5bf7bab0 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 -- 172.21.15.164:0/3945724292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 msgr2=0x560a5bf7a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fbb70098040 tx=0x7fbb700bc040 comp rx=0 tx=0).stop 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 -- 172.21.15.164:0/3945724292 shutdown_connections 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf81610 0x560a5bf98340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 --2- 172.21.15.164:0/3945724292 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf7bab0 0x560a5bf7a990 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 -- 172.21.15.164:0/3945724292 >> 172.21.15.164:0/3945724292 conn(0x560a5bf77020 msgr2=0x560a5bf7a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 -- 172.21.15.164:0/3945724292 shutdown_connections 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.046+0000 7fbb87979740 1 -- 172.21.15.164:0/3945724292 wait complete. 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 -- start start 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 Processor -- start 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf8ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.041 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801a95c0 con 0x560a5bf81610 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801aaa30 con 0x560a5bf7bab0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.047+0000 7fbb87979740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbb801a9c90 con 0x560a5bf7c4a0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb87979740 10 client.0 _ll_register_callbacks cb 0x7fbb700d5420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41620/0 (socket says 172.21.15.164:41620) 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 -- 172.21.15.164:0/1953258030 learned_addr learned my addr 172.21.15.164:0/1953258030 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7de00640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf8ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb77e00640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 -- 172.21.15.164:0/1953258030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 msgr2=0x560a5bf8b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 -- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 msgr2=0x560a5bf8ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf8ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.048+0000 7fbb7e800640 1 -- 172.21.15.164:0/1953258030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560a5bf8c8b0 con 0x560a5bf81610 2024-03-27T08:36:58.042 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb7e800640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb780206e0 tx=0x7fbb78004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d116ab088a1630eb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb63400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb7801c5c0 con 0x560a5bf81610 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbb78017030 con 0x560a5bf81610 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb70009de0 con 0x560a5bf81610 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbb7801c760 con 0x560a5bf81610 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb87979740 10 client.15825 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.049+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x560a5bff7e20 con 0x560a5bf81610 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb70009de0 con 0x560a5bf81610 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fbb7802aa80 con 0x560a5bf81610 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 10 client.15825 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 10 client.15825 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 20 client.15825 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bff8880 0x560a5bffaca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 4 client.15825 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:58.045 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560a5bee7f00 con 0x560a5bff8880 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.050+0000 7fbb7de00640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bff8880 0x560a5bffaca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.051+0000 7fbb7de00640 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bff8880 0x560a5bffaca0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=56076ba42a3ba9e5 server_cookie=95bed85c71e44562 in_seq=0 out_seq=0 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.051+0000 7fbb63400640 10 client.15825 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.051+0000 7fbb63400640 1 -- 172.21.15.164:0/1953258030 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560a5bee7f00 con 0x560a5bff8880 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.051+0000 7fbb63400640 10 client.15825 handle_command_reply: tid=0 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.051+0000 7fbb87979740 1 client.15825 shutdown 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 msgr2=0x560a5bf8c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fbb780206e0 tx=0x7fbb78004ab0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 shutdown_connections 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x560a5bff8880 0x560a5bffaca0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x560a5bf81610 0x560a5bf8c2c0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb63400640 0 client.15825 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:36:58.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x560a5bf7c4a0 0x560a5bf8b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 --2- 172.21.15.164:0/1953258030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560a5bf7bab0 0x560a5bf8ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 >> 172.21.15.164:0/1953258030 conn(0x560a5bf77020 msgr2=0x560a5bf7ab10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 shutdown_connections 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 1 -- 172.21.15.164:0/1953258030 wait complete. 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.052+0000 7fbb87979740 20 client.15825 trim_cache size 0 max 16384 2024-03-27T08:36:58.047 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 msgr2=0x7fbb640a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 0x7fbb640a5ad0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x560a5bf7cd00 tx=0x7fbb78009500 comp rx=0 tx=0).stop 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 msgr2=0x7fbb80075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbb7000d950 tx=0x7fbb7000de10 comp rx=0 tx=0).stop 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 shutdown_connections 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbb640a3610 0x7fbb640a5ad0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.048 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbb80103600 0x7fbb80074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb80102c40 0x7fbb80073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 --2- 172.21.15.164:0/2625283477 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbb80101a50 0x7fbb80075900 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 >> 172.21.15.164:0/2625283477 conn(0x7fbb800fcfc0 msgr2=0x7fbb80105f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 shutdown_connections 2024-03-27T08:36:58.049 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.053+0000 7fbb7f200640 1 -- 172.21.15.164:0/2625283477 wait complete. 2024-03-27T08:36:58.064 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T08:36:58.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 -- 172.21.15.164:0/1288768455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964103c50 msgr2=0x7f8964104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 --2- 172.21.15.164:0/1288768455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964103c50 0x7f8964104070 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f8954009900 tx=0x7f895402bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:58.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 -- 172.21.15.164:0/1288768455 shutdown_connections 2024-03-27T08:36:58.289 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 --2- 172.21.15.164:0/1288768455 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f896410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 --2- 172.21.15.164:0/1288768455 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964104e40 0x7f89641052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 --2- 172.21.15.164:0/1288768455 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964103c50 0x7f8964104070 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 -- 172.21.15.164:0/1288768455 >> 172.21.15.164:0/1288768455 conn(0x7f89640ff1c0 msgr2=0x7f8964101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 -- 172.21.15.164:0/1288768455 shutdown_connections 2024-03-27T08:36:58.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.297+0000 7f8968c00640 1 -- 172.21.15.164:0/1288768455 wait complete. 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.298+0000 7f8968c00640 1 Processor -- start 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 -- start start 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103c50 0x7f8964199fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f89641a1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f896410f8b0 con 0x7f8964104e40 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f896410f730 con 0x7f8964105800 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8968c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f896410fa30 con 0x7f8964103c50 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41640/0 (socket says 172.21.15.164:41640) 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8962a00640 1 -- 172.21.15.164:0/2403070626 learned_addr learned my addr 172.21.15.164:0/2403070626 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8963e00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f89641a1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.299+0000 7f8963400640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103c50 0x7f8964199fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 -- 172.21.15.164:0/2403070626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103c50 msgr2=0x7f8964199fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103c50 0x7f8964199fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 -- 172.21.15.164:0/2403070626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 msgr2=0x7f89641a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f89641a1550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 -- 172.21.15.164:0/2403070626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89641a1bc0 con 0x7f8964104e40 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8963e00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f89641a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8962a00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f895000d770 tx=0x7f895000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f895be00640 1 -- 172.21.15.164:0/2403070626 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950017070 con 0x7f8964104e40 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f895be00640 1 -- 172.21.15.164:0/2403070626 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89500054f0 con 0x7f8964104e40 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f895be00640 1 -- 172.21.15.164:0/2403070626 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950004d60 con 0x7f8964104e40 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.300+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89641a1eb0 con 0x7f8964104e40 2024-03-27T08:36:58.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.301+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89641a2320 con 0x7f8964104e40 2024-03-27T08:36:58.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.304+0000 7f896cfc0740 1 Processor -- start 2024-03-27T08:36:58.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 -- start start 2024-03-27T08:36:58.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b170ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.296 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b1714a0 0x56400b175fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.297 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f895be00640 1 -- 172.21.15.164:0/2403070626 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8950004f00 con 0x7f8964104e40 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56400b1387b0 con 0x56400b176610 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56400b0d5670 con 0x56400b1714a0 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f896cfc0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56400b07d970 con 0x56400b170ab0 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41644/0 (socket says 172.21.15.164:41644) 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f8962a00640 1 -- 172.21.15.164:0/1578410932 learned_addr learned my addr 172.21.15.164:0/1578410932 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f8963400640 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b1714a0 0x56400b175fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.305+0000 7f8963e00640 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b170ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 -- 172.21.15.164:0/1578410932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 msgr2=0x56400b170ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b170ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 -- 172.21.15.164:0/1578410932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b1714a0 msgr2=0x56400b175fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.298 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b1714a0 0x56400b175fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 -- 172.21.15.164:0/1578410932 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400ade93f0 con 0x56400b176610 2024-03-27T08:36:58.299 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.306+0000 7f8962a00640 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f89500df400 tx=0x7f89500df8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e052253be0cfedee server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f895be00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 0x7f89480a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f894fe00640 1 -- 172.21.15.164:0/1578410932 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500dbb60 con 0x56400b176610 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f894fe00640 1 -- 172.21.15.164:0/1578410932 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f895009c390 con 0x56400b176610 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f894fe00640 1 -- 172.21.15.164:0/1578410932 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89500a0040 con 0x56400b176610 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f895be00640 1 -- 172.21.15.164:0/2403070626 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f89500cf810 con 0x7f8964104e40 2024-03-27T08:36:58.300 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.307+0000 7f8963e00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 0x7f89480a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 -- 172.21.15.164:0/1578410932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 msgr2=0x56400b178aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f89500df400 tx=0x7f89500df8c0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f8963e00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 0x7f89480a5b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56400b171d00 tx=0x7f895c0098a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 -- 172.21.15.164:0/1578410932 shutdown_connections 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b176610 0x56400b178aa0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b1714a0 0x56400b175fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1578410932 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b170ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 -- 172.21.15.164:0/1578410932 >> 172.21.15.164:0/1578410932 conn(0x56400b16c020 msgr2=0x56400b16c420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 -- 172.21.15.164:0/1578410932 shutdown_connections 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.308+0000 7f896cfc0740 1 -- 172.21.15.164:0/1578410932 wait complete. 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 -- start start 2024-03-27T08:36:58.301 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 Processor -- start 2024-03-27T08:36:58.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b182190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56400b090ca0 con 0x56400b170ab0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56400b0d1620 con 0x56400b176610 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56400b1795c0 con 0x56400b1714a0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.309+0000 7f896cfc0740 10 client.0 _ll_register_callbacks cb 0x56400b0cd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41646/0 (socket says 172.21.15.164:41646) 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 -- 172.21.15.164:0/2687679235 learned_addr learned my addr 172.21.15.164:0/2687679235 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8962a00640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963e00640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b182190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 -- 172.21.15.164:0/2687679235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 msgr2=0x56400b17b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 -- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 msgr2=0x56400b182190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b182190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 -- 172.21.15.164:0/2687679235 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56400aeb37d0 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.310+0000 7f8963400640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8954009900 tx=0x7f8954004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535042102702a4ae server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f894cc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954005d50 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8954005230 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f895009c390 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8954050050 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f896cfc0740 10 client.15837 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56400b185570 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.311+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f895009c390 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8954003920 con 0x56400b170ab0 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 10 client.15837 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 10 client.15837 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 20 client.15837 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.306 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b186d00 0x56400b189170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 4 client.15837 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:58.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56400b0e2bb0 con 0x56400b186d00 2024-03-27T08:36:58.307 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.312+0000 7f8962a00640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b186d00 0x56400b189170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.313+0000 7f894cc00640 10 client.15837 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.313+0000 7f8962a00640 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b186d00 0x56400b189170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=819fc062b7a2547a server_cookie=8ae07b4203f8c113 in_seq=0 out_seq=0 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f894cc00640 1 -- 172.21.15.164:0/2687679235 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56400b0e2bb0 con 0x56400b186d00 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f894cc00640 10 client.15837 handle_command_reply: tid=0 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 client.15837 shutdown 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 msgr2=0x56400b17ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8954009900 tx=0x7f8954004270 comp rx=0 tx=0).stop 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 shutdown_connections 2024-03-27T08:36:58.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b186d00 0x56400b189170 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b182190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2687679235 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17ac10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 >> 172.21.15.164:0/2687679235 conn(0x56400b16c020 msgr2=0x56400b16b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f894cc00640 0 client.15837 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 shutdown_connections 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.315+0000 7f896cfc0740 1 -- 172.21.15.164:0/2687679235 wait complete. 2024-03-27T08:36:58.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.316+0000 7f896cfc0740 20 client.15837 trim_cache size 0 max 16384 2024-03-27T08:36:58.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 Processor -- start 2024-03-27T08:36:58.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 -- start start 2024-03-27T08:36:58.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b18da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.331 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b18df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a9530 con 0x56400b1714a0 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a6e00 con 0x56400b176610 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.339+0000 7f896cfc0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a4c50 con 0x56400b170ab0 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41648/0 (socket says 172.21.15.164:41648) 2024-03-27T08:36:58.332 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 -- 172.21.15.164:0/2784543555 learned_addr learned my addr 172.21.15.164:0/2784543555 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8963400640 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b18da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8963e00640 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b18df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 -- 172.21.15.164:0/2784543555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 msgr2=0x56400b18da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b18da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 -- 172.21.15.164:0/2784543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 msgr2=0x56400b18df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b18df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 -- 172.21.15.164:0/2784543555 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56400b1678a0 con 0x56400b1714a0 2024-03-27T08:36:58.334 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.340+0000 7f8962a00640 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f89500dfdc0 tx=0x7f89500bc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f181c25eb5fc54ad server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.341+0000 7f894f400640 1 -- 172.21.15.164:0/2784543555 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950020040 con 0x56400b1714a0 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.341+0000 7f894f400640 1 -- 172.21.15.164:0/2784543555 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89500056a0 con 0x56400b1714a0 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.341+0000 7f894f400640 1 -- 172.21.15.164:0/2784543555 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8950009cc0 con 0x56400b1714a0 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.341+0000 7f896cfc0740 1 -- 172.21.15.164:0/2784543555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 msgr2=0x56400b182150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.341+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f89500dfdc0 tx=0x7f89500bc040 comp rx=0 tx=0).stop 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 -- 172.21.15.164:0/2784543555 shutdown_connections 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b18df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b1714a0 0x56400b182150 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 --2- 172.21.15.164:0/2784543555 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b170ab0 0x56400b18da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 -- 172.21.15.164:0/2784543555 >> 172.21.15.164:0/2784543555 conn(0x56400b16c020 msgr2=0x56400b16b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 -- 172.21.15.164:0/2784543555 shutdown_connections 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 -- 172.21.15.164:0/2784543555 wait complete. 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 -- start start 2024-03-27T08:36:58.335 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.342+0000 7f896cfc0740 1 Processor -- start 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b1eb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a52c0 con 0x56400b170ab0 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a6730 con 0x56400b176610 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89641a5990 con 0x56400b1714a0 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f896cfc0740 10 client.0 _ll_register_callbacks cb 0x7f895402c5d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f8963400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f8963400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41656/0 (socket says 172.21.15.164:41656) 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f8963400640 1 -- 172.21.15.164:0/1682352889 learned_addr learned my addr 172.21.15.164:0/1682352889 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.343+0000 7f8963e00640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b1eb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.338 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8962a00640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 -- 172.21.15.164:0/1682352889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 msgr2=0x56400b17f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 -- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 msgr2=0x56400b1eb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b1eb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 -- 172.21.15.164:0/1682352889 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56400b1eb5a0 con 0x56400b170ab0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963e00640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b1eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f8963400640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8954005ab0 tx=0x7f8954005640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a0f6ad7ec25e14 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f894cc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.344+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8954005d50 con 0x56400b170ab0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f89540037f0 con 0x56400b170ab0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89500056a0 con 0x56400b170ab0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f89540039f0 con 0x56400b170ab0 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f896cfc0740 10 client.15843 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.339 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56400b1ec7d0 con 0x56400b170ab0 2024-03-27T08:36:58.340 INFO:tasks.workunit.client.0.smithi164.stderr:+ mkdir untar_tar 2024-03-27T08:36:58.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89500056a0 con 0x56400b170ab0 2024-03-27T08:36:58.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.345+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f89540605a0 con 0x56400b170ab0 2024-03-27T08:36:58.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 10 client.15843 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.341 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 10 client.15843 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 20 client.15843 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b1ed140 0x56400b1ef560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 4 client.15843 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56400b0dcf00 con 0x56400b1ed140 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.346+0000 7f8962a00640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b1ed140 0x56400b1ef560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.347+0000 7f8962a00640 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b1ed140 0x56400b1ef560 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9190d62fb17a9916 server_cookie=62b954d4dffcf06f in_seq=0 out_seq=0 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.347+0000 7f894cc00640 10 client.15843 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f894cc00640 1 -- 172.21.15.164:0/1682352889 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56400b0dcf00 con 0x56400b1ed140 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f894cc00640 10 client.15843 handle_command_reply: tid=0 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 client.15843 shutdown 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 msgr2=0x56400b17efa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8954005ab0 tx=0x7f8954005640 comp rx=0 tx=0).stop 2024-03-27T08:36:58.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 shutdown_connections 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x56400b1ed140 0x56400b1ef560 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56400b176610 0x56400b1eb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56400b1714a0 0x56400b17f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f894cc00640 0 client.15843 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 --2- 172.21.15.164:0/1682352889 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56400b170ab0 0x56400b17efa0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 >> 172.21.15.164:0/1682352889 conn(0x56400b16c020 msgr2=0x56400b16f280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.348+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 shutdown_connections 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.349+0000 7f896cfc0740 1 -- 172.21.15.164:0/1682352889 wait complete. 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.349+0000 7f896cfc0740 20 client.15843 trim_cache size 0 max 16384 2024-03-27T08:36:58.343 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 msgr2=0x7f89480a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 0x7f89480a5b50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x56400b171d00 tx=0x7f895c0098a0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 msgr2=0x7f896419a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f895000d770 tx=0x7f895000dc30 comp rx=0 tx=0).stop 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 shutdown_connections 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89480a3690 0x7f89480a5b50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8964105800 0x7f89641a1550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8964104e40 0x7f896419a4e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 --2- 172.21.15.164:0/2403070626 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8964103c50 0x7f8964199fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 >> 172.21.15.164:0/2403070626 conn(0x7f89640ff1c0 msgr2=0x7f8964108140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 shutdown_connections 2024-03-27T08:36:58.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.350+0000 7f8968c00640 1 -- 172.21.15.164:0/2403070626 wait complete. 2024-03-27T08:36:58.350 INFO:tasks.workunit.client.0.smithi164.stderr:+ cd untar_tar 2024-03-27T08:36:58.353 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-03-27T08:36:58.361 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T08:36:58.391 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ 2024-03-27T08:36:58.397 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/00-INDEX 2024-03-27T08:36:58.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/ 2024-03-27T08:36:58.407 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/README 2024-03-27T08:36:58.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-03-27T08:36:58.417 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-03-27T08:36:58.423 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-03-27T08:36:58.429 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-03-27T08:36:58.435 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-03-27T08:36:58.440 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-03-27T08:36:58.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-03-27T08:36:58.452 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-03-27T08:36:58.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-03-27T08:36:58.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-03-27T08:36:58.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-03-27T08:36:58.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-03-27T08:36:58.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-03-27T08:36:58.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-03-27T08:36:58.483 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-03-27T08:36:58.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-03-27T08:36:58.495 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-03-27T08:36:58.501 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-03-27T08:36:58.508 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-03-27T08:36:58.514 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-03-27T08:36:58.519 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-03-27T08:36:58.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-03-27T08:36:58.530 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-03-27T08:36:58.535 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-03-27T08:36:58.541 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-03-27T08:36:58.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-03-27T08:36:58.554 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-03-27T08:36:58.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-03-27T08:36:58.564 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-03-27T08:36:58.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 -- 172.21.15.164:0/809315976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10075b30 msgr2=0x7fca10073f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 --2- 172.21.15.164:0/809315976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10075b30 0x7fca10073f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fca00009900 tx=0x7fca0002bcc0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 -- 172.21.15.164:0/809315976 shutdown_connections 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 --2- 172.21.15.164:0/809315976 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca1010bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 --2- 172.21.15.164:0/809315976 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10074550 0x7fca100749b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 --2- 172.21.15.164:0/809315976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10075b30 0x7fca10073f80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 -- 172.21.15.164:0/809315976 >> 172.21.15.164:0/809315976 conn(0x7fca100fcfc0 msgr2=0x7fca100ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.573 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 -- 172.21.15.164:0/809315976 shutdown_connections 2024-03-27T08:36:58.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.581+0000 7fca15600640 1 -- 172.21.15.164:0/809315976 wait complete. 2024-03-27T08:36:58.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-03-27T08:36:58.574 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.582+0000 7fca15600640 1 Processor -- start 2024-03-27T08:36:58.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 -- start start 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10074550 0x7fca10199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10075b30 0x7fca1019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010f900 con 0x7fca101098e0 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010f780 con 0x7fca10074550 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca15600640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca1010fa80 con 0x7fca10075b30 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41672/0 (socket says 172.21.15.164:41672) 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca14c00640 1 -- 172.21.15.164:0/2677943370 learned_addr learned my addr 172.21.15.164:0/2677943370 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.583+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10074550 0x7fca10199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca0f400640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10075b30 0x7fca1019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 -- 172.21.15.164:0/2677943370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10075b30 msgr2=0x7fca1019a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10075b30 0x7fca1019a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 -- 172.21.15.164:0/2677943370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10074550 msgr2=0x7fca10199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10074550 0x7fca10199ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 -- 172.21.15.164:0/2677943370 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1006b6a0 con 0x7fca101098e0 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.584+0000 7fca14c00640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fca0800cce0 tx=0x7fca0800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.585+0000 7fca0cc00640 1 -- 172.21.15.164:0/2677943370 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0800f450 con 0x7fca101098e0 2024-03-27T08:36:58.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.585+0000 7fca0cc00640 1 -- 172.21.15.164:0/2677943370 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca0800fac0 con 0x7fca101098e0 2024-03-27T08:36:58.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.585+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1006b990 con 0x7fca101098e0 2024-03-27T08:36:58.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.585+0000 7fca0cc00640 1 -- 172.21.15.164:0/2677943370 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08018be0 con 0x7fca101098e0 2024-03-27T08:36:58.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.585+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1006be90 con 0x7fca101098e0 2024-03-27T08:36:58.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-03-27T08:36:58.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.589+0000 7fca1997e740 1 Processor -- start 2024-03-27T08:36:58.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.589+0000 7fca0cc00640 1 -- 172.21.15.164:0/2677943370 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fca0800fc70 con 0x7fca101098e0 2024-03-27T08:36:58.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 -- start start 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 0x55edb73dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73e2610 0x55edb73e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edb73a47b0 con 0x55edb73dd4a0 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edb7341670 con 0x55edb73e2610 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca1997e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edb72e9970 con 0x55edb73dcab0 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41678/0 (socket says 172.21.15.164:41678) 2024-03-27T08:36:58.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.590+0000 7fca0fe00640 1 -- 172.21.15.164:0/3786372712 learned_addr learned my addr 172.21.15.164:0/3786372712 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.583 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0f400640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73e2610 0x55edb73e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0f400640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 0x55edb73dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 -- 172.21.15.164:0/3786372712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 msgr2=0x55edb73dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 0x55edb73dced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 -- 172.21.15.164:0/3786372712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73e2610 msgr2=0x55edb73e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73e2610 0x55edb73e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 -- 172.21.15.164:0/3786372712 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb70553f0 con 0x55edb73dd4a0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0f400640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 0x55edb73dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0cc00640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 0x7fc9f40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0cc00640 1 -- 172.21.15.164:0/2677943370 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fca080d0410 con 0x7fca101098e0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca0002c2d0 tx=0x7fca00005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8389fc69a20f4577 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.591+0000 7fca0f400640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 0x7fc9f40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.592+0000 7fca05200640 1 -- 172.21.15.164:0/3786372712 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00004040 con 0x55edb73dd4a0 2024-03-27T08:36:58.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.592+0000 7fca05200640 1 -- 172.21.15.164:0/3786372712 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca00005510 con 0x55edb73dd4a0 2024-03-27T08:36:58.585 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.592+0000 7fca05200640 1 -- 172.21.15.164:0/3786372712 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00004cf0 con 0x55edb73dd4a0 2024-03-27T08:36:58.585 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 -- 172.21.15.164:0/3786372712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 msgr2=0x55edb73e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca0f400640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 0x7fc9f40a5ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55edb73ddd00 tx=0x7fc9fc004730 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca0002c2d0 tx=0x7fca00005e80 comp rx=0 tx=0).stop 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 -- 172.21.15.164:0/3786372712 shutdown_connections 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73e2610 0x55edb73e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73e1fa0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 --2- 172.21.15.164:0/3786372712 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dcab0 0x55edb73dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 -- 172.21.15.164:0/3786372712 >> 172.21.15.164:0/3786372712 conn(0x55edb73d8020 msgr2=0x55edb73d8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 -- 172.21.15.164:0/3786372712 shutdown_connections 2024-03-27T08:36:58.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.593+0000 7fca1997e740 1 -- 172.21.15.164:0/3786372712 wait complete. 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 -- start start 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 Processor -- start 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55edb72fcca0 con 0x55edb73e2610 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55edb733d620 con 0x55edb73dcab0 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55edb73e5560 con 0x55edb73dd4a0 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.594+0000 7fca1997e740 10 client.0 _ll_register_callbacks cb 0x55edb7339160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41686/0 (socket says 172.21.15.164:41686) 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 -- 172.21.15.164:0/2005702241 learned_addr learned my addr 172.21.15.164:0/2005702241 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca0f400640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 -- 172.21.15.164:0/2005702241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 msgr2=0x55edb73e7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73e7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 -- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 msgr2=0x55edb73e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.595+0000 7fca14c00640 1 -- 172.21.15.164:0/2005702241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb711f7d0 con 0x55edb73e2610 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fca14c00640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca080a5030 tx=0x7fca0809c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6207a5023fa76560 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fc9f9600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080872e0 con 0x55edb73e2610 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fca080a50d0 con 0x55edb73e2610 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca00005510 con 0x55edb73e2610 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca080a0ca0 con 0x55edb73e2610 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fca1997e740 10 client.15852 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.596+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55edb73f1510 con 0x55edb73e2610 2024-03-27T08:36:58.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca00005510 con 0x55edb73e2610 2024-03-27T08:36:58.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fca080b5070 con 0x55edb73e2610 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fca1997e740 10 client.15852 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fca1997e740 10 client.15852 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fca1997e740 20 client.15852 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.597+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb73f2a00 0x55edb73f4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.598+0000 7fca1997e740 4 client.15852 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:58.592 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.598+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55edb734ebb0 con 0x55edb73f2a00 2024-03-27T08:36:58.593 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.598+0000 7fca0fe00640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb73f2a00 0x55edb73f4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.599+0000 7fca0fe00640 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb73f2a00 0x55edb73f4ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27192e052fd487d9 server_cookie=a5e8af8b8719d832 in_seq=0 out_seq=0 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.599+0000 7fc9f9600640 10 client.15852 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fc9f9600640 1 -- 172.21.15.164:0/2005702241 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55edb734ebb0 con 0x55edb73f2a00 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fc9f9600640 10 client.15852 handle_command_reply: tid=0 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 client.15852 shutdown 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 msgr2=0x55edb73ee160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca080a5030 tx=0x7fca0809c520 comp rx=0 tx=0).stop 2024-03-27T08:36:58.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 shutdown_connections 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb73f2a00 0x55edb73f4ea0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73ee160 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73e7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 --2- 172.21.15.164:0/2005702241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 >> 172.21.15.164:0/2005702241 conn(0x55edb73d8020 msgr2=0x55edb73d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fc9f9600640 0 client.15852 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 shutdown_connections 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.600+0000 7fca1997e740 1 -- 172.21.15.164:0/2005702241 wait complete. 2024-03-27T08:36:58.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.601+0000 7fca1997e740 20 client.15852 trim_cache size 0 max 16384 2024-03-27T08:36:58.595 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-03-27T08:36:58.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-03-27T08:36:58.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-03-27T08:36:58.605 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-03-27T08:36:58.609 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.618+0000 7fca1997e740 1 Processor -- start 2024-03-27T08:36:58.610 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-03-27T08:36:58.611 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.618+0000 7fca1997e740 1 -- start start 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73de780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fca101b5f50 con 0x55edb73e2610 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca101b3820 con 0x55edb73dcab0 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca1997e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca10072a10 con 0x55edb73dd4a0 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73de780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca14c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41696/0 (socket says 172.21.15.164:41696) 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca14c00640 1 -- 172.21.15.164:0/4173489248 learned_addr learned my addr 172.21.15.164:0/4173489248 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca0f400640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.612 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca14c00640 1 -- 172.21.15.164:0/4173489248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 msgr2=0x55edb73ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.619+0000 7fca14c00640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca14c00640 1 -- 172.21.15.164:0/4173489248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 msgr2=0x55edb73de780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca14c00640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73de780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca14c00640 1 -- 172.21.15.164:0/4173489248 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55edb73d38a0 con 0x55edb73e2610 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca0fe00640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73de780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca0f400640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fca14c00640 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca080ce290 tx=0x7fca0809ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2af5ef29c47a0ddc server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fc9fbe00640 1 -- 172.21.15.164:0/4173489248 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca080a50d0 con 0x55edb73e2610 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fc9fbe00640 1 -- 172.21.15.164:0/4173489248 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca080a5270 con 0x55edb73e2610 2024-03-27T08:36:58.613 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.620+0000 7fc9fbe00640 1 -- 172.21.15.164:0/4173489248 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca08061ab0 con 0x55edb73e2610 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 -- 172.21.15.164:0/4173489248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 msgr2=0x55edb73decc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca080ce290 tx=0x7fca0809ae00 comp rx=0 tx=0).stop 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 -- 172.21.15.164:0/4173489248 shutdown_connections 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73e2610 0x55edb73decc0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73dd4a0 0x55edb73ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.615 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 --2- 172.21.15.164:0/4173489248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73de780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 -- 172.21.15.164:0/4173489248 >> 172.21.15.164:0/4173489248 conn(0x55edb73d8020 msgr2=0x55edb73e6be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 -- 172.21.15.164:0/4173489248 shutdown_connections 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.621+0000 7fca1997e740 1 -- 172.21.15.164:0/4173489248 wait complete. 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 -- start start 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 Processor -- start 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73eb310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73eb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73e2610 0x55edb73ec810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fca10073080 con 0x55edb73dd4a0 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca101b3150 con 0x55edb73dcab0 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fca10073750 con 0x55edb73e2610 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca1997e740 10 client.0 _ll_register_callbacks cb 0x7fca08018620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.622+0000 7fca0f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73eb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.616 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73eb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73eb850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41698/0 (socket says 172.21.15.164:41698) 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0f400640 1 -- 172.21.15.164:0/3437881650 learned_addr learned my addr 172.21.15.164:0/3437881650 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca14c00640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73e2610 0x55edb73ec810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 -- 172.21.15.164:0/3437881650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73e2610 msgr2=0x55edb73ec810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73e2610 0x55edb73ec810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 -- 172.21.15.164:0/3437881650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 msgr2=0x55edb73eb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73eb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.617 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 -- 172.21.15.164:0/3437881650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55edb73ece00 con 0x55edb73dcab0 2024-03-27T08:36:58.617 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-03-27T08:36:58.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fca0fe00640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73eb310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55edb73d8f90 tx=0x7fca000042a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53c96e1bcb9384a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:58.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.623+0000 7fc9f9600640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:36:58.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.624+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca00053020 con 0x55edb73dcab0 2024-03-27T08:36:58.619 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.624+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fca080a5270 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.624+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fca000037f0 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.624+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fca000039f0 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 10 client.35540 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55edb73ee0e0 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca080a5270 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fca00056050 con 0x55edb73dcab0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 10 client.35540 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 10 client.35540 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 20 client.35540 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb7458da0 0x55edb745b190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 4 client.35540 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.625+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55edb7348f00 con 0x55edb7458da0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.626+0000 7fca0f400640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb7458da0 0x55edb745b190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:58.620 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.626+0000 7fc9f9600640 10 client.35540 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.626+0000 7fca0f400640 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb7458da0 0x55edb745b190 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c24207bbf10e8672 server_cookie=6684498f53e321bc in_seq=0 out_seq=0 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fc9f9600640 1 -- 172.21.15.164:0/3437881650 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55edb7348f00 con 0x55edb7458da0 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fc9f9600640 10 client.35540 handle_command_reply: tid=0 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 client.35540 shutdown 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 msgr2=0x55edb73eb310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73eb310 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x55edb73d8f90 tx=0x7fca000042a0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 shutdown_connections 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55edb7458da0 0x55edb745b190 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55edb73e2610 0x55edb73ec810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55edb73dd4a0 0x55edb73eb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 --2- 172.21.15.164:0/3437881650 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55edb73dcab0 0x55edb73eb310 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fc9f9600640 0 client.35540 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 >> 172.21.15.164:0/3437881650 conn(0x55edb73d8020 msgr2=0x55edb73e6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.621 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 shutdown_connections 2024-03-27T08:36:58.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 1 -- 172.21.15.164:0/3437881650 wait complete. 2024-03-27T08:36:58.622 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-03-27T08:36:58.622 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.627+0000 7fca1997e740 20 client.35540 trim_cache size 0 max 16384 2024-03-27T08:36:58.622 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:36:58.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 msgr2=0x7fc9f40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 0x7fc9f40a5ad0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x55edb73ddd00 tx=0x7fc9fc004730 comp rx=0 tx=0).stop 2024-03-27T08:36:58.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 msgr2=0x7fca101a1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:58.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fca0800cce0 tx=0x7fca0800a620 comp rx=0 tx=0).stop 2024-03-27T08:36:58.623 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 shutdown_connections 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9f40a3610 0x7fc9f40a5ad0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fca101098e0 0x7fca101a1490 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fca10075b30 0x7fca1019a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 --2- 172.21.15.164:0/2677943370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca10074550 0x7fca10199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.628+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 >> 172.21.15.164:0/2677943370 conn(0x7fca100fcfc0 msgr2=0x7fca10105870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.629+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 shutdown_connections 2024-03-27T08:36:58.624 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:58.629+0000 7fca15600640 1 -- 172.21.15.164:0/2677943370 wait complete. 2024-03-27T08:36:58.624 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-03-27T08:36:58.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-03-27T08:36:58.629 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-03-27T08:36:58.633 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-03-27T08:36:58.634 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:58 smithi164 ceph-mon[31788]: pgmap v490: 97 pgs: 97 active+clean; 37 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-03-27T08:36:58.635 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:36:58 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1458325532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:58.638 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-03-27T08:36:58.641 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-03-27T08:36:58.646 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-03-27T08:36:58.650 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-03-27T08:36:58.655 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-03-27T08:36:58.660 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-03-27T08:36:58.668 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-03-27T08:36:58.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-03-27T08:36:58.680 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-03-27T08:36:58.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-03-27T08:36:58.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-03-27T08:36:58.703 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-03-27T08:36:58.712 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-03-27T08:36:58.719 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-03-27T08:36:58.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-03-27T08:36:58.735 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-03-27T08:36:58.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-03-27T08:36:58.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-03-27T08:36:58.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-03-27T08:36:58.767 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-03-27T08:36:58.774 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-03-27T08:36:58.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-03-27T08:36:58.792 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-03-27T08:36:58.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-03-27T08:36:58.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-03-27T08:36:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:58 smithi167 ceph-mon[34903]: pgmap v490: 97 pgs: 97 active+clean; 37 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-03-27T08:36:58.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:36:58 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1458325532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:58.822 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-03-27T08:36:58.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:58 smithi173 ceph-mon[35397]: pgmap v490: 97 pgs: 97 active+clean; 37 MiB data, 482 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.0 MiB/s wr, 11 op/s 2024-03-27T08:36:58.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:36:58 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1458325532' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:36:58.831 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-03-27T08:36:58.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-03-27T08:36:58.850 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-03-27T08:36:58.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-03-27T08:36:58.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-03-27T08:36:58.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-03-27T08:36:58.889 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-03-27T08:36:58.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-03-27T08:36:58.906 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-03-27T08:36:58.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-03-27T08:36:58.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-03-27T08:36:58.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-03-27T08:36:58.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-03-27T08:36:58.953 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-03-27T08:36:58.962 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-03-27T08:36:58.970 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-03-27T08:36:58.977 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-03-27T08:36:58.984 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-03-27T08:36:58.996 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-03-27T08:36:59.004 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-03-27T08:36:59.011 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-03-27T08:36:59.019 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-03-27T08:36:59.029 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-03-27T08:36:59.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-03-27T08:36:59.045 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-03-27T08:36:59.054 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-03-27T08:36:59.063 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-03-27T08:36:59.077 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-03-27T08:36:59.086 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-03-27T08:36:59.093 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-03-27T08:36:59.102 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-03-27T08:36:59.111 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-03-27T08:36:59.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-03-27T08:36:59.128 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-03-27T08:36:59.134 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-03-27T08:36:59.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-03-27T08:36:59.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-03-27T08:36:59.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-03-27T08:36:59.169 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-03-27T08:36:59.180 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-03-27T08:36:59.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-03-27T08:36:59.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-03-27T08:36:59.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-03-27T08:36:59.216 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-03-27T08:36:59.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-03-27T08:36:59.233 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-03-27T08:36:59.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-03-27T08:36:59.254 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-03-27T08:36:59.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-03-27T08:36:59.271 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-03-27T08:36:59.280 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-03-27T08:36:59.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-03-27T08:36:59.297 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-03-27T08:36:59.306 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-03-27T08:36:59.314 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-03-27T08:36:59.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-03-27T08:36:59.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-03-27T08:36:59.342 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-03-27T08:36:59.350 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-03-27T08:36:59.359 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-03-27T08:36:59.367 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-03-27T08:36:59.376 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-03-27T08:36:59.385 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-03-27T08:36:59.393 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-03-27T08:36:59.401 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-03-27T08:36:59.409 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-03-27T08:36:59.419 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-03-27T08:36:59.427 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-03-27T08:36:59.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-03-27T08:36:59.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-03-27T08:36:59.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-03-27T08:36:59.463 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-03-27T08:36:59.472 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-03-27T08:36:59.481 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-03-27T08:36:59.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-03-27T08:36:59.498 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-03-27T08:36:59.507 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-03-27T08:36:59.515 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-03-27T08:36:59.524 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-03-27T08:36:59.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-03-27T08:36:59.543 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-03-27T08:36:59.552 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-03-27T08:36:59.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-03-27T08:36:59.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-03-27T08:36:59.577 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-03-27T08:36:59.585 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-03-27T08:36:59.593 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-03-27T08:36:59.606 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-03-27T08:36:59.612 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-03-27T08:36:59.620 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-03-27T08:36:59.628 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-03-27T08:36:59.637 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T08:36:59.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:36:59.638 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T08:36:59.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-03-27T08:36:59.648 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-03-27T08:36:59.657 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-03-27T08:36:59.663 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-03-27T08:36:59.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-03-27T08:36:59.672 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-03-27T08:36:59.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-03-27T08:36:59.683 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-03-27T08:36:59.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-03-27T08:36:59.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-03-27T08:36:59.696 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-03-27T08:36:59.700 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-03-27T08:36:59.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-03-27T08:36:59.712 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-03-27T08:36:59.718 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-03-27T08:36:59.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-03-27T08:36:59.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-03-27T08:36:59.738 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-03-27T08:36:59.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-03-27T08:36:59.748 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-03-27T08:36:59.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-03-27T08:36:59.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-03-27T08:36:59.764 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-03-27T08:36:59.770 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-03-27T08:36:59.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-03-27T08:36:59.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-03-27T08:36:59.794 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-03-27T08:36:59.801 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-03-27T08:36:59.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-03-27T08:36:59.814 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-03-27T08:36:59.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-03-27T08:36:59.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-03-27T08:36:59.833 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 -- 172.21.15.164:0/3796401370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 msgr2=0x7f8f90105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 --2- 172.21.15.164:0/3796401370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f90105400 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f8f78009900 tx=0x7f8f7802bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 -- 172.21.15.164:0/3796401370 shutdown_connections 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 --2- 172.21.15.164:0/3796401370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 0x7f8f9010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 --2- 172.21.15.164:0/3796401370 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f90105400 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.875 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 --2- 172.21.15.164:0/3796401370 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 0x7f8f901041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 -- 172.21.15.164:0/3796401370 >> 172.21.15.164:0/3796401370 conn(0x7f8f900ff300 msgr2=0x7f8f90101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 -- 172.21.15.164:0/3796401370 shutdown_connections 2024-03-27T08:36:59.876 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.883+0000 7f8f97800640 1 -- 172.21.15.164:0/3796401370 wait complete. 2024-03-27T08:36:59.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 Processor -- start 2024-03-27T08:36:59.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 -- start start 2024-03-27T08:36:59.878 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 0x7f8f9019a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 0x7f8f901a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010fa30 con 0x7f8f90104f80 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010f8b0 con 0x7f8f90105940 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.884+0000 7f8f97800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f9010fbb0 con 0x7f8f90103d90 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41702/0 (socket says 172.21.15.164:41702) 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 -- 172.21.15.164:0/2777236847 learned_addr learned my addr 172.21.15.164:0/2777236847 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f95800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 0x7f8f901a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f94e00640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 0x7f8f9019a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 -- 172.21.15.164:0/2777236847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 msgr2=0x7f8f9019a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 0x7f8f9019a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 -- 172.21.15.164:0/2777236847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 msgr2=0x7f8f901a16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 0x7f8f901a16b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 -- 172.21.15.164:0/2777236847 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f901a1d20 con 0x7f8f90104f80 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.885+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8f78000c00 tx=0x7f8f78004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.886+0000 7f8f8d600640 1 -- 172.21.15.164:0/2777236847 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78043020 con 0x7f8f90104f80 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.886+0000 7f8f8d600640 1 -- 172.21.15.164:0/2777236847 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f780054d0 con 0x7f8f90104f80 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.886+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f901a1fb0 con 0x7f8f90104f80 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.886+0000 7f8f8d600640 1 -- 172.21.15.164:0/2777236847 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f78003d40 con 0x7f8f90104f80 2024-03-27T08:36:59.880 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.886+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f901a24c0 con 0x7f8f90104f80 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.889+0000 7f8f8d600640 1 -- 172.21.15.164:0/2777236847 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8f78046020 con 0x7f8f90104f80 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.889+0000 7f8f9a427740 1 Processor -- start 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.889+0000 7f8f9a427740 1 -- start start 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c3fa550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c401320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55610c35e280 con 0x55610c3f8f00 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55610c3066f0 con 0x55610c3faa90 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f9a427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55610c35a230 con 0x55610c3fa0d0 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41712/0 (socket says 172.21.15.164:41712) 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 -- 172.21.15.164:0/3932592859 learned_addr learned my addr 172.21.15.164:0/3932592859 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c401320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f94e00640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c3fa550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f8d600640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 0x7f8f740a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 -- 172.21.15.164:0/3932592859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 msgr2=0x55610c3fa550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c3fa550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 -- 172.21.15.164:0/3932592859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 msgr2=0x55610c401320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c401320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f95800640 1 -- 172.21.15.164:0/3932592859 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610c13a7e0 con 0x55610c3f8f00 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.890+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c401320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f8d600640 1 -- 172.21.15.164:0/2777236847 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8f780f2030 con 0x7f8f90104f80 2024-03-27T08:36:59.884 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f95800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 0x7f8f740a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f95800640 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000dc30 tx=0x7f8f8000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8780039b2cdbb256 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f86000640 1 -- 172.21.15.164:0/3932592859 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8001c480 con 0x55610c3f8f00 2024-03-27T08:36:59.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f86000640 1 -- 172.21.15.164:0/3932592859 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f80011990 con 0x55610c3f8f00 2024-03-27T08:36:59.885 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.891+0000 7f8f86000640 1 -- 172.21.15.164:0/3932592859 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8001bc60 con 0x55610c3f8f00 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 -- 172.21.15.164:0/3932592859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 msgr2=0x55610c3f9320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f8f8000dc30 tx=0x7f8f8000f730 comp rx=0 tx=0).stop 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f95800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 0x7f8f740a5b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f8001b000 tx=0x7f8f800107a0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 -- 172.21.15.164:0/3932592859 shutdown_connections 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c401320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c3fa550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 --2- 172.21.15.164:0/3932592859 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c3f9320 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.889 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.892+0000 7f8f9a427740 1 -- 172.21.15.164:0/3932592859 >> 172.21.15.164:0/3932592859 conn(0x55610c3f42f0 msgr2=0x55610c3f46f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.893+0000 7f8f9a427740 1 -- 172.21.15.164:0/3932592859 shutdown_connections 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.893+0000 7f8f9a427740 1 -- 172.21.15.164:0/3932592859 wait complete. 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.893+0000 7f8f9a427740 1 -- start start 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.893+0000 7f8f9a427740 1 Processor -- start 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3f8f00 0x55610c403470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c40a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55610c401aa0 con 0x55610c3fa0d0 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55610c319aa0 con 0x55610c3faa90 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55610c401c20 con 0x55610c3f8f00 2024-03-27T08:36:59.890 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f9a427740 10 client.0 _ll_register_callbacks cb 0x55610c319490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41724/0 (socket says 172.21.15.164:41724) 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 -- 172.21.15.164:0/4192966216 learned_addr learned my addr 172.21.15.164:0/4192966216 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f94e00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3f8f00 0x55610c403470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f95800640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c40a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.891 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 -- 172.21.15.164:0/4192966216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3f8f00 msgr2=0x55610c403470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3f8f00 0x55610c403470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 -- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 msgr2=0x55610c40a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c40a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f8fe00640 1 -- 172.21.15.164:0/4192966216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610c19af70 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.894+0000 7f8f95800640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c40a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8f780ba970 tx=0x7f8f7802bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dea7ba3a30f16ef server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f780be2e0 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8f780035f0 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f80011990 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f780bde70 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f9a427740 10 client.15870 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55610c032170 con 0x55610c3fa0d0 2024-03-27T08:36:59.892 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.895+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f80011990 con 0x55610c3fa0d0 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8f780f40d0 con 0x55610c3fa0d0 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 10 client.15870 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 10 client.15870 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 20 client.15870 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c40f1a0 0x55610c4115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 4 client.15870 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55610c36b7c0 con 0x55610c40f1a0 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.896+0000 7f8f94e00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c40f1a0 0x55610c4115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.897+0000 7f8f94e00640 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c40f1a0 0x55610c4115e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5578291eb1c81e3b server_cookie=bc08f10e6df2e7c2 in_seq=0 out_seq=0 2024-03-27T08:36:59.893 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.897+0000 7f8f7ea00640 10 client.15870 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:59.894 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.898+0000 7f8f7ea00640 1 -- 172.21.15.164:0/4192966216 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55610c36b7c0 con 0x55610c40f1a0 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.898+0000 7f8f7ea00640 10 client.15870 handle_command_reply: tid=0 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 client.15870 shutdown 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 msgr2=0x55610c4039b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f8f780ba970 tx=0x7f8f7802bc30 comp rx=0 tx=0).stop 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 shutdown_connections 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c40f1a0 0x55610c4115e0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c40a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3fa0d0 0x55610c4039b0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 --2- 172.21.15.164:0/4192966216 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3f8f00 0x55610c403470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f7ea00640 0 client.15870 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 >> 172.21.15.164:0/4192966216 conn(0x55610c3f42f0 msgr2=0x55610c3f3550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.895 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 shutdown_connections 2024-03-27T08:36:59.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 1 -- 172.21.15.164:0/4192966216 wait complete. 2024-03-27T08:36:59.896 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.899+0000 7f8f9a427740 20 client.15870 trim_cache size 0 max 16384 2024-03-27T08:36:59.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.918+0000 7f8f9a427740 1 Processor -- start 2024-03-27T08:36:59.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.918+0000 7f8f9a427740 1 -- start start 2024-03-27T08:36:59.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c40a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c3f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901adac0 con 0x55610c3f8f00 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901ab390 con 0x55610c3faa90 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f9a427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901a91e0 con 0x55610c3fa0d0 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41736/0 (socket says 172.21.15.164:41736) 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 -- 172.21.15.164:0/605398715 learned_addr learned my addr 172.21.15.164:0/605398715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:59.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f95800640 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c3f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 -- 172.21.15.164:0/605398715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 msgr2=0x55610c40a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c40a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 -- 172.21.15.164:0/605398715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 msgr2=0x55610c3f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c3f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.919+0000 7f8f94e00640 1 -- 172.21.15.164:0/605398715 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55610c411c60 con 0x55610c3f8f00 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f94e00640 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800ae40 tx=0x7f8f8800a880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be631879be2e51bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f85600640 1 -- 172.21.15.164:0/605398715 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8801baa0 con 0x55610c3f8f00 2024-03-27T08:36:59.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f85600640 1 -- 172.21.15.164:0/605398715 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f8801b810 con 0x55610c3f8f00 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f85600640 1 -- 172.21.15.164:0/605398715 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f88004030 con 0x55610c3f8f00 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 -- 172.21.15.164:0/605398715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 msgr2=0x55610c402e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800ae40 tx=0x7f8f8800a880 comp rx=0 tx=0).stop 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 -- 172.21.15.164:0/605398715 shutdown_connections 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3faa90 0x55610c3f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c40a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 --2- 172.21.15.164:0/605398715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3f8f00 0x55610c402e50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.920+0000 7f8f9a427740 1 -- 172.21.15.164:0/605398715 >> 172.21.15.164:0/605398715 conn(0x55610c3f42f0 msgr2=0x55610c402740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 -- 172.21.15.164:0/605398715 shutdown_connections 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 -- 172.21.15.164:0/605398715 wait complete. 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 -- start start 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 Processor -- start 2024-03-27T08:36:59.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3f8f00 0x55610c40a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.921+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c408c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f9a427740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f9a427740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901a9850 con 0x55610c3faa90 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f9a427740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901aacc0 con 0x55610c3f8f00 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f9a427740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f8f901a9f20 con 0x55610c3fa0d0 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f9a427740 10 client.0 _ll_register_callbacks cb 0x7f8f780ba830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41752/0 (socket says 172.21.15.164:41752) 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 -- 172.21.15.164:0/1176779970 learned_addr learned my addr 172.21.15.164:0/1176779970 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f94e00640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3f8f00 0x55610c40a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f8fe00640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c408c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 -- 172.21.15.164:0/1176779970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 msgr2=0x55610c408c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c408c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.916 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 -- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3f8f00 msgr2=0x55610c40a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:36:59.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3f8f00 0x55610c40a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.922+0000 7f8f95800640 1 -- 172.21.15.164:0/1176779970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55610c3f8d30 con 0x55610c3faa90 2024-03-27T08:36:59.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f95800640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8f8001c040 tx=0x7f8f80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a87a0f33a9127964 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:36:59.917 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:36:59.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f8001c480 con 0x55610c3faa90 2024-03-27T08:36:59.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f8f80011990 con 0x55610c3faa90 2024-03-27T08:36:59.918 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f8801b810 con 0x55610c3faa90 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8f80011b90 con 0x55610c3faa90 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f9a427740 10 client.15876 fetch_fsmap learned FSMap version 24 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55610c47ea40 con 0x55610c3faa90 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.923+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f8801b810 con 0x55610c3faa90 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f8f80031070 con 0x55610c3faa90 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 10 client.15876 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 20 client.15876 populate_metadata read hostname 'smithi164' 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c47f2e0 0x55610c481700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 4 client.15876 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55610c365b10 con 0x55610c47f2e0 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.924+0000 7f8f94e00640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c47f2e0 0x55610c481700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.925+0000 7f8f7ea00640 10 client.15876 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:59.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.925+0000 7f8f94e00640 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c47f2e0 0x55610c481700 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8861efee0a187c3c server_cookie=77dace2d9cc2a4d6 in_seq=0 out_seq=0 2024-03-27T08:36:59.920 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f7ea00640 1 -- 172.21.15.164:0/1176779970 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55610c365b10 con 0x55610c47f2e0 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f7ea00640 10 client.15876 handle_command_reply: tid=0 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 client.15876 shutdown 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 msgr2=0x55610c409160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8f8001c040 tx=0x7f8f80016000 comp rx=0 tx=0).stop 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 shutdown_connections 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55610c47f2e0 0x55610c481700 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55610c3faa90 0x55610c409160 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55610c3fa0d0 0x55610c408c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f7ea00640 0 client.15876 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 --2- 172.21.15.164:0/1176779970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55610c3f8f00 0x55610c40a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 >> 172.21.15.164:0/1176779970 conn(0x55610c3f42f0 msgr2=0x55610c3f7550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 shutdown_connections 2024-03-27T08:36:59.921 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 1 -- 172.21.15.164:0/1176779970 wait complete. 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.928+0000 7f8f9a427740 20 client.15876 trim_cache size 0 max 16384 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stdout: "return_code": 0, 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_tag": "7e7ab286-c489-4884-bf1a-cbe373190e2e", 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": "asynchronous" 2024-03-27T08:36:59.922 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 msgr2=0x7f8f740a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 0x7f8f740a5b50 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8f8001b000 tx=0x7f8f800107a0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 msgr2=0x7f8f9019a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f8f78000c00 tx=0x7f8f78004f10 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 shutdown_connections 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f8f740a3690 0x7f8f740a5b50 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f90105940 0x7f8f901a16b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8f90104f80 0x7f8f9019a640 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 --2- 172.21.15.164:0/2777236847 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8f90103d90 0x7f8f9019a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:36:59.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 >> 172.21.15.164:0/2777236847 conn(0x7f8f900ff300 msgr2=0x7f8f901082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:36:59.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 shutdown_connections 2024-03-27T08:36:59.924 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:36:59.929+0000 7f8f97800640 1 -- 172.21.15.164:0/2777236847 wait complete. 2024-03-27T08:36:59.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:36:59.939 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:37:00.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-03-27T08:37:00.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-03-27T08:37:00.196 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-03-27T08:37:00.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 -- 172.21.15.164:0/989132502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54102d60 msgr2=0x7fbd541031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 --2- 172.21.15.164:0/989132502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54102d60 0x7fbd541031e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7fbd40009900 tx=0x7fbd4002bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 -- 172.21.15.164:0/989132502 shutdown_connections 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 --2- 172.21.15.164:0/989132502 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 0x7fbd54109fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 --2- 172.21.15.164:0/989132502 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54102d60 0x7fbd541031e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.200 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 --2- 172.21.15.164:0/989132502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54101b70 0x7fbd54101f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 -- 172.21.15.164:0/989132502 >> 172.21.15.164:0/989132502 conn(0x7fbd540fd100 msgr2=0x7fbd540ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 -- 172.21.15.164:0/989132502 shutdown_connections 2024-03-27T08:37:00.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.208+0000 7fbd59200640 1 -- 172.21.15.164:0/989132502 wait complete. 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.209+0000 7fbd59200640 1 Processor -- start 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 -- start start 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 0x7fbd5419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 0x7fbd5419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 0x7fbd541a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410d820 con 0x7fbd54101b70 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410d6a0 con 0x7fbd54102d60 2024-03-27T08:37:00.202 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd59200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbd5410d9a0 con 0x7fbd54103720 2024-03-27T08:37:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 0x7fbd5419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 0x7fbd5419a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41766/0 (socket says 172.21.15.164:41766) 2024-03-27T08:37:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd51e00640 1 -- 172.21.15.164:0/1289506773 learned_addr learned my addr 172.21.15.164:0/1289506773 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.210+0000 7fbd51400640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 0x7fbd5419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.203 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd52800640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 0x7fbd541a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.203 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-03-27T08:37:00.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 -- 172.21.15.164:0/1289506773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 msgr2=0x7fbd541a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.204 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 0x7fbd541a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 -- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 msgr2=0x7fbd5419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 0x7fbd5419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 -- 172.21.15.164:0/1289506773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd541a1d10 con 0x7fbd54102d60 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.211+0000 7fbd51400640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 0x7fbd5419a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd40036040 tx=0x7fbd40004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.212+0000 7fbd4aa00640 1 -- 172.21.15.164:0/1289506773 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40043020 con 0x7fbd54102d60 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.212+0000 7fbd4aa00640 1 -- 172.21.15.164:0/1289506773 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd40005460 con 0x7fbd54102d60 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.212+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd541a1fa0 con 0x7fbd54102d60 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.212+0000 7fbd4aa00640 1 -- 172.21.15.164:0/1289506773 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd40003ca0 con 0x7fbd54102d60 2024-03-27T08:37:00.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.212+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd541a24b0 con 0x7fbd54102d60 2024-03-27T08:37:00.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-03-27T08:37:00.207 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.216+0000 7fbd5be5f740 1 Processor -- start 2024-03-27T08:37:00.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.216+0000 7fbd5be5f740 1 -- start start 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66c974a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ba66bf56b0 con 0x55ba66c8fea0 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba66b9d750 con 0x55ba66c95010 2024-03-27T08:37:00.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ba66bf1660 con 0x55ba66c8f4b0 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd4aa00640 1 -- 172.21.15.164:0/1289506773 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fbd40046020 con 0x7fbd54102d60 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41776/0 (socket says 172.21.15.164:41776) 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd51e00640 1 -- 172.21.15.164:0/384125122 learned_addr learned my addr 172.21.15.164:0/384125122 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd52800640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.217+0000 7fbd51400640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66c974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 -- 172.21.15.164:0/384125122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 msgr2=0x55ba66c8f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8f8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 -- 172.21.15.164:0/384125122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 msgr2=0x55ba66c974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66c974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 -- 172.21.15.164:0/384125122 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba669d37d0 con 0x55ba66c8fea0 2024-03-27T08:37:00.210 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd52800640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:00.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd51e00640 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d80 tx=0x7fbd44011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c681a69339babb99 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd3f400640 1 -- 172.21.15.164:0/384125122 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4401e070 con 0x55ba66c8fea0 2024-03-27T08:37:00.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd3f400640 1 -- 172.21.15.164:0/384125122 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd44019b00 con 0x55ba66c8fea0 2024-03-27T08:37:00.211 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.218+0000 7fbd3f400640 1 -- 172.21.15.164:0/384125122 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd4400ea80 con 0x55ba66c8fea0 2024-03-27T08:37:00.212 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-03-27T08:37:00.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.219+0000 7fbd4aa00640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 0x7fbd380a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.214 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.219+0000 7fbd4aa00640 1 -- 172.21.15.164:0/1289506773 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbd400f1e40 con 0x7fbd54102d60 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.219+0000 7fbd5be5f740 1 -- 172.21.15.164:0/384125122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 msgr2=0x55ba66c949a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.219+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fbd44009d80 tx=0x7fbd44011810 comp rx=0 tx=0).stop 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd52800640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 0x7fbd380a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 -- 172.21.15.164:0/384125122 shutdown_connections 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66c974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66c949a0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/384125122 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 -- 172.21.15.164:0/384125122 >> 172.21.15.164:0/384125122 conn(0x55ba66c8aa20 msgr2=0x55ba66c8ae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd5be5f740 1 -- 172.21.15.164:0/384125122 shutdown_connections 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.220+0000 7fbd52800640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 0x7fbd380a5b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ba66c90700 tx=0x7fbd4c009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.215 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.221+0000 7fbd5be5f740 1 -- 172.21.15.164:0/384125122 wait complete. 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.221+0000 7fbd5be5f740 1 -- start start 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.221+0000 7fbd5be5f740 1 Processor -- start 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c99f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c95010 0x55ba66ca0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ba66c97fc0 con 0x55ba66c8f4b0 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba66bb0a80 con 0x55ba66c8fea0 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ba66c98140 con 0x55ba66c95010 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd5be5f740 10 client.0 _ll_register_callbacks cb 0x55ba66bb0470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:00.216 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd51e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41780/0 (socket says 172.21.15.164:41780) 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd51e00640 1 -- 172.21.15.164:0/4281098709 learned_addr learned my addr 172.21.15.164:0/4281098709 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd51400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c99f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.222+0000 7fbd52800640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c95010 0x55ba66ca0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 -- 172.21.15.164:0/4281098709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c95010 msgr2=0x55ba66ca0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c95010 0x55ba66ca0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 -- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 msgr2=0x55ba66c99f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c99f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 -- 172.21.15.164:0/4281098709 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba669093f0 con 0x55ba66c8f4b0 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd51e00640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbd440058c0 tx=0x7fbd440196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02e9488c37cd31b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.217 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd33e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:00.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd44028020 con 0x55ba66c8f4b0 2024-03-27T08:37:00.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbd44005050 con 0x55ba66c8f4b0 2024-03-27T08:37:00.218 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.223+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd44019b00 con 0x55ba66c8f4b0 2024-03-27T08:37:00.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd4401e040 con 0x55ba66c8f4b0 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 10 client.15888 fetch_fsmap learned FSMap version 24 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba668c90f0 con 0x55ba66c8f4b0 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd44019b00 con 0x55ba66c8f4b0 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fbd440046c0 con 0x55ba66c8f4b0 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 10 client.15888 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 10 client.15888 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 20 client.15888 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66ca5580 0x55ba66ca79d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.220 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 4 client.15888 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.224+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba66c02bf0 con 0x55ba66ca5580 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.225+0000 7fbd51400640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66ca5580 0x55ba66ca79d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.225+0000 7fbd51400640 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66ca5580 0x55ba66ca79d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbd7ef62cbeda97d server_cookie=59e11dfdad6d0837 in_seq=0 out_seq=0 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.225+0000 7fbd33e00640 10 client.15888 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd33e00640 1 -- 172.21.15.164:0/4281098709 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ba66c02bf0 con 0x55ba66ca5580 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd33e00640 10 client.15888 handle_command_reply: tid=0 2024-03-27T08:37:00.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 client.15888 shutdown 2024-03-27T08:37:00.221 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-03-27T08:37:00.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 msgr2=0x55ba66c99a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fbd440058c0 tx=0x7fbd440196e0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 shutdown_connections 2024-03-27T08:37:00.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66ca5580 0x55ba66ca79d0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c95010 0x55ba66ca0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c99f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd33e00640 0 client.15888 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/4281098709 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8f4b0 0x55ba66c99a20 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 >> 172.21.15.164:0/4281098709 conn(0x55ba66c8aa20 msgr2=0x55ba66c89c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 shutdown_connections 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.228+0000 7fbd5be5f740 1 -- 172.21.15.164:0/4281098709 wait complete. 2024-03-27T08:37:00.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.229+0000 7fbd5be5f740 20 client.15888 trim_cache size 0 max 16384 2024-03-27T08:37:00.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-03-27T08:37:00.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-03-27T08:37:00.230 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-03-27T08:37:00.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-03-27T08:37:00.238 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-03-27T08:37:00.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 Processor -- start 2024-03-27T08:37:00.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 -- start start 2024-03-27T08:37:00.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8e510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66cad2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541adb50 con 0x55ba66c8fea0 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541ab420 con 0x55ba66c95010 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.250+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541a9270 con 0x55ba66c8f4b0 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:41792/0 (socket says 172.21.15.164:41792) 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 -- 172.21.15.164:0/205878891 learned_addr learned my addr 172.21.15.164:0/205878891 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:00.243 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd52800640 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66cad2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51e00640 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 -- 172.21.15.164:0/205878891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 msgr2=0x55ba66c8e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 -- 172.21.15.164:0/205878891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 msgr2=0x55ba66cad2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66cad2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 -- 172.21.15.164:0/205878891 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba66c94690 con 0x55ba66c8fea0 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.251+0000 7fbd51400640 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbd400bdfc0 tx=0x7fbd400ef7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1c0a04193ca84b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.252+0000 7fbd3ea00640 1 -- 172.21.15.164:0/205878891 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd400bdc20 con 0x55ba66c8fea0 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.252+0000 7fbd3ea00640 1 -- 172.21.15.164:0/205878891 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd40005610 con 0x55ba66c8fea0 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.252+0000 7fbd3ea00640 1 -- 172.21.15.164:0/205878891 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd400bc360 con 0x55ba66c8fea0 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- 172.21.15.164:0/205878891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 msgr2=0x55ba66ca0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fbd400bdfc0 tx=0x7fbd400ef7c0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- 172.21.15.164:0/205878891 shutdown_connections 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c95010 0x55ba66cad2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c8fea0 0x55ba66ca0f60 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/205878891 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c8e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- 172.21.15.164:0/205878891 >> 172.21.15.164:0/205878891 conn(0x55ba66c8aa20 msgr2=0x55ba66c89390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- 172.21.15.164:0/205878891 shutdown_connections 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- 172.21.15.164:0/205878891 wait complete. 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.253+0000 7fbd5be5f740 1 -- start start 2024-03-27T08:37:00.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 Processor -- start 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c9e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c95010 0x55ba66c9f910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541a98e0 con 0x55ba66c95010 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541aad50 con 0x55ba66c8fea0 2024-03-27T08:37:00.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbd541a9fb0 con 0x55ba66c8f4b0 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd5be5f740 10 client.0 _ll_register_callbacks cb 0x7fbd440099b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd51400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd51400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36870/0 (socket says 172.21.15.164:36870) 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd51400640 1 -- 172.21.15.164:0/2005785451 learned_addr learned my addr 172.21.15.164:0/2005785451 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.254+0000 7fbd52800640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c95010 0x55ba66c9f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51e00640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c9e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 -- 172.21.15.164:0/2005785451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 msgr2=0x55ba66c9e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c9e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 -- 172.21.15.164:0/2005785451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c95010 msgr2=0x55ba66c9f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c95010 0x55ba66c9f910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 -- 172.21.15.164:0/2005785451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba66c9ff00 con 0x55ba66c8fea0 2024-03-27T08:37:00.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-03-27T08:37:00.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd51400640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd400be250 tx=0x7fbd400c7090 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b060f6451a0f410e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:00.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.255+0000 7fbd33e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:00.252 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd400db020 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbd400042d0 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbd40005610 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fbd40003e40 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd5be5f740 10 client.35573 fetch_fsmap learned FSMap version 24 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55ba66ca12b0 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbd40005610 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7fbd4009f020 con 0x55ba66c8fea0 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd5be5f740 10 client.35573 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.256+0000 7fbd5be5f740 10 client.35573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.257+0000 7fbd5be5f740 20 client.35573 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.257+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66d0be10 0x55ba66d0e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.257+0000 7fbd5be5f740 4 client.35573 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.257+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ba66bfcf40 con 0x55ba66d0be10 2024-03-27T08:37:00.253 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.257+0000 7fbd51e00640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66d0be10 0x55ba66d0e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.258+0000 7fbd51e00640 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66d0be10 0x55ba66d0e230 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54d375863a4529fd server_cookie=fea5bcf16b9c09a6 in_seq=0 out_seq=0 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.258+0000 7fbd33e00640 10 client.35573 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd33e00640 1 -- 172.21.15.164:0/2005785451 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55ba66bfcf40 con 0x55ba66d0be10 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd33e00640 10 client.35573 handle_command_reply: tid=0 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 client.35573 shutdown 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 msgr2=0x55ba66c9e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbd400be250 tx=0x7fbd400c7090 comp rx=0 tx=0).stop 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 shutdown_connections 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba66d0be10 0x55ba66d0e230 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba66c95010 0x55ba66c9f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba66c8fea0 0x55ba66c9e950 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd33e00640 0 client.35573 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:00.254 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 --2- 172.21.15.164:0/2005785451 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba66c8f4b0 0x55ba66c9e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 >> 172.21.15.164:0/2005785451 conn(0x55ba66c8aa20 msgr2=0x55ba66c89c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 shutdown_connections 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 1 -- 172.21.15.164:0/2005785451 wait complete. 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.259+0000 7fbd5be5f740 20 client.35573 trim_cache size 0 max 16384 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": { 2024-03-27T08:37:00.255 INFO:teuthology.orchestra.run.smithi164.stdout: "7e7ab286-c489-4884-bf1a-cbe373190e2e": { 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/", 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout: "tag": "7e7ab286-c489-4884-bf1a-cbe373190e2e", 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout: "options": "recursive,force" 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:37:00.256 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:37:00.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 msgr2=0x7fbd380a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 0x7fbd380a5b50 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x55ba66c90700 tx=0x7fbd4c009600 comp rx=0 tx=0).stop 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 msgr2=0x7fbd5419a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 0x7fbd5419a630 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fbd40036040 tx=0x7fbd40004e20 comp rx=0 tx=0).stop 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 shutdown_connections 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbd380a3690 0x7fbd380a5b50 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbd54103720 0x7fbd541a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbd54102d60 0x7fbd5419a630 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.257 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 --2- 172.21.15.164:0/1289506773 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbd54101b70 0x7fbd5419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:00.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 >> 172.21.15.164:0/1289506773 conn(0x7fbd540fd100 msgr2=0x7fbd54073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:00.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 shutdown_connections 2024-03-27T08:37:00.258 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:00.260+0000 7fbd59200640 1 -- 172.21.15.164:0/1289506773 wait complete. 2024-03-27T08:37:00.258 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-03-27T08:37:00.260 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-03-27T08:37:00.265 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-03-27T08:37:00.272 INFO:tasks.cephfs.filesystem:scrub status for tag:7e7ab286-c489-4884-bf1a-cbe373190e2e - {'path': '/', 'tag': '7e7ab286-c489-4884-bf1a-cbe373190e2e', 'options': 'recursive,force'} 2024-03-27T08:37:00.272 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-03-27T08:37:00.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-03-27T08:37:00.282 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-03-27T08:37:00.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-03-27T08:37:00.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-03-27T08:37:00.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-03-27T08:37:00.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-03-27T08:37:00.317 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-03-27T08:37:00.325 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-03-27T08:37:00.333 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-03-27T08:37:00.343 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-03-27T08:37:00.355 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-03-27T08:37:00.361 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-03-27T08:37:00.369 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-03-27T08:37:00.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-03-27T08:37:00.383 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-03-27T08:37:00.393 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-03-27T08:37:00.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-03-27T08:37:00.410 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-03-27T08:37:00.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-03-27T08:37:00.430 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-03-27T08:37:00.438 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-03-27T08:37:00.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-03-27T08:37:00.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-03-27T08:37:00.464 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-03-27T08:37:00.473 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-03-27T08:37:00.481 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-03-27T08:37:00.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-03-27T08:37:00.498 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-03-27T08:37:00.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-03-27T08:37:00.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-03-27T08:37:00.521 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-03-27T08:37:00.529 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-03-27T08:37:00.538 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-03-27T08:37:00.545 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-03-27T08:37:00.553 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-03-27T08:37:00.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-03-27T08:37:00.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-03-27T08:37:00.592 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-03-27T08:37:00.603 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-03-27T08:37:00.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-03-27T08:37:00.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-03-27T08:37:00.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-03-27T08:37:00.643 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/Changes 2024-03-27T08:37:00.653 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-03-27T08:37:00.661 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/CodingStyle 2024-03-27T08:37:00.672 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-03-27T08:37:00.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-03-27T08:37:00.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-03-27T08:37:00.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-03-27T08:37:00.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/ 2024-03-27T08:37:00.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-03-27T08:37:00.723 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-03-27T08:37:00.734 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-03-27T08:37:00.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-03-27T08:37:00.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-03-27T08:37:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:00 smithi164 ceph-mon[31788]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-03-27T08:37:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:00 smithi164 ceph-mon[31788]: scrub queued for path: / 2024-03-27T08:37:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:00 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:00 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:37:00.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:00 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-03-27T08:37:00.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-03-27T08:37:00.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-03-27T08:37:00.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-03-27T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:00 smithi167 ceph-mon[34903]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-03-27T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:00 smithi167 ceph-mon[34903]: scrub queued for path: / 2024-03-27T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:00 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:00 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:37:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:00 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:00 smithi173 ceph-mon[35397]: pgmap v491: 97 pgs: 97 active+clean; 55 MiB data, 522 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 4.5 MiB/s wr, 11 op/s 2024-03-27T08:37:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:00 smithi173 ceph-mon[35397]: scrub queued for path: / 2024-03-27T08:37:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:00 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:00 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:37:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:00 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:00.828 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-03-27T08:37:00.840 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-03-27T08:37:00.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-03-27T08:37:00.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-03-27T08:37:00.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-03-27T08:37:00.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-03-27T08:37:00.902 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-03-27T08:37:00.917 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-03-27T08:37:00.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-03-27T08:37:00.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-03-27T08:37:00.949 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-03-27T08:37:00.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-03-27T08:37:00.966 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-03-27T08:37:00.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-03-27T08:37:00.985 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-03-27T08:37:00.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-03-27T08:37:01.001 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-03-27T08:37:01.010 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-03-27T08:37:01.023 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-03-27T08:37:01.036 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-03-27T08:37:01.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-03-27T08:37:01.059 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-03-27T08:37:01.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-03-27T08:37:01.082 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-03-27T08:37:01.094 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-03-27T08:37:01.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-03-27T08:37:01.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-03-27T08:37:01.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-03-27T08:37:01.145 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-03-27T08:37:01.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-03-27T08:37:01.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-03-27T08:37:01.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-03-27T08:37:01.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-03-27T08:37:01.210 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-03-27T08:37:01.220 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-03-27T08:37:01.231 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-03-27T08:37:01.241 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-03-27T08:37:01.249 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-03-27T08:37:01.257 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-03-27T08:37:01.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-03-27T08:37:01.278 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-03-27T08:37:01.290 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-03-27T08:37:01.314 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-03-27T08:37:01.354 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-03-27T08:37:01.365 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-03-27T08:37:01.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-03-27T08:37:01.384 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-03-27T08:37:01.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-03-27T08:37:01.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-03-27T08:37:01.412 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-03-27T08:37:01.421 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-03-27T08:37:01.433 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-03-27T08:37:01.443 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-03-27T08:37:01.453 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-03-27T08:37:01.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-03-27T08:37:01.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-03-27T08:37:01.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-03-27T08:37:01.498 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-03-27T08:37:01.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-03-27T08:37:01.518 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-03-27T08:37:01.531 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-03-27T08:37:01.541 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-03-27T08:37:01.549 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-03-27T08:37:01.559 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-03-27T08:37:01.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-03-27T08:37:01.579 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-03-27T08:37:01.590 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-03-27T08:37:01.599 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-03-27T08:37:01.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-03-27T08:37:01.617 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-03-27T08:37:01.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-03-27T08:37:01.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-03-27T08:37:01.645 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-03-27T08:37:01.661 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-03-27T08:37:01.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-03-27T08:37:01.682 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-03-27T08:37:01.696 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-03-27T08:37:01.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-03-27T08:37:01.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-03-27T08:37:01.725 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-03-27T08:37:01.734 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-03-27T08:37:01.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-03-27T08:37:01.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:01 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:37:01.755 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-03-27T08:37:01.766 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-03-27T08:37:01.774 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-03-27T08:37:01.786 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-03-27T08:37:01.795 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-03-27T08:37:01.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-03-27T08:37:01.815 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-03-27T08:37:01.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:01 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:37:01.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:01 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:37:01.824 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-03-27T08:37:01.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-03-27T08:37:01.842 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-03-27T08:37:01.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-03-27T08:37:01.861 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-03-27T08:37:01.875 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-03-27T08:37:01.886 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-03-27T08:37:01.899 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-03-27T08:37:01.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-03-27T08:37:01.918 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-03-27T08:37:01.927 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-03-27T08:37:01.937 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-03-27T08:37:01.946 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-03-27T08:37:01.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-03-27T08:37:01.965 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-03-27T08:37:01.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-03-27T08:37:01.984 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-03-27T08:37:01.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-03-27T08:37:02.003 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-03-27T08:37:02.012 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-03-27T08:37:02.021 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-03-27T08:37:02.031 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-03-27T08:37:02.041 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-03-27T08:37:02.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-03-27T08:37:02.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-03-27T08:37:02.066 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-03-27T08:37:02.074 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-03-27T08:37:02.084 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-03-27T08:37:02.094 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-03-27T08:37:02.105 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-03-27T08:37:02.114 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-03-27T08:37:02.126 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-03-27T08:37:02.135 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-03-27T08:37:02.145 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-03-27T08:37:02.154 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-03-27T08:37:02.164 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-03-27T08:37:02.174 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-03-27T08:37:02.182 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-03-27T08:37:02.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-03-27T08:37:02.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-03-27T08:37:02.222 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-03-27T08:37:02.235 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-03-27T08:37:02.247 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-03-27T08:37:02.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-03-27T08:37:02.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-03-27T08:37:02.298 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-03-27T08:37:02.313 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-03-27T08:37:02.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-03-27T08:37:02.339 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-03-27T08:37:02.351 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-03-27T08:37:02.363 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-03-27T08:37:02.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-03-27T08:37:02.385 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-03-27T08:37:02.395 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-03-27T08:37:02.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-03-27T08:37:02.416 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-03-27T08:37:02.426 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-03-27T08:37:02.435 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-03-27T08:37:02.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-03-27T08:37:02.457 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-03-27T08:37:02.467 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-03-27T08:37:02.477 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-03-27T08:37:02.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-03-27T08:37:02.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-03-27T08:37:02.505 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-03-27T08:37:02.515 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-03-27T08:37:02.524 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-03-27T08:37:02.534 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-03-27T08:37:02.543 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-03-27T08:37:02.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-03-27T08:37:02.560 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-03-27T08:37:02.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-03-27T08:37:02.579 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-03-27T08:37:02.588 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-03-27T08:37:02.600 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-03-27T08:37:02.612 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-03-27T08:37:02.621 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-03-27T08:37:02.629 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-03-27T08:37:02.639 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-03-27T08:37:02.648 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-03-27T08:37:02.656 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-03-27T08:37:02.665 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-03-27T08:37:02.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-03-27T08:37:02.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-03-27T08:37:02.692 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-03-27T08:37:02.703 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-03-27T08:37:02.713 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-03-27T08:37:02.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-03-27T08:37:02.734 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-03-27T08:37:02.744 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-03-27T08:37:02.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-03-27T08:37:02.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:02 smithi164 ceph-mon[31788]: pgmap v492: 97 pgs: 97 active+clean; 71 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 18 op/s 2024-03-27T08:37:02.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-03-27T08:37:02.774 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-03-27T08:37:02.784 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-03-27T08:37:02.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-03-27T08:37:02.808 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-03-27T08:37:02.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:02 smithi167 ceph-mon[34903]: pgmap v492: 97 pgs: 97 active+clean; 71 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 18 op/s 2024-03-27T08:37:02.819 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-03-27T08:37:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:02 smithi173 ceph-mon[35397]: pgmap v492: 97 pgs: 97 active+clean; 71 MiB data, 564 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 5.6 MiB/s wr, 18 op/s 2024-03-27T08:37:02.828 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-03-27T08:37:02.838 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-03-27T08:37:02.849 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-03-27T08:37:03.019 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-03-27T08:37:03.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-03-27T08:37:03.043 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-03-27T08:37:03.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-03-27T08:37:03.061 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-03-27T08:37:03.072 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-03-27T08:37:03.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-03-27T08:37:03.090 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-03-27T08:37:03.100 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-03-27T08:37:03.111 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-03-27T08:37:03.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-03-27T08:37:03.131 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-03-27T08:37:03.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-03-27T08:37:03.150 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-03-27T08:37:03.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-03-27T08:37:03.175 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-03-27T08:37:03.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-03-27T08:37:03.195 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-03-27T08:37:03.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-03-27T08:37:03.221 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-03-27T08:37:03.230 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-03-27T08:37:03.238 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-03-27T08:37:03.248 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-03-27T08:37:03.257 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-03-27T08:37:03.270 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-03-27T08:37:03.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-03-27T08:37:03.290 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-03-27T08:37:03.296 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-03-27T08:37:03.308 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-03-27T08:37:03.319 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-03-27T08:37:03.327 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-03-27T08:37:03.359 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-03-27T08:37:03.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-03-27T08:37:03.382 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-03-27T08:37:03.391 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/ 2024-03-27T08:37:03.399 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-03-27T08:37:03.406 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-03-27T08:37:03.416 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-03-27T08:37:03.424 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-03-27T08:37:03.431 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-03-27T08:37:03.441 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-03-27T08:37:03.448 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-03-27T08:37:03.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-03-27T08:37:03.463 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-03-27T08:37:03.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/EDID/hex 2024-03-27T08:37:03.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/HOWTO 2024-03-27T08:37:03.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-03-27T08:37:03.503 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-03-27T08:37:03.511 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-03-27T08:37:03.520 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-03-27T08:37:03.527 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-03-27T08:37:03.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/Makefile 2024-03-27T08:37:03.540 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-03-27T08:37:03.549 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/ 2024-03-27T08:37:03.553 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-03-27T08:37:03.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-03-27T08:37:03.572 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-03-27T08:37:03.581 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-03-27T08:37:03.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-03-27T08:37:03.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-03-27T08:37:03.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-03-27T08:37:03.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/ 2024-03-27T08:37:03.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-03-27T08:37:03.634 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-03-27T08:37:03.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-03-27T08:37:03.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-03-27T08:37:03.674 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-03-27T08:37:03.682 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-03-27T08:37:03.695 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-03-27T08:37:03.707 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-03-27T08:37:03.714 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-03-27T08:37:03.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-03-27T08:37:03.729 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-03-27T08:37:03.741 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-03-27T08:37:03.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-03-27T08:37:03.764 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-03-27T08:37:03.774 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-03-27T08:37:03.784 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-03-27T08:37:03.795 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-03-27T08:37:03.808 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-03-27T08:37:03.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SAK.txt 2024-03-27T08:37:03.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SM501.txt 2024-03-27T08:37:03.844 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-03-27T08:37:03.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-03-27T08:37:03.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-03-27T08:37:03.867 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-03-27T08:37:03.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-03-27T08:37:03.885 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/ 2024-03-27T08:37:03.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-03-27T08:37:03.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-03-27T08:37:03.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-03-27T08:37:03.983 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-03-27T08:37:03.991 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-03-27T08:37:04.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-03-27T08:37:04.010 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-03-27T08:37:04.018 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/ 2024-03-27T08:37:04.027 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-03-27T08:37:04.033 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-03-27T08:37:04.042 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-03-27T08:37:04.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-03-27T08:37:04.062 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-03-27T08:37:04.069 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-03-27T08:37:04.080 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-03-27T08:37:04.086 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-03-27T08:37:04.095 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-03-27T08:37:04.106 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-03-27T08:37:04.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-03-27T08:37:04.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-03-27T08:37:04.129 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-03-27T08:37:04.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/ 2024-03-27T08:37:04.144 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-03-27T08:37:04.153 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-03-27T08:37:04.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-03-27T08:37:04.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-03-27T08:37:04.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-03-27T08:37:04.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-03-27T08:37:04.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-03-27T08:37:04.204 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/ 2024-03-27T08:37:04.210 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-03-27T08:37:04.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-03-27T08:37:04.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-03-27T08:37:04.232 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Booting 2024-03-27T08:37:04.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-03-27T08:37:04.251 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-03-27T08:37:04.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-03-27T08:37:04.273 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-03-27T08:37:04.281 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-03-27T08:37:04.286 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-03-27T08:37:04.296 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-03-27T08:37:04.310 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-03-27T08:37:04.313 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-03-27T08:37:04.324 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-03-27T08:37:04.333 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Porting 2024-03-27T08:37:04.345 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/README 2024-03-27T08:37:04.354 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-03-27T08:37:04.361 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-03-27T08:37:04.372 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-03-27T08:37:04.384 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-03-27T08:37:04.396 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-03-27T08:37:04.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-03-27T08:37:04.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-03-27T08:37:04.422 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-03-27T08:37:04.431 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-03-27T08:37:04.441 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-03-27T08:37:04.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-03-27T08:37:04.458 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-03-27T08:37:04.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-03-27T08:37:04.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-03-27T08:37:04.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-03-27T08:37:04.494 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-03-27T08:37:04.503 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-03-27T08:37:04.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-03-27T08:37:04.520 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-03-27T08:37:04.528 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-03-27T08:37:04.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-03-27T08:37:04.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-03-27T08:37:04.554 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-03-27T08:37:04.563 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-03-27T08:37:04.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-03-27T08:37:04.580 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-03-27T08:37:04.589 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-03-27T08:37:04.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-03-27T08:37:04.606 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-03-27T08:37:04.613 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-03-27T08:37:04.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-03-27T08:37:04.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-03-27T08:37:04.640 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-03-27T08:37:04.650 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-03-27T08:37:04.661 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-03-27T08:37:04.673 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-03-27T08:37:04.683 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-03-27T08:37:04.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-03-27T08:37:04.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-03-27T08:37:04.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-03-27T08:37:04.718 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-03-27T08:37:04.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-03-27T08:37:04.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-03-27T08:37:04.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/Setup 2024-03-27T08:37:04.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:04 smithi164 ceph-mon[31788]: pgmap v493: 97 pgs: 97 active+clean; 81 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-03-27T08:37:04.756 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-03-27T08:37:04.761 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-03-27T08:37:04.770 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-03-27T08:37:04.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-03-27T08:37:04.791 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-03-27T08:37:04.802 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-03-27T08:37:04.814 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-03-27T08:37:04.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:04 smithi167 ceph-mon[34903]: pgmap v493: 97 pgs: 97 active+clean; 81 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-03-27T08:37:04.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-03-27T08:37:04.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:04 smithi173 ceph-mon[35397]: pgmap v493: 97 pgs: 97 active+clean; 81 MiB data, 581 MiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.1 MiB/s wr, 34 op/s 2024-03-27T08:37:04.829 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-03-27T08:37:04.835 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-03-27T08:37:04.844 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-03-27T08:37:04.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-03-27T08:37:04.861 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-03-27T08:37:04.868 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-03-27T08:37:04.879 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-03-27T08:37:04.887 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-03-27T08:37:04.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-03-27T08:37:04.918 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-03-27T08:37:04.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-03-27T08:37:05.003 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-03-27T08:37:05.010 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-03-27T08:37:05.018 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-03-27T08:37:05.026 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-03-27T08:37:05.034 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-03-27T08:37:05.042 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-03-27T08:37:05.052 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-03-27T08:37:05.061 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-03-27T08:37:05.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-03-27T08:37:05.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-03-27T08:37:05.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-03-27T08:37:05.096 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm64/ 2024-03-27T08:37:05.108 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-03-27T08:37:05.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-03-27T08:37:05.126 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-03-27T08:37:05.134 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-03-27T08:37:05.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-03-27T08:37:05.152 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-03-27T08:37:05.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-03-27T08:37:05.167 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-03-27T08:37:05.175 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-03-27T08:37:05.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-03-27T08:37:05.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-03-27T08:37:05.200 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-03-27T08:37:05.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/backlight/ 2024-03-27T08:37:05.215 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-03-27T08:37:05.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-03-27T08:37:05.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-03-27T08:37:05.242 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bcache.txt 2024-03-27T08:37:05.253 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-03-27T08:37:05.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/ 2024-03-27T08:37:05.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-03-27T08:37:05.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-03-27T08:37:05.283 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-03-27T08:37:05.292 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-03-27T08:37:05.301 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-03-27T08:37:05.311 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/ 2024-03-27T08:37:05.320 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-03-27T08:37:05.330 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-03-27T08:37:05.343 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-03-27T08:37:05.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-03-27T08:37:05.360 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-03-27T08:37:05.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-03-27T08:37:05.380 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-03-27T08:37:05.390 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-03-27T08:37:05.397 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-03-27T08:37:05.406 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-03-27T08:37:05.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-03-27T08:37:05.421 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/request.txt 2024-03-27T08:37:05.428 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-03-27T08:37:05.434 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-03-27T08:37:05.443 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-03-27T08:37:05.451 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/ 2024-03-27T08:37:05.460 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-03-27T08:37:05.467 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-03-27T08:37:05.478 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-03-27T08:37:05.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-03-27T08:37:05.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-03-27T08:37:05.503 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-03-27T08:37:05.514 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-03-27T08:37:05.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-03-27T08:37:05.538 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-03-27T08:37:05.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-03-27T08:37:05.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-03-27T08:37:05.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-03-27T08:37:05.576 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-03-27T08:37:05.584 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-03-27T08:37:05.594 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-03-27T08:37:05.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-03-27T08:37:05.609 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-03-27T08:37:05.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-03-27T08:37:05.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-03-27T08:37:05.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-03-27T08:37:05.644 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-03-27T08:37:05.651 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-03-27T08:37:05.660 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-03-27T08:37:05.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-03-27T08:37:05.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-03-27T08:37:05.686 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-03-27T08:37:05.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/ 2024-03-27T08:37:05.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-03-27T08:37:05.708 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-03-27T08:37:05.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-03-27T08:37:05.723 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 -- 172.21.15.164:0/1945504636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100bf0 msgr2=0x7f3d54101050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 --2- 172.21.15.164:0/1945504636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100bf0 0x7f3d54101050 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3d40009900 tx=0x7f3d4002bcc0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 -- 172.21.15.164:0/1945504636 shutdown_connections 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 --2- 172.21.15.164:0/1945504636 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54101590 0x7f3d54101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 --2- 172.21.15.164:0/1945504636 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100bf0 0x7f3d54101050 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 --2- 172.21.15.164:0/1945504636 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54100290 0x7f3d541006b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.731+0000 7f3d53e00640 1 -- 172.21.15.164:0/1945504636 >> 172.21.15.164:0/1945504636 conn(0x7f3d540fbe30 msgr2=0x7f3d540fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.732+0000 7f3d53e00640 1 -- 172.21.15.164:0/1945504636 shutdown_connections 2024-03-27T08:37:05.724 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.732+0000 7f3d53e00640 1 -- 172.21.15.164:0/1945504636 wait complete. 2024-03-27T08:37:05.726 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 Processor -- start 2024-03-27T08:37:05.726 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 -- start start 2024-03-27T08:37:05.726 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54100bf0 0x7f3d5419a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54101590 0x7f3d541a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410f850 con 0x7f3d54101590 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410f6d0 con 0x7f3d54100290 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.733+0000 7f3d53e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5410f9d0 con 0x7f3d54100bf0 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:50258/0 (socket says 172.21.15.164:50258) 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 -- 172.21.15.164:0/2760587879 learned_addr learned my addr 172.21.15.164:0/2760587879 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d53400640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54101590 0x7f3d541a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52000640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54100bf0 0x7f3d5419a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 -- 172.21.15.164:0/2760587879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54100bf0 msgr2=0x7f3d5419a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54100bf0 0x7f3d5419a3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.727 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 -- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54101590 msgr2=0x7f3d541a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54101590 0x7f3d541a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.728 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 -- 172.21.15.164:0/2760587879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d541a1a90 con 0x7f3d54100290 2024-03-27T08:37:05.728 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.734+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400ea60 tx=0x7f3d4400ef20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.735+0000 7f3d4b400640 1 -- 172.21.15.164:0/2760587879 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4400cde0 con 0x7f3d54100290 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.735+0000 7f3d4b400640 1 -- 172.21.15.164:0/2760587879 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d440035f0 con 0x7f3d54100290 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.735+0000 7f3d4b400640 1 -- 172.21.15.164:0/2760587879 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d44010690 con 0x7f3d54100290 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.735+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d541a1d80 con 0x7f3d54100290 2024-03-27T08:37:05.729 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.735+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d541a2190 con 0x7f3d54100290 2024-03-27T08:37:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d4b400640 1 -- 172.21.15.164:0/2760587879 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3d440037a0 con 0x7f3d54100290 2024-03-27T08:37:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 Processor -- start 2024-03-27T08:37:05.730 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 -- start start 2024-03-27T08:37:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.732 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638366fab50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563836657d10 con 0x5638366f2b60 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563836600260 con 0x5638366f3550 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.739+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563836653cc0 con 0x5638366f86c0 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36550/0 (socket says 172.21.15.164:36550) 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 -- 172.21.15.164:0/2937270087 learned_addr learned my addr 172.21.15.164:0/2937270087 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d52000640 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638366fab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 -- 172.21.15.164:0/2937270087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 msgr2=0x5638366fab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638366fab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 -- 172.21.15.164:0/2937270087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 msgr2=0x5638366f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.733 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 -- 172.21.15.164:0/2937270087 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638365f7aa0 con 0x5638366f2b60 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d4b400640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 0x7f3d380a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.740+0000 7f3d53400640 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c010370 tx=0x7f3d4c010830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee05f2e5d910253 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.741+0000 7f3d4b400640 1 -- 172.21.15.164:0/2760587879 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3d440d0100 con 0x7f3d54100290 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.741+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 0x7f3d380a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.741+0000 7f3d3fe00640 1 -- 172.21.15.164:0/2937270087 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c016070 con 0x5638366f2b60 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.741+0000 7f3d3fe00640 1 -- 172.21.15.164:0/2937270087 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d4c004d20 con 0x5638366f2b60 2024-03-27T08:37:05.734 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.741+0000 7f3d3fe00640 1 -- 172.21.15.164:0/2937270087 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c005420 con 0x5638366f2b60 2024-03-27T08:37:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2937270087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 msgr2=0x5638366f2f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c010370 tx=0x7f3d4c010830 comp rx=0 tx=0).stop 2024-03-27T08:37:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d52a00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 0x7f3d380a5ac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d440989e0 tx=0x7f3d440d3b40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.735 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2937270087 shutdown_connections 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638366fab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2937270087 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x5638366f2f80 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2937270087 >> 172.21.15.164:0/2937270087 conn(0x5638366ee0d0 msgr2=0x5638366ee4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2937270087 shutdown_connections 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.742+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2937270087 wait complete. 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.743+0000 7f3d5c46b740 1 -- start start 2024-03-27T08:37:05.736 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.743+0000 7f3d5c46b740 1 Processor -- start 2024-03-27T08:37:05.736 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.743+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366fce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.743+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x5638367043c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5638366fb670 con 0x5638366f86c0 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563836613630 con 0x5638366f3550 2024-03-27T08:37:05.742 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5638366fb7f0 con 0x5638366f2b60 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d5c46b740 10 client.0 _ll_register_callbacks cb 0x563836618c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d52000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x5638367043c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d52000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:50274/0 (socket says 172.21.15.164:50274) 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d52000640 1 -- 172.21.15.164:0/2469197611 learned_addr learned my addr 172.21.15.164:0/2469197611 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.744+0000 7f3d53400640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366fce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 -- 172.21.15.164:0/2469197611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 msgr2=0x5638366fce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366fce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 -- 172.21.15.164:0/2469197611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 msgr2=0x5638367043c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x5638367043c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 -- 172.21.15.164:0/2469197611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383661f5f0 con 0x5638366f3550 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d53400640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x5638367043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:05.743 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d52000640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d4002c2d0 tx=0x7f3d4002cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59fe7e34be26fd3b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.745+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d40042070 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3d40005230 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d4c004d20 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d4004e050 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d5c46b740 10 client.35585 fetch_fsmap learned FSMap version 24 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56383636c210 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.746+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d4c004d20 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3d400035f0 con 0x5638366f3550 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 10 client.35585 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 10 client.35585 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 20 client.35585 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:05.744 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563836708cb0 0x56383670b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 4 client.35585 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563836665250 con 0x563836708cb0 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.747+0000 7f3d53400640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563836708cb0 0x56383670b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.748+0000 7f3d53400640 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563836708cb0 0x56383670b0c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7b9678d5b97cefd server_cookie=6a6dd7e8f93e59c4 in_seq=0 out_seq=0 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.748+0000 7f3d3cc00640 10 client.35585 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d3cc00640 1 -- 172.21.15.164:0/2469197611 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563836665250 con 0x563836708cb0 2024-03-27T08:37:05.745 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d3cc00640 10 client.35585 handle_command_reply: tid=0 2024-03-27T08:37:05.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/ 2024-03-27T08:37:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 client.35585 shutdown 2024-03-27T08:37:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 msgr2=0x5638366fd380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f3d4002c2d0 tx=0x7f3d4002cbe0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.746 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 shutdown_connections 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563836708cb0 0x56383670b0c0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x5638367043c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366fd380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/2469197611 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 >> 172.21.15.164:0/2469197611 conn(0x5638366ee0d0 msgr2=0x5638366ed310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d3cc00640 0 client.35585 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 shutdown_connections 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 1 -- 172.21.15.164:0/2469197611 wait complete. 2024-03-27T08:37:05.747 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.751+0000 7f3d5c46b740 20 client.35585 trim_cache size 0 max 16384 2024-03-27T08:37:05.747 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-03-27T08:37:05.749 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-03-27T08:37:05.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-03-27T08:37:05.760 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.770+0000 7f3d5c46b740 1 Processor -- start 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.770+0000 7f3d5c46b740 1 -- start start 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366f4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541ad8c0 con 0x5638366f86c0 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541ab190 con 0x5638366f3550 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a8fe0 con 0x5638366f2b60 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d52000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36560/0 (socket says 172.21.15.164:36560) 2024-03-27T08:37:05.763 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 -- 172.21.15.164:0/4008939875 learned_addr learned my addr 172.21.15.164:0/4008939875 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 -- 172.21.15.164:0/4008939875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 msgr2=0x5638366f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366f4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 -- 172.21.15.164:0/4008939875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 msgr2=0x5638366f4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.764 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.771+0000 7f3d53400640 1 -- 172.21.15.164:0/4008939875 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563836438620 con 0x5638366f86c0 2024-03-27T08:37:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.772+0000 7f3d53400640 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c010d30 tx=0x7f3d4c009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9929ed49ba8dde0b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.772+0000 7f3d3f400640 1 -- 172.21.15.164:0/4008939875 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c016040 con 0x5638366f86c0 2024-03-27T08:37:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.772+0000 7f3d3f400640 1 -- 172.21.15.164:0/4008939875 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d4c02d580 con 0x5638366f86c0 2024-03-27T08:37:05.765 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.772+0000 7f3d3f400640 1 -- 172.21.15.164:0/4008939875 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c012da0 con 0x5638366f86c0 2024-03-27T08:37:05.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 -- 172.21.15.164:0/4008939875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 msgr2=0x563836704380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c010d30 tx=0x7f3d4c009600 comp rx=0 tx=0).stop 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 -- 172.21.15.164:0/4008939875 shutdown_connections 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f86c0 0x563836704380 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638366f4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.767 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/4008939875 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f2b60 0x5638366f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 -- 172.21.15.164:0/4008939875 >> 172.21.15.164:0/4008939875 conn(0x5638366ee0d0 msgr2=0x5638366ee4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 -- 172.21.15.164:0/4008939875 shutdown_connections 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.773+0000 7f3d5c46b740 1 -- 172.21.15.164:0/4008939875 wait complete. 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 -- start start 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 Processor -- start 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638367025a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638367035b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a9650 con 0x5638366f2b60 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541aaac0 con 0x5638366f3550 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3d541a9d20 con 0x5638366f86c0 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.774+0000 7f3d5c46b740 10 client.0 _ll_register_callbacks cb 0x7f3d44005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:05.768 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:36576/0 (socket says 172.21.15.164:36576) 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 -- 172.21.15.164:0/3432178571 learned_addr learned my addr 172.21.15.164:0/3432178571 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d52000640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638367025a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 -- 172.21.15.164:0/3432178571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 msgr2=0x5638367035b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638367035b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 -- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 msgr2=0x5638367025a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638367025a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 -- 172.21.15.164:0/3432178571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563836703ba0 con 0x5638366f2b60 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d53400640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004c30 tx=0x7f3d4c02d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aa23be5d78cb184 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.775+0000 7f3d3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c016070 con 0x5638366f2b60 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d4c02d580 con 0x5638366f2b60 2024-03-27T08:37:05.769 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3d4c0126d0 con 0x5638366f2b60 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f3d4c012b20 con 0x5638366f2b60 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d5c46b740 10 client.15912 fetch_fsmap learned FSMap version 24 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x56383676f500 con 0x5638366f2b60 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.776+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d4c02d580 con 0x5638366f2b60 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 24) ==== 8338+0+0 (secure 0 0 0) 0x7f3d4c00f040 con 0x5638366f2b60 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 10 client.15912 fetch_fsmap finished waiting for FSMap version 24 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 10 client.15912 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 20 client.15912 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56383676fc90 0x5638367720b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 4 client.15912 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56383665f5a0 con 0x56383676fc90 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.777+0000 7f3d52000640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56383676fc90 0x5638367720b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:05.771 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.778+0000 7f3d52000640 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56383676fc90 0x5638367720b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c1e188be74517bd server_cookie=7df1db4fab251e8f in_seq=0 out_seq=0 2024-03-27T08:37:05.772 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:05.778+0000 7f3d3cc00640 10 client.15912 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:05.772 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-03-27T08:37:05.773 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-03-27T08:37:05.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-03-27T08:37:05.781 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-03-27T08:37:05.785 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-03-27T08:37:05.791 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-03-27T08:37:05.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-03-27T08:37:05.802 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-03-27T08:37:05.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-03-27T08:37:05.815 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/clk.txt 2024-03-27T08:37:05.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-03-27T08:37:05.826 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/ 2024-03-27T08:37:05.830 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-03-27T08:37:05.835 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-03-27T08:37:05.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-03-27T08:37:05.847 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-03-27T08:37:05.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-03-27T08:37:05.858 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/console/ 2024-03-27T08:37:05.864 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/console/console.txt 2024-03-27T08:37:05.871 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-03-27T08:37:05.877 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-03-27T08:37:05.885 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-03-27T08:37:05.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-03-27T08:37:05.899 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-03-27T08:37:05.907 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-03-27T08:37:05.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-03-27T08:37:06.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-03-27T08:37:06.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-03-27T08:37:06.069 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-03-27T08:37:06.077 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-03-27T08:37:06.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-03-27T08:37:06.097 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-03-27T08:37:06.107 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-03-27T08:37:06.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-03-27T08:37:06.125 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-03-27T08:37:06.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-03-27T08:37:06.143 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-03-27T08:37:06.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-03-27T08:37:06.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-03-27T08:37:06.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crc32.txt 2024-03-27T08:37:06.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cris/ 2024-03-27T08:37:06.183 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/cris/README 2024-03-27T08:37:06.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/ 2024-03-27T08:37:06.199 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-03-27T08:37:06.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-03-27T08:37:06.216 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-03-27T08:37:06.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-03-27T08:37:06.233 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-03-27T08:37:06.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-03-27T08:37:06.253 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-03-27T08:37:06.260 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-03-27T08:37:06.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-03-27T08:37:06.275 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/ 2024-03-27T08:37:06.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-03-27T08:37:06.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-03-27T08:37:06.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-03-27T08:37:06.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-03-27T08:37:06.320 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-03-27T08:37:06.328 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-03-27T08:37:06.338 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-03-27T08:37:06.346 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-03-27T08:37:06.355 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-03-27T08:37:06.624 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-03-27T08:37:06.628 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-03-27T08:37:06.633 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-03-27T08:37:06.638 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-03-27T08:37:06.641 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-03-27T08:37:06.659 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.672+0000 7f3d3cc00640 1 -- 172.21.15.164:0/3432178571 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56383665f5a0 con 0x56383676fc90 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.672+0000 7f3d3cc00640 10 client.15912 handle_command_reply: tid=0 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.672+0000 7f3d5c46b740 1 client.15912 shutdown 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 msgr2=0x563836702060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c004c30 tx=0x7f3d4c02d890 comp rx=0 tx=0).stop 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 shutdown_connections 2024-03-27T08:37:06.665 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56383676fc90 0x5638367720b0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5638366f86c0 0x5638367035b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638366f3550 0x5638367025a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 --2- 172.21.15.164:0/3432178571 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5638366f2b60 0x563836702060 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 >> 172.21.15.164:0/3432178571 conn(0x5638366ee0d0 msgr2=0x5638366fcde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d3cc00640 0 client.15912 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 shutdown_connections 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 1 -- 172.21.15.164:0/3432178571 wait complete. 2024-03-27T08:37:06.666 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.673+0000 7f3d5c46b740 20 client.15912 trim_cache size 0 max 16384 2024-03-27T08:37:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:37:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:37:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:37:06.667 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:37:06.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-03-27T08:37:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.674+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 msgr2=0x7f3d380a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.674+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 0x7f3d380a5ac0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3d440989e0 tx=0x7f3d440d3b40 comp rx=0 tx=0).stop 2024-03-27T08:37:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.674+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 msgr2=0x7f3d54199e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:06.668 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.674+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3d4400ea60 tx=0x7f3d4400ef20 comp rx=0 tx=0).stop 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 shutdown_connections 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3d380a3600 0x7f3d380a5ac0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3d54101590 0x7f3d541a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3d54100bf0 0x7f3d5419a3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 --2- 172.21.15.164:0/2760587879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d54100290 0x7f3d54199e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 >> 172.21.15.164:0/2760587879 conn(0x7f3d540fbe30 msgr2=0x7f3d540fd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 shutdown_connections 2024-03-27T08:37:06.669 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:06.675+0000 7f3d53e00640 1 -- 172.21.15.164:0/2760587879 wait complete. 2024-03-27T08:37:06.672 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-03-27T08:37:06.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-03-27T08:37:06.680 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-03-27T08:37:06.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-03-27T08:37:06.692 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-03-27T08:37:06.696 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-03-27T08:37:06.702 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-03-27T08:37:06.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-03-27T08:37:06.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-03-27T08:37:06.718 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-03-27T08:37:06.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-03-27T08:37:06.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-03-27T08:37:06.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-03-27T08:37:06.738 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-03-27T08:37:06.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-03-27T08:37:06.748 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devices.txt 2024-03-27T08:37:06.753 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:06 smithi164 ceph-mon[31788]: pgmap v494: 97 pgs: 97 active+clean; 83 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 51 op/s 2024-03-27T08:37:06.771 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/ 2024-03-27T08:37:06.776 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-03-27T08:37:06.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-03-27T08:37:06.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-03-27T08:37:06.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-03-27T08:37:06.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-03-27T08:37:06.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-03-27T08:37:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:06 smithi167 ceph-mon[34903]: pgmap v494: 97 pgs: 97 active+clean; 83 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 51 op/s 2024-03-27T08:37:06.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-03-27T08:37:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:06 smithi173 ceph-mon[35397]: pgmap v494: 97 pgs: 97 active+clean; 83 MiB data, 611 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.2 MiB/s wr, 51 op/s 2024-03-27T08:37:06.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-03-27T08:37:06.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-03-27T08:37:06.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-03-27T08:37:06.850 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-03-27T08:37:06.859 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-03-27T08:37:06.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-03-27T08:37:06.884 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-03-27T08:37:06.895 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-03-27T08:37:06.906 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-03-27T08:37:06.918 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-03-27T08:37:06.929 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-03-27T08:37:07.027 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-03-27T08:37:07.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-03-27T08:37:07.047 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-03-27T08:37:07.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-03-27T08:37:07.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-03-27T08:37:07.074 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-03-27T08:37:07.082 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-03-27T08:37:07.090 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-03-27T08:37:07.098 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-03-27T08:37:07.107 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-03-27T08:37:07.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-03-27T08:37:07.125 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-03-27T08:37:07.134 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-03-27T08:37:07.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-03-27T08:37:07.150 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-03-27T08:37:07.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-03-27T08:37:07.171 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-03-27T08:37:07.183 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-03-27T08:37:07.193 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-03-27T08:37:07.202 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-03-27T08:37:07.212 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-03-27T08:37:07.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-03-27T08:37:07.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-03-27T08:37:07.237 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-03-27T08:37:07.246 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-03-27T08:37:07.259 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-03-27T08:37:07.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-03-27T08:37:07.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-03-27T08:37:07.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-03-27T08:37:07.299 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-03-27T08:37:07.307 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-03-27T08:37:07.317 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-03-27T08:37:07.329 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-03-27T08:37:07.337 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-03-27T08:37:07.344 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-03-27T08:37:07.355 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-03-27T08:37:07.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-03-27T08:37:07.380 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-03-27T08:37:07.392 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-03-27T08:37:07.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-03-27T08:37:07.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-03-27T08:37:07.429 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-03-27T08:37:07.443 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-03-27T08:37:07.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-03-27T08:37:07.463 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-03-27T08:37:07.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-03-27T08:37:07.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-03-27T08:37:07.492 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-03-27T08:37:07.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-03-27T08:37:07.510 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-03-27T08:37:07.529 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-03-27T08:37:07.539 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-03-27T08:37:07.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-03-27T08:37:07.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-03-27T08:37:07.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-03-27T08:37:07.584 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-03-27T08:37:07.596 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-03-27T08:37:07.604 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-03-27T08:37:07.613 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-03-27T08:37:07.622 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-03-27T08:37:07.631 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-03-27T08:37:07.640 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-03-27T08:37:07.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-03-27T08:37:07.656 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-03-27T08:37:07.668 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-03-27T08:37:07.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-03-27T08:37:07.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-03-27T08:37:07.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-03-27T08:37:07.703 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-03-27T08:37:07.712 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-03-27T08:37:07.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-03-27T08:37:07.733 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-03-27T08:37:07.742 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-03-27T08:37:07.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-03-27T08:37:07.761 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-03-27T08:37:07.771 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-03-27T08:37:07.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-03-27T08:37:07.790 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-03-27T08:37:07.798 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-03-27T08:37:07.806 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-03-27T08:37:07.816 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-03-27T08:37:07.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:07 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:07.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:07 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:07.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-03-27T08:37:07.837 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-03-27T08:37:07.845 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-03-27T08:37:07.858 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-03-27T08:37:07.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-03-27T08:37:07.876 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-03-27T08:37:07.886 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-03-27T08:37:07.895 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-03-27T08:37:07.906 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-03-27T08:37:07.914 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-03-27T08:37:07.931 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-03-27T08:37:07.941 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-03-27T08:37:08.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:07 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:08.007 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-03-27T08:37:08.015 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-03-27T08:37:08.023 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-03-27T08:37:08.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-03-27T08:37:08.039 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-03-27T08:37:08.048 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-03-27T08:37:08.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-03-27T08:37:08.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-03-27T08:37:08.082 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-03-27T08:37:08.090 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-03-27T08:37:08.099 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-03-27T08:37:08.108 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-03-27T08:37:08.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-03-27T08:37:08.127 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-03-27T08:37:08.137 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-03-27T08:37:08.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-03-27T08:37:08.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-03-27T08:37:08.169 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-03-27T08:37:08.179 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-03-27T08:37:08.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-03-27T08:37:08.197 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-03-27T08:37:08.209 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-03-27T08:37:08.226 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-03-27T08:37:08.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-03-27T08:37:08.245 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-03-27T08:37:08.257 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-03-27T08:37:08.266 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-03-27T08:37:08.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-03-27T08:37:08.282 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-03-27T08:37:08.290 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-03-27T08:37:08.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-03-27T08:37:08.311 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-03-27T08:37:08.321 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-03-27T08:37:08.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-03-27T08:37:08.342 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-03-27T08:37:08.357 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-03-27T08:37:08.367 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-03-27T08:37:08.374 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-03-27T08:37:08.386 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-03-27T08:37:08.402 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-03-27T08:37:08.410 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-03-27T08:37:08.420 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-03-27T08:37:08.429 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-03-27T08:37:08.439 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-03-27T08:37:08.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-03-27T08:37:08.461 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-03-27T08:37:08.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-03-27T08:37:08.483 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-03-27T08:37:08.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-03-27T08:37:08.502 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-03-27T08:37:08.516 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-03-27T08:37:08.524 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-03-27T08:37:08.534 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-03-27T08:37:08.543 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-03-27T08:37:08.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-03-27T08:37:08.560 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-03-27T08:37:08.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-03-27T08:37:08.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-03-27T08:37:08.587 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-03-27T08:37:08.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-03-27T08:37:08.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-03-27T08:37:08.617 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-03-27T08:37:08.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-03-27T08:37:08.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-03-27T08:37:08.645 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-03-27T08:37:08.656 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-03-27T08:37:08.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-03-27T08:37:08.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-03-27T08:37:08.690 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-03-27T08:37:08.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-03-27T08:37:08.707 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-03-27T08:37:08.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-03-27T08:37:08.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-03-27T08:37:08.735 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-03-27T08:37:08.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-03-27T08:37:08.756 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-03-27T08:37:08.766 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-03-27T08:37:08.775 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-03-27T08:37:08.785 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-03-27T08:37:08.793 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-03-27T08:37:08.802 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-03-27T08:37:08.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-03-27T08:37:08.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:08 smithi167 ceph-mon[34903]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.8 MiB/s wr, 77 op/s 2024-03-27T08:37:08.822 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-03-27T08:37:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:08 smithi173 ceph-mon[35397]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.8 MiB/s wr, 77 op/s 2024-03-27T08:37:08.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-03-27T08:37:08.842 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-03-27T08:37:08.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-03-27T08:37:08.862 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-03-27T08:37:08.872 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-03-27T08:37:08.884 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-03-27T08:37:08.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-03-27T08:37:08.904 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-03-27T08:37:08.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-03-27T08:37:08.927 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-03-27T08:37:08.936 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-03-27T08:37:08.947 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-03-27T08:37:08.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-03-27T08:37:09.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:08 smithi164 ceph-mon[31788]: pgmap v495: 97 pgs: 97 active+clean; 86 MiB data, 618 MiB used, 1.0 TiB / 1.0 TiB avail; 190 KiB/s rd, 4.8 MiB/s wr, 77 op/s 2024-03-27T08:37:09.057 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-03-27T08:37:09.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-03-27T08:37:09.074 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-03-27T08:37:09.082 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-03-27T08:37:09.092 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-03-27T08:37:09.101 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-03-27T08:37:09.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-03-27T08:37:09.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-03-27T08:37:09.130 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-03-27T08:37:09.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-03-27T08:37:09.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-03-27T08:37:09.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-03-27T08:37:09.165 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-03-27T08:37:09.173 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-03-27T08:37:09.182 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-03-27T08:37:09.191 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-03-27T08:37:09.199 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-03-27T08:37:09.210 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-03-27T08:37:09.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-03-27T08:37:09.229 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-03-27T08:37:09.239 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-03-27T08:37:09.249 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-03-27T08:37:09.258 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-03-27T08:37:09.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-03-27T08:37:09.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-03-27T08:37:09.287 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-03-27T08:37:09.297 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-03-27T08:37:09.305 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-03-27T08:37:09.315 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-03-27T08:37:09.324 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-03-27T08:37:09.334 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-03-27T08:37:09.345 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-03-27T08:37:09.354 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-03-27T08:37:09.365 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-03-27T08:37:09.377 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-03-27T08:37:09.386 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-03-27T08:37:09.395 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-03-27T08:37:09.405 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-03-27T08:37:09.415 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-03-27T08:37:09.424 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-03-27T08:37:09.433 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-03-27T08:37:09.442 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-03-27T08:37:09.451 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-03-27T08:37:09.461 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-03-27T08:37:09.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-03-27T08:37:09.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-03-27T08:37:09.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-03-27T08:37:09.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-03-27T08:37:09.507 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-03-27T08:37:09.517 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-03-27T08:37:09.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-03-27T08:37:09.535 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-03-27T08:37:09.544 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-03-27T08:37:09.553 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-03-27T08:37:09.562 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-03-27T08:37:09.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-03-27T08:37:09.581 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-03-27T08:37:09.592 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-03-27T08:37:09.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-03-27T08:37:09.610 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-03-27T08:37:09.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-03-27T08:37:09.629 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-03-27T08:37:09.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-03-27T08:37:09.645 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-03-27T08:37:09.654 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-03-27T08:37:09.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-03-27T08:37:09.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-03-27T08:37:09.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-03-27T08:37:09.689 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-03-27T08:37:09.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-03-27T08:37:09.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-03-27T08:37:09.720 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-03-27T08:37:09.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-03-27T08:37:09.740 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-03-27T08:37:09.749 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-03-27T08:37:09.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-03-27T08:37:09.769 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-03-27T08:37:09.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-03-27T08:37:09.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-03-27T08:37:09.800 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-03-27T08:37:09.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-03-27T08:37:09.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-03-27T08:37:09.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-03-27T08:37:09.845 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-03-27T08:37:09.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-03-27T08:37:09.863 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-03-27T08:37:09.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-03-27T08:37:09.880 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-03-27T08:37:09.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-03-27T08:37:09.900 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-03-27T08:37:09.910 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-03-27T08:37:09.920 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-03-27T08:37:09.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-03-27T08:37:09.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-03-27T08:37:09.949 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-03-27T08:37:09.959 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-03-27T08:37:09.978 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-03-27T08:37:10.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-03-27T08:37:10.066 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-03-27T08:37:10.080 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-03-27T08:37:10.090 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-03-27T08:37:10.100 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-03-27T08:37:10.109 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-03-27T08:37:10.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-03-27T08:37:10.129 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-03-27T08:37:10.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-03-27T08:37:10.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-03-27T08:37:10.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-03-27T08:37:10.167 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-03-27T08:37:10.176 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-03-27T08:37:10.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-03-27T08:37:10.195 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-03-27T08:37:10.203 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-03-27T08:37:10.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-03-27T08:37:10.221 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-03-27T08:37:10.231 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-03-27T08:37:10.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-03-27T08:37:10.249 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-03-27T08:37:10.259 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-03-27T08:37:10.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-03-27T08:37:10.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-03-27T08:37:10.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-03-27T08:37:10.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-03-27T08:37:10.303 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-03-27T08:37:10.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-03-27T08:37:10.319 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-03-27T08:37:10.448 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-03-27T08:37:10.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-03-27T08:37:10.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-03-27T08:37:10.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-03-27T08:37:10.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-03-27T08:37:10.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-03-27T08:37:10.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-03-27T08:37:10.463 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-03-27T08:37:10.474 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-03-27T08:37:10.483 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-03-27T08:37:10.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-03-27T08:37:10.502 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-03-27T08:37:10.510 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-03-27T08:37:10.522 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-03-27T08:37:10.531 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-03-27T08:37:10.540 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-03-27T08:37:10.549 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-03-27T08:37:10.556 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-03-27T08:37:10.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-03-27T08:37:10.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-03-27T08:37:10.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-03-27T08:37:10.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-03-27T08:37:10.599 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-03-27T08:37:10.614 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-03-27T08:37:10.622 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-03-27T08:37:10.635 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-03-27T08:37:10.641 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-03-27T08:37:10.651 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-03-27T08:37:10.661 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-03-27T08:37:10.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-03-27T08:37:10.681 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-03-27T08:37:10.693 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-03-27T08:37:10.704 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-03-27T08:37:10.714 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-03-27T08:37:10.725 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-03-27T08:37:10.736 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-03-27T08:37:10.748 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-03-27T08:37:10.757 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-03-27T08:37:10.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-03-27T08:37:10.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-03-27T08:37:10.788 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-03-27T08:37:10.798 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-03-27T08:37:10.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-03-27T08:37:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:10 smithi167 ceph-mon[34903]: pgmap v496: 97 pgs: 97 active+clean; 87 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 4.3 MiB/s wr, 164 op/s 2024-03-27T08:37:10.819 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-03-27T08:37:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:10 smithi173 ceph-mon[35397]: pgmap v496: 97 pgs: 97 active+clean; 87 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 4.3 MiB/s wr, 164 op/s 2024-03-27T08:37:10.828 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-03-27T08:37:10.838 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-03-27T08:37:10.849 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-03-27T08:37:10.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-03-27T08:37:10.874 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-03-27T08:37:10.883 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-03-27T08:37:10.893 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-03-27T08:37:10.901 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-03-27T08:37:10.912 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-03-27T08:37:10.921 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-03-27T08:37:10.931 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-03-27T08:37:10.941 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-03-27T08:37:10.950 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-03-27T08:37:10.959 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-03-27T08:37:10.968 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-03-27T08:37:10.989 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-03-27T08:37:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:10 smithi164 ceph-mon[31788]: pgmap v496: 97 pgs: 97 active+clean; 87 MiB data, 630 MiB used, 1.0 TiB / 1.0 TiB avail; 193 KiB/s rd, 4.3 MiB/s wr, 164 op/s 2024-03-27T08:37:11.100 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-03-27T08:37:11.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-03-27T08:37:11.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-03-27T08:37:11.129 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-03-27T08:37:11.139 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-03-27T08:37:11.149 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-03-27T08:37:11.159 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-03-27T08:37:11.168 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-03-27T08:37:11.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-03-27T08:37:11.188 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-03-27T08:37:11.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-03-27T08:37:11.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-03-27T08:37:11.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-03-27T08:37:11.231 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-03-27T08:37:11.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-03-27T08:37:11.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-03-27T08:37:11.260 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-03-27T08:37:11.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-03-27T08:37:11.278 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-03-27T08:37:11.287 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-03-27T08:37:11.295 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-03-27T08:37:11.307 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-03-27T08:37:11.317 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-03-27T08:37:11.329 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-03-27T08:37:11.339 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-03-27T08:37:11.350 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-03-27T08:37:11.360 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-03-27T08:37:11.368 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-03-27T08:37:11.377 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-03-27T08:37:11.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-03-27T08:37:11.397 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-03-27T08:37:11.408 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-03-27T08:37:11.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-03-27T08:37:11.426 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-03-27T08:37:11.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-03-27T08:37:11.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-03-27T08:37:11.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-03-27T08:37:11.464 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-03-27T08:37:11.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-03-27T08:37:11.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-03-27T08:37:11.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-03-27T08:37:11.499 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-03-27T08:37:11.508 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-03-27T08:37:11.517 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-03-27T08:37:11.526 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-03-27T08:37:11.536 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-03-27T08:37:11.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-03-27T08:37:11.559 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-03-27T08:37:11.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-03-27T08:37:11.582 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-03-27T08:37:11.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-03-27T08:37:11.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-03-27T08:37:11.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-03-27T08:37:11.622 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-03-27T08:37:11.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-03-27T08:37:11.639 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-03-27T08:37:11.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-03-27T08:37:11.655 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-03-27T08:37:11.665 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-03-27T08:37:11.674 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-03-27T08:37:11.685 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-03-27T08:37:11.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-03-27T08:37:11.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-03-27T08:37:11.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-03-27T08:37:11.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-03-27T08:37:11.923 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-03-27T08:37:11.935 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-03-27T08:37:11.947 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-03-27T08:37:11.955 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-03-27T08:37:11.966 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-03-27T08:37:11.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-03-27T08:37:11.983 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-03-27T08:37:12.013 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-03-27T08:37:12.021 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-03-27T08:37:12.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-03-27T08:37:12.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-03-27T08:37:12.051 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-03-27T08:37:12.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-03-27T08:37:12.070 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-03-27T08:37:12.079 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-03-27T08:37:12.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-03-27T08:37:12.101 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-03-27T08:37:12.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-03-27T08:37:12.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-03-27T08:37:12.129 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-03-27T08:37:12.138 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-03-27T08:37:12.146 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-03-27T08:37:12.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-03-27T08:37:12.165 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-03-27T08:37:12.173 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-03-27T08:37:12.181 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-03-27T08:37:12.191 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-03-27T08:37:12.199 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-03-27T08:37:12.209 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-03-27T08:37:12.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-03-27T08:37:12.228 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-03-27T08:37:12.241 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-03-27T08:37:12.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-03-27T08:37:12.259 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-03-27T08:37:12.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-03-27T08:37:12.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-03-27T08:37:12.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-03-27T08:37:12.298 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-03-27T08:37:12.308 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-03-27T08:37:12.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-03-27T08:37:12.326 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-03-27T08:37:12.336 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-03-27T08:37:12.347 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-03-27T08:37:12.357 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-03-27T08:37:12.366 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-03-27T08:37:12.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-03-27T08:37:12.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-03-27T08:37:12.396 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-03-27T08:37:12.405 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-03-27T08:37:12.415 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-03-27T08:37:12.425 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-03-27T08:37:12.434 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-03-27T08:37:12.444 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-03-27T08:37:12.452 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-03-27T08:37:12.461 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-03-27T08:37:12.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-03-27T08:37:12.482 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-03-27T08:37:12.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-03-27T08:37:12.501 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-03-27T08:37:12.511 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-03-27T08:37:12.521 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-03-27T08:37:12.531 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-03-27T08:37:12.539 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-03-27T08:37:12.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-03-27T08:37:12.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-03-27T08:37:12.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-03-27T08:37:12.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-03-27T08:37:12.582 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-03-27T08:37:12.594 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-03-27T08:37:12.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-03-27T08:37:12.609 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-03-27T08:37:12.618 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-03-27T08:37:12.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-03-27T08:37:12.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-03-27T08:37:12.645 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-03-27T08:37:12.654 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-03-27T08:37:12.663 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-03-27T08:37:12.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-03-27T08:37:12.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-03-27T08:37:12.698 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-03-27T08:37:12.708 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-03-27T08:37:12.721 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-03-27T08:37:12.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-03-27T08:37:12.742 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-03-27T08:37:12.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-03-27T08:37:12.763 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-03-27T08:37:12.773 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-03-27T08:37:12.784 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-03-27T08:37:12.794 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-03-27T08:37:12.808 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-03-27T08:37:12.817 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-03-27T08:37:12.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:12 smithi167 ceph-mon[34903]: pgmap v497: 97 pgs: 97 active+clean; 88 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 2.8 MiB/s wr, 219 op/s 2024-03-27T08:37:12.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:12 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:12 smithi173 ceph-mon[35397]: pgmap v497: 97 pgs: 97 active+clean; 88 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 2.8 MiB/s wr, 219 op/s 2024-03-27T08:37:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:12 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:12.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-03-27T08:37:12.837 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-03-27T08:37:12.846 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-03-27T08:37:12.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-03-27T08:37:12.865 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-03-27T08:37:12.874 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-03-27T08:37:12.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-03-27T08:37:12.894 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-03-27T08:37:12.903 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-03-27T08:37:12.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-03-27T08:37:12.925 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-03-27T08:37:12.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-03-27T08:37:12.950 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-03-27T08:37:12.959 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-03-27T08:37:12.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-03-27T08:37:12.979 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-03-27T08:37:12.991 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-03-27T08:37:13.001 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-03-27T08:37:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:12 smithi164 ceph-mon[31788]: pgmap v497: 97 pgs: 97 active+clean; 88 MiB data, 634 MiB used, 1.0 TiB / 1.0 TiB avail; 194 KiB/s rd, 2.8 MiB/s wr, 219 op/s 2024-03-27T08:37:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:12 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:13.029 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-03-27T08:37:13.106 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-03-27T08:37:13.112 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-03-27T08:37:13.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-03-27T08:37:13.131 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-03-27T08:37:13.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-03-27T08:37:13.147 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-03-27T08:37:13.155 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-03-27T08:37:13.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-03-27T08:37:13.171 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-03-27T08:37:13.179 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-03-27T08:37:13.188 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-03-27T08:37:13.194 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-03-27T08:37:13.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-03-27T08:37:13.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-03-27T08:37:13.213 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-03-27T08:37:13.222 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-03-27T08:37:13.230 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-03-27T08:37:13.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-03-27T08:37:13.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-03-27T08:37:13.259 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-03-27T08:37:13.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-03-27T08:37:13.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-03-27T08:37:13.286 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-03-27T08:37:13.295 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-03-27T08:37:13.305 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-03-27T08:37:13.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-03-27T08:37:13.325 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-03-27T08:37:13.335 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-03-27T08:37:13.344 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-03-27T08:37:13.354 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-03-27T08:37:13.360 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-03-27T08:37:13.369 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-03-27T08:37:13.379 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-03-27T08:37:13.389 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-03-27T08:37:13.399 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-03-27T08:37:13.409 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-03-27T08:37:13.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-03-27T08:37:13.428 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-03-27T08:37:13.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-03-27T08:37:13.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-03-27T08:37:13.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-03-27T08:37:13.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-03-27T08:37:13.474 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-03-27T08:37:13.483 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-03-27T08:37:13.492 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-03-27T08:37:13.502 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-03-27T08:37:13.517 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-03-27T08:37:13.528 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-03-27T08:37:13.538 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-03-27T08:37:13.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-03-27T08:37:13.562 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-03-27T08:37:13.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-03-27T08:37:13.580 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-03-27T08:37:13.588 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-03-27T08:37:13.598 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-03-27T08:37:13.606 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-03-27T08:37:13.614 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-03-27T08:37:13.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-03-27T08:37:13.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-03-27T08:37:13.639 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-03-27T08:37:13.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-03-27T08:37:13.654 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-03-27T08:37:13.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-03-27T08:37:13.671 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-03-27T08:37:13.679 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-03-27T08:37:13.688 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-03-27T08:37:13.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-03-27T08:37:13.707 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-03-27T08:37:13.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-03-27T08:37:13.724 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-03-27T08:37:13.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-03-27T08:37:13.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-03-27T08:37:13.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-03-27T08:37:13.763 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-03-27T08:37:13.771 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-03-27T08:37:13.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-03-27T08:37:13.794 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-03-27T08:37:13.805 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-03-27T08:37:13.814 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-03-27T08:37:13.823 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-03-27T08:37:13.835 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-03-27T08:37:13.845 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-03-27T08:37:13.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-03-27T08:37:13.863 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-03-27T08:37:13.872 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-03-27T08:37:13.880 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-03-27T08:37:13.891 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-03-27T08:37:13.899 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-03-27T08:37:13.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-03-27T08:37:13.921 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-03-27T08:37:13.935 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-03-27T08:37:13.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-03-27T08:37:13.953 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-03-27T08:37:13.964 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-03-27T08:37:13.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-03-27T08:37:13.984 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-03-27T08:37:13.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-03-27T08:37:14.013 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-03-27T08:37:14.021 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-03-27T08:37:14.041 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-03-27T08:37:14.104 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-03-27T08:37:14.114 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-03-27T08:37:14.125 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-03-27T08:37:14.133 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-03-27T08:37:14.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-03-27T08:37:14.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-03-27T08:37:14.158 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-03-27T08:37:14.165 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-03-27T08:37:14.176 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-03-27T08:37:14.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-03-27T08:37:14.194 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-03-27T08:37:14.203 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-03-27T08:37:14.212 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-03-27T08:37:14.223 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-03-27T08:37:14.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-03-27T08:37:14.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-03-27T08:37:14.259 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-03-27T08:37:14.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-03-27T08:37:14.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-03-27T08:37:14.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-03-27T08:37:14.299 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-03-27T08:37:14.307 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-03-27T08:37:14.320 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-03-27T08:37:14.330 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-03-27T08:37:14.339 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-03-27T08:37:14.348 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-03-27T08:37:14.358 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-03-27T08:37:14.370 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-03-27T08:37:14.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-03-27T08:37:14.387 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-03-27T08:37:14.395 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-03-27T08:37:14.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-03-27T08:37:14.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-03-27T08:37:14.427 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-03-27T08:37:14.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-03-27T08:37:14.448 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-03-27T08:37:14.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-03-27T08:37:14.469 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-03-27T08:37:14.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-03-27T08:37:14.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-03-27T08:37:14.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-03-27T08:37:14.509 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-03-27T08:37:14.517 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-03-27T08:37:14.530 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-03-27T08:37:14.544 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-03-27T08:37:14.553 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-03-27T08:37:14.563 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-03-27T08:37:14.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-03-27T08:37:14.586 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-03-27T08:37:14.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-03-27T08:37:14.609 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-03-27T08:37:14.620 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-03-27T08:37:14.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-03-27T08:37:14.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-03-27T08:37:14.653 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-03-27T08:37:14.664 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-03-27T08:37:14.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-03-27T08:37:14.685 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-03-27T08:37:14.695 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-03-27T08:37:14.704 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-03-27T08:37:14.713 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-03-27T08:37:14.724 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-03-27T08:37:14.733 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-03-27T08:37:14.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-03-27T08:37:14.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-03-27T08:37:14.764 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-03-27T08:37:14.772 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-03-27T08:37:14.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-03-27T08:37:14.793 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-03-27T08:37:14.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-03-27T08:37:14.813 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-03-27T08:37:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:14 smithi167 ceph-mon[34903]: pgmap v498: 97 pgs: 97 active+clean; 90 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-03-27T08:37:14.823 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-03-27T08:37:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:14 smithi173 ceph-mon[35397]: pgmap v498: 97 pgs: 97 active+clean; 90 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-03-27T08:37:14.833 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-03-27T08:37:14.843 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-03-27T08:37:14.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-03-27T08:37:14.862 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-03-27T08:37:14.872 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-03-27T08:37:14.881 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-03-27T08:37:14.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-03-27T08:37:14.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-03-27T08:37:14.907 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-03-27T08:37:14.917 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-03-27T08:37:14.926 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-03-27T08:37:14.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-03-27T08:37:14.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-03-27T08:37:14.952 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-03-27T08:37:14.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-03-27T08:37:14.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-03-27T08:37:14.978 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-03-27T08:37:14.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-03-27T08:37:14.998 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-03-27T08:37:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:14 smithi164 ceph-mon[31788]: pgmap v498: 97 pgs: 97 active+clean; 90 MiB data, 638 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 1.6 MiB/s wr, 240 op/s 2024-03-27T08:37:15.009 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-03-27T08:37:15.020 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-03-27T08:37:15.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-03-27T08:37:15.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-03-27T08:37:15.138 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-03-27T08:37:15.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-03-27T08:37:15.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-03-27T08:37:15.171 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-03-27T08:37:15.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-03-27T08:37:15.187 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-03-27T08:37:15.197 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-03-27T08:37:15.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-03-27T08:37:15.215 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-03-27T08:37:15.226 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-03-27T08:37:15.236 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-03-27T08:37:15.245 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-03-27T08:37:15.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-03-27T08:37:15.266 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-03-27T08:37:15.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-03-27T08:37:15.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-03-27T08:37:15.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-03-27T08:37:15.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-03-27T08:37:15.322 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-03-27T08:37:15.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-03-27T08:37:15.342 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-03-27T08:37:15.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-03-27T08:37:15.362 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-03-27T08:37:15.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-03-27T08:37:15.380 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-03-27T08:37:15.389 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-03-27T08:37:15.398 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-03-27T08:37:15.406 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-03-27T08:37:15.414 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-03-27T08:37:15.423 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-03-27T08:37:15.432 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-03-27T08:37:15.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-03-27T08:37:15.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-03-27T08:37:15.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-03-27T08:37:15.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-03-27T08:37:15.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-03-27T08:37:15.494 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-03-27T08:37:15.503 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-03-27T08:37:15.511 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-03-27T08:37:15.520 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-03-27T08:37:15.530 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-03-27T08:37:15.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-03-27T08:37:15.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-03-27T08:37:15.556 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-03-27T08:37:15.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-03-27T08:37:15.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-03-27T08:37:15.584 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-03-27T08:37:15.593 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-03-27T08:37:15.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-03-27T08:37:15.613 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-03-27T08:37:15.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-03-27T08:37:15.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-03-27T08:37:15.639 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-03-27T08:37:15.648 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-03-27T08:37:15.657 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-03-27T08:37:15.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-03-27T08:37:15.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-03-27T08:37:15.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-03-27T08:37:15.693 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-03-27T08:37:15.703 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-03-27T08:37:15.712 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-03-27T08:37:15.720 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-03-27T08:37:15.728 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-03-27T08:37:15.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-03-27T08:37:15.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-03-27T08:37:15.753 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-03-27T08:37:15.762 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-03-27T08:37:15.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-03-27T08:37:15.776 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-03-27T08:37:15.787 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-03-27T08:37:15.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-03-27T08:37:15.809 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-03-27T08:37:15.818 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-03-27T08:37:15.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-03-27T08:37:15.837 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-03-27T08:37:15.847 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-03-27T08:37:15.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-03-27T08:37:15.865 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-03-27T08:37:15.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-03-27T08:37:15.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-03-27T08:37:15.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-03-27T08:37:15.900 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-03-27T08:37:15.910 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-03-27T08:37:15.919 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-03-27T08:37:15.929 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-03-27T08:37:15.939 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-03-27T08:37:15.948 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-03-27T08:37:15.958 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-03-27T08:37:15.966 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-03-27T08:37:15.975 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-03-27T08:37:15.983 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-03-27T08:37:15.994 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-03-27T08:37:16.002 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-03-27T08:37:16.012 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-03-27T08:37:16.020 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-03-27T08:37:16.029 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-03-27T08:37:16.039 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-03-27T08:37:16.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-03-27T08:37:16.153 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-03-27T08:37:16.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-03-27T08:37:16.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-03-27T08:37:16.181 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-03-27T08:37:16.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-03-27T08:37:16.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-03-27T08:37:16.207 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-03-27T08:37:16.215 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-03-27T08:37:16.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-03-27T08:37:16.235 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-03-27T08:37:16.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-03-27T08:37:16.252 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-03-27T08:37:16.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-03-27T08:37:16.272 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-03-27T08:37:16.280 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-03-27T08:37:16.290 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-03-27T08:37:16.299 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-03-27T08:37:16.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-03-27T08:37:16.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-03-27T08:37:16.329 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-03-27T08:37:16.342 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-03-27T08:37:16.355 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-03-27T08:37:16.367 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-03-27T08:37:16.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-03-27T08:37:16.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-03-27T08:37:16.397 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-03-27T08:37:16.408 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-03-27T08:37:16.420 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-03-27T08:37:16.430 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-03-27T08:37:16.442 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-03-27T08:37:16.457 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-03-27T08:37:16.467 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-03-27T08:37:16.477 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-03-27T08:37:16.485 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-03-27T08:37:16.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-03-27T08:37:16.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-03-27T08:37:16.515 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-03-27T08:37:16.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-03-27T08:37:16.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-03-27T08:37:16.541 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-03-27T08:37:16.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-03-27T08:37:16.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-03-27T08:37:16.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-03-27T08:37:16.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-03-27T08:37:16.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-03-27T08:37:16.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-03-27T08:37:16.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-03-27T08:37:16.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-03-27T08:37:16.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-03-27T08:37:16.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-03-27T08:37:16.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-03-27T08:37:16.652 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-03-27T08:37:16.665 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-03-27T08:37:16.672 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-03-27T08:37:16.681 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-03-27T08:37:16.690 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-03-27T08:37:16.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-03-27T08:37:16.709 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-03-27T08:37:16.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-03-27T08:37:16.725 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-03-27T08:37:16.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-03-27T08:37:16.749 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-03-27T08:37:16.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-03-27T08:37:16.769 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-03-27T08:37:16.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-03-27T08:37:16.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-03-27T08:37:16.798 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-03-27T08:37:16.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-03-27T08:37:16.816 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-03-27T08:37:16.817 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:16 smithi167 ceph-mon[34903]: pgmap v499: 97 pgs: 97 active+clean; 90 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 875 KiB/s wr, 241 op/s 2024-03-27T08:37:16.823 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-03-27T08:37:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:16 smithi173 ceph-mon[35397]: pgmap v499: 97 pgs: 97 active+clean; 90 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 875 KiB/s wr, 241 op/s 2024-03-27T08:37:16.832 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-03-27T08:37:16.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-03-27T08:37:16.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-03-27T08:37:16.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-03-27T08:37:16.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-03-27T08:37:16.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-03-27T08:37:16.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-03-27T08:37:16.901 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-03-27T08:37:16.911 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-03-27T08:37:16.921 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-03-27T08:37:16.932 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-03-27T08:37:16.941 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-03-27T08:37:16.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-03-27T08:37:16.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-03-27T08:37:16.970 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-03-27T08:37:16.979 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-03-27T08:37:16.989 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-03-27T08:37:16.997 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-03-27T08:37:17.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:16 smithi164 ceph-mon[31788]: pgmap v499: 97 pgs: 97 active+clean; 90 MiB data, 642 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 875 KiB/s wr, 241 op/s 2024-03-27T08:37:17.007 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-03-27T08:37:17.016 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-03-27T08:37:17.025 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-03-27T08:37:17.039 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-03-27T08:37:17.048 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-03-27T08:37:17.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-03-27T08:37:17.118 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-03-27T08:37:17.126 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-03-27T08:37:17.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-03-27T08:37:17.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-03-27T08:37:17.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-03-27T08:37:17.166 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-03-27T08:37:17.175 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-03-27T08:37:17.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-03-27T08:37:17.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-03-27T08:37:17.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-03-27T08:37:17.209 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-03-27T08:37:17.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-03-27T08:37:17.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-03-27T08:37:17.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-03-27T08:37:17.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-03-27T08:37:17.252 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-03-27T08:37:17.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-03-27T08:37:17.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-03-27T08:37:17.278 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-03-27T08:37:17.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-03-27T08:37:17.299 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-03-27T08:37:17.307 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-03-27T08:37:17.317 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-03-27T08:37:17.329 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-03-27T08:37:17.339 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-03-27T08:37:17.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-03-27T08:37:17.360 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-03-27T08:37:17.369 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-03-27T08:37:17.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-03-27T08:37:17.390 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-03-27T08:37:17.401 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-03-27T08:37:17.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-03-27T08:37:17.423 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-03-27T08:37:17.435 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-03-27T08:37:17.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-03-27T08:37:17.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-03-27T08:37:17.464 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-03-27T08:37:17.476 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-03-27T08:37:17.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-03-27T08:37:17.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-03-27T08:37:17.508 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-03-27T08:37:17.520 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-03-27T08:37:17.529 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-03-27T08:37:17.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-03-27T08:37:17.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-03-27T08:37:17.558 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-03-27T08:37:17.568 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-03-27T08:37:17.582 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-03-27T08:37:17.593 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-03-27T08:37:17.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-03-27T08:37:17.609 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-03-27T08:37:17.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-03-27T08:37:17.631 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-03-27T08:37:17.644 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-03-27T08:37:17.652 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-03-27T08:37:17.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-03-27T08:37:17.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-03-27T08:37:17.679 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-03-27T08:37:17.690 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-03-27T08:37:17.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-03-27T08:37:17.708 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-03-27T08:37:17.718 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-03-27T08:37:17.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-03-27T08:37:17.734 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-03-27T08:37:17.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-03-27T08:37:17.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-03-27T08:37:17.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-03-27T08:37:17.769 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-03-27T08:37:17.780 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-03-27T08:37:18.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-03-27T08:37:18.121 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-03-27T08:37:18.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-03-27T08:37:18.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-03-27T08:37:18.169 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-03-27T08:37:18.179 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-03-27T08:37:18.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-03-27T08:37:18.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-03-27T08:37:18.207 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-03-27T08:37:18.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-03-27T08:37:18.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-03-27T08:37:18.237 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-03-27T08:37:18.246 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-03-27T08:37:18.255 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-03-27T08:37:18.264 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-03-27T08:37:18.275 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-03-27T08:37:18.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-03-27T08:37:18.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-03-27T08:37:18.304 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-03-27T08:37:18.314 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-03-27T08:37:18.325 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-03-27T08:37:18.334 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-03-27T08:37:18.343 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-03-27T08:37:18.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-03-27T08:37:18.360 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-03-27T08:37:18.370 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-03-27T08:37:18.380 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-03-27T08:37:18.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-03-27T08:37:18.400 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-03-27T08:37:18.420 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-03-27T08:37:18.427 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-03-27T08:37:18.442 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-03-27T08:37:18.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-03-27T08:37:18.476 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-03-27T08:37:18.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-03-27T08:37:18.485 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-03-27T08:37:18.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-03-27T08:37:18.504 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-03-27T08:37:18.514 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-03-27T08:37:18.523 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-03-27T08:37:18.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-03-27T08:37:18.545 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-03-27T08:37:18.555 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-03-27T08:37:18.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-03-27T08:37:18.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-03-27T08:37:18.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-03-27T08:37:18.607 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-03-27T08:37:18.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-03-27T08:37:18.629 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-03-27T08:37:18.719 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-03-27T08:37:18.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-03-27T08:37:18.736 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-03-27T08:37:18.744 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-03-27T08:37:18.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-03-27T08:37:18.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-03-27T08:37:18.769 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-03-27T08:37:18.775 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-03-27T08:37:18.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-03-27T08:37:18.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-03-27T08:37:18.795 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-03-27T08:37:18.803 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-03-27T08:37:18.811 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-03-27T08:37:18.819 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-03-27T08:37:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:18 smithi173 ceph-mon[35397]: pgmap v500: 97 pgs: 97 active+clean; 91 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 822 KiB/s wr, 236 op/s 2024-03-27T08:37:18.826 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-03-27T08:37:18.833 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-03-27T08:37:18.839 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-03-27T08:37:18.848 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-03-27T08:37:18.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-03-27T08:37:18.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-03-27T08:37:18.876 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-03-27T08:37:18.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-03-27T08:37:18.899 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-03-27T08:37:18.911 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-03-27T08:37:18.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-03-27T08:37:18.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-03-27T08:37:18.942 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-03-27T08:37:18.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-03-27T08:37:18.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-03-27T08:37:18.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-03-27T08:37:18.979 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-03-27T08:37:18.988 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-03-27T08:37:19.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-03-27T08:37:19.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:18 smithi164 ceph-mon[31788]: pgmap v500: 97 pgs: 97 active+clean; 91 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 822 KiB/s wr, 236 op/s 2024-03-27T08:37:19.010 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-03-27T08:37:19.021 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-03-27T08:37:19.033 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-03-27T08:37:19.043 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-03-27T08:37:19.056 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-03-27T08:37:19.067 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-03-27T08:37:19.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:18 smithi167 ceph-mon[34903]: pgmap v500: 97 pgs: 97 active+clean; 91 MiB data, 650 MiB used, 1.0 TiB / 1.0 TiB avail; 417 KiB/s rd, 822 KiB/s wr, 236 op/s 2024-03-27T08:37:19.080 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-03-27T08:37:19.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-03-27T08:37:19.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-03-27T08:37:19.187 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-03-27T08:37:19.197 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-03-27T08:37:19.204 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-03-27T08:37:19.213 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-03-27T08:37:19.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-03-27T08:37:19.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-03-27T08:37:19.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-03-27T08:37:19.253 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-03-27T08:37:19.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-03-27T08:37:19.282 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-03-27T08:37:19.292 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-03-27T08:37:19.301 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-03-27T08:37:19.311 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-03-27T08:37:19.321 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-03-27T08:37:19.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-03-27T08:37:19.341 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-03-27T08:37:19.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-03-27T08:37:19.362 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-03-27T08:37:19.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-03-27T08:37:19.384 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-03-27T08:37:19.396 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-03-27T08:37:19.405 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-03-27T08:37:19.415 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-03-27T08:37:19.424 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-03-27T08:37:19.435 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-03-27T08:37:19.445 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-03-27T08:37:19.453 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-03-27T08:37:19.465 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-03-27T08:37:19.474 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-03-27T08:37:19.485 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-03-27T08:37:19.495 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-03-27T08:37:19.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-03-27T08:37:19.517 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-03-27T08:37:19.526 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-03-27T08:37:19.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-03-27T08:37:19.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-03-27T08:37:19.558 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-03-27T08:37:19.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-03-27T08:37:19.581 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-03-27T08:37:19.595 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-03-27T08:37:19.603 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-03-27T08:37:19.613 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-03-27T08:37:19.620 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-03-27T08:37:19.631 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-03-27T08:37:19.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-03-27T08:37:19.657 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-03-27T08:37:19.660 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-03-27T08:37:19.668 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-03-27T08:37:19.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-03-27T08:37:19.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-03-27T08:37:19.693 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-03-27T08:37:19.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-03-27T08:37:19.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-03-27T08:37:19.718 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-03-27T08:37:19.725 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-03-27T08:37:19.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-03-27T08:37:19.740 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-03-27T08:37:19.747 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-03-27T08:37:19.755 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-03-27T08:37:19.763 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-03-27T08:37:19.773 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-03-27T08:37:19.781 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-03-27T08:37:19.788 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-03-27T08:37:19.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-03-27T08:37:19.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-03-27T08:37:19.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-03-27T08:37:19.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-03-27T08:37:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 -- 172.21.15.164:0/1375366985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710105950 msgr2=0x7f571010c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.824 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 --2- 172.21.15.164:0/1375366985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710105950 0x7f571010c1e0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5708009ca0 tx=0x7f570802c100 comp rx=0 tx=0).stop 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 -- 172.21.15.164:0/1375366985 shutdown_connections 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 --2- 172.21.15.164:0/1375366985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710105950 0x7f571010c1e0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 --2- 172.21.15.164:0/1375366985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 0x7f5710105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 --2- 172.21.15.164:0/1375366985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710103da0 0x7f57101041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 -- 172.21.15.164:0/1375366985 >> 172.21.15.164:0/1375366985 conn(0x7f57100ff310 msgr2=0x7f5710101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 -- 172.21.15.164:0/1375366985 shutdown_connections 2024-03-27T08:37:19.825 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.832+0000 7f5717000640 1 -- 172.21.15.164:0/1375366985 wait complete. 2024-03-27T08:37:19.826 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-03-27T08:37:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.833+0000 7f5717000640 1 Processor -- start 2024-03-27T08:37:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.833+0000 7f5717000640 1 -- start start 2024-03-27T08:37:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 0x7f571019a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710105950 0x7f57101a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f571010fa00 con 0x7f5710103da0 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f571010f880 con 0x7f5710104f90 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f5717000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f571010fb80 con 0x7f5710105950 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60064/0 (socket says 172.21.15.164:60064) 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f570fe00640 1 -- 172.21.15.164:0/3929360273 learned_addr learned my addr 172.21.15.164:0/3929360273 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.834+0000 7f570f400640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 0x7f571019a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.829 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f5715000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710105950 0x7f57101a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 -- 172.21.15.164:0/3929360273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710105950 msgr2=0x7f57101a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710105950 0x7f57101a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 -- 172.21.15.164:0/3929360273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 msgr2=0x7f571019a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 0x7f571019a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 -- 172.21.15.164:0/3929360273 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57101a1be0 con 0x7f5710103da0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570fe00640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f570000d950 tx=0x7f570000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570cc00640 1 -- 172.21.15.164:0/3929360273 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700017070 con 0x7f5710103da0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570cc00640 1 -- 172.21.15.164:0/3929360273 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5700009c30 con 0x7f5710103da0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f570cc00640 1 -- 172.21.15.164:0/3929360273 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f570000f620 con 0x7f5710103da0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.835+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57101a1ed0 con 0x7f5710103da0 2024-03-27T08:37:19.830 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.836+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57101a22e0 con 0x7f5710103da0 2024-03-27T08:37:19.831 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.839+0000 7f5719bf6740 1 Processor -- start 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.839+0000 7f5719bf6740 1 -- start start 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f570cc00640 1 -- 172.21.15.164:0/3929360273 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f570001a070 con 0x7f5710103da0 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c1be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c1e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dea3b7bd10 con 0x55dea3c16980 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dea3b24260 con 0x55dea3c17370 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5719bf6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dea3b77cc0 con 0x55dea3c1c4e0 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60068/0 (socket says 172.21.15.164:60068) 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f5715000640 1 -- 172.21.15.164:0/3675435503 learned_addr learned my addr 172.21.15.164:0/3675435503 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f570fe00640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c1be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.840+0000 7f570f400640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c1e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 -- 172.21.15.164:0/3675435503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 msgr2=0x55dea3c1e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c1e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 -- 172.21.15.164:0/3675435503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 msgr2=0x55dea3c16da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 -- 172.21.15.164:0/3675435503 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea3b1baa0 con 0x55dea3c17370 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f5715000640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:19.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570f400640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c1e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:19.835 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f570fe00640 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c1be70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57000cd250 tx=0x7f57000d7670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=41386152b41aa2d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f5705600640 1 -- 172.21.15.164:0/3675435503 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000de070 con 0x55dea3c17370 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f5705600640 1 -- 172.21.15.164:0/3675435503 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f57000d17a0 con 0x55dea3c17370 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.841+0000 7f5705600640 1 -- 172.21.15.164:0/3675435503 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000daa40 con 0x55dea3c17370 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.842+0000 7f570cc00640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 0x7f56f40a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.842+0000 7f570cc00640 1 -- 172.21.15.164:0/3929360273 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f57000cf800 con 0x7f5710103da0 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.842+0000 7f5715000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 0x7f56f40a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.842+0000 7f5719bf6740 1 -- 172.21.15.164:0/3675435503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 msgr2=0x55dea3c1be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.839 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.842+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c1be70 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f57000cd250 tx=0x7f57000d7670 comp rx=0 tx=0).stop 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 -- 172.21.15.164:0/3675435503 shutdown_connections 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c1e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c1be70 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3675435503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c16da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 -- 172.21.15.164:0/3675435503 >> 172.21.15.164:0/3675435503 conn(0x55dea3c11ef0 msgr2=0x55dea3c122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 -- 172.21.15.164:0/3675435503 shutdown_connections 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5715000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 0x7f56f40a5b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5708006010 tx=0x7f570802e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.843+0000 7f5719bf6740 1 -- 172.21.15.164:0/3675435503 wait complete. 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.844+0000 7f5719bf6740 1 -- start start 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.844+0000 7f5719bf6740 1 Processor -- start 2024-03-27T08:37:19.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c21250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c28290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dea3c1f490 con 0x55dea3c16980 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dea3b37630 con 0x55dea3c17370 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dea3c1f610 con 0x55dea3c1c4e0 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5719bf6740 10 client.0 _ll_register_callbacks cb 0x55dea3b3cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60080/0 (socket says 172.21.15.164:60080) 2024-03-27T08:37:19.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f570fe00640 1 -- 172.21.15.164:0/348196784 learned_addr learned my addr 172.21.15.164:0/348196784 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f570f400640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c21250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.845+0000 7f5715000640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c28290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 -- 172.21.15.164:0/348196784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 msgr2=0x55dea3c28290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c28290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 -- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 msgr2=0x55dea3c21250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c21250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 -- 172.21.15.164:0/348196784 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea3b435f0 con 0x55dea3c16980 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f570fe00640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f570000bfd0 tx=0x7f5700010c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b30d268b7caa606 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f56fa000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700021070 con 0x55dea3c16980 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f57000109c0 con 0x55dea3c16980 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f57000d17a0 con 0x55dea3c16980 2024-03-27T08:37:19.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57000de030 con 0x55dea3c16980 2024-03-27T08:37:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f5719bf6740 10 client.15924 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.846+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dea3890210 con 0x55dea3c16980 2024-03-27T08:37:19.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f57000d17a0 con 0x55dea3c16980 2024-03-27T08:37:19.846 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57000982f0 con 0x55dea3c16980 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 10 client.15924 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 10 client.15924 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 20 client.15924 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c2c780 0x55dea3c2eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.848 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 4 client.15924 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dea3b89250 con 0x55dea3c2c780 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.847+0000 7f570f400640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c2c780 0x55dea3c2eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.848+0000 7f570f400640 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c2c780 0x55dea3c2eb70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cebdcb9fe21320ce server_cookie=d881f540961454b7 in_seq=0 out_seq=0 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.848+0000 7f56fa000640 10 client.15924 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f56fa000640 1 -- 172.21.15.164:0/348196784 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55dea3b89250 con 0x55dea3c2c780 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f56fa000640 10 client.15924 handle_command_reply: tid=0 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 client.15924 shutdown 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 msgr2=0x55dea3c20d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f570000bfd0 tx=0x7f5700010c90 comp rx=0 tx=0).stop 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 shutdown_connections 2024-03-27T08:37:19.849 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c2c780 0x55dea3c2eb70 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c28290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c21250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 --2- 172.21.15.164:0/348196784 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c20d10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f56fa000640 0 client.15924 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 >> 172.21.15.164:0/348196784 conn(0x55dea3c11ef0 msgr2=0x55dea3c110f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 shutdown_connections 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 1 -- 172.21.15.164:0/348196784 wait complete. 2024-03-27T08:37:19.850 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.850+0000 7f5719bf6740 20 client.15924 trim_cache size 0 max 16384 2024-03-27T08:37:19.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-03-27T08:37:19.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-03-27T08:37:19.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-03-27T08:37:19.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-03-27T08:37:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.867+0000 7f5719bf6740 1 Processor -- start 2024-03-27T08:37:19.859 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 -- start start 2024-03-27T08:37:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.860 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c28220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c10da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f57101adab0 con 0x55dea3c16980 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57101ab380 con 0x55dea3c17370 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f5719bf6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57101a91d0 con 0x55dea3c1c4e0 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f570f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c28220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60086/0 (socket says 172.21.15.164:60086) 2024-03-27T08:37:19.861 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.868+0000 7f570fe00640 1 -- 172.21.15.164:0/3447873410 learned_addr learned my addr 172.21.15.164:0/3447873410 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:19.862 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f5715000640 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c10da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 -- 172.21.15.164:0/3447873410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 msgr2=0x55dea3c10da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c10da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 -- 172.21.15.164:0/3447873410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 msgr2=0x55dea3c28220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c28220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 -- 172.21.15.164:0/3447873410 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dea395c620 con 0x55dea3c16980 2024-03-27T08:37:19.865 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f570fe00640 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f57000980e0 tx=0x7f570009a190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e567e9727c99612 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f5704c00640 1 -- 172.21.15.164:0/3447873410 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700021070 con 0x55dea3c16980 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.869+0000 7f5704c00640 1 -- 172.21.15.164:0/3447873410 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f570009c380 con 0x55dea3c16980 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5704c00640 1 -- 172.21.15.164:0/3447873410 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57000a48f0 con 0x55dea3c16980 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 -- 172.21.15.164:0/3447873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 msgr2=0x55dea3c10860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f57000980e0 tx=0x7f570009a190 comp rx=0 tx=0).stop 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 -- 172.21.15.164:0/3447873410 shutdown_connections 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c10da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c28220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 --2- 172.21.15.164:0/3447873410 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c10860 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.870+0000 7f5719bf6740 1 -- 172.21.15.164:0/3447873410 >> 172.21.15.164:0/3447873410 conn(0x55dea3c11ef0 msgr2=0x55dea3c20920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:19.866 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.871+0000 7f5719bf6740 1 -- 172.21.15.164:0/3447873410 shutdown_connections 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.871+0000 7f5719bf6740 1 -- 172.21.15.164:0/3447873410 wait complete. 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.871+0000 7f5719bf6740 1 -- start start 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.871+0000 7f5719bf6740 1 Processor -- start 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c26290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c271e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f57101a9840 con 0x55dea3c16980 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f57101aacb0 con 0x55dea3c17370 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f57101a9f10 con 0x55dea3c1c4e0 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5719bf6740 10 client.0 _ll_register_callbacks cb 0x7f5708037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60092/0 (socket says 172.21.15.164:60092) 2024-03-27T08:37:19.867 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 -- 172.21.15.164:0/850343497 learned_addr learned my addr 172.21.15.164:0/850343497 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570f400640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c26290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5715000640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c271e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 -- 172.21.15.164:0/850343497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 msgr2=0x55dea3c271e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c271e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 -- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 msgr2=0x55dea3c26290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c26290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f570fe00640 1 -- 172.21.15.164:0/850343497 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dea3c277d0 con 0x55dea3c16980 2024-03-27T08:37:19.868 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.872+0000 7f5715000640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:37:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f570fe00640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5700098650 tx=0x7f57000cfb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75237340003ad0e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f56fa000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5700021070 con 0x55dea3c16980 2024-03-27T08:37:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f57000a4460 con 0x55dea3c16980 2024-03-27T08:37:19.869 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f570009c380 con 0x55dea3c16980 2024-03-27T08:37:19.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-03-27T08:37:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f57000d5820 con 0x55dea3c16980 2024-03-27T08:37:19.870 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f5719bf6740 10 client.15930 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.873+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55dea3c277d0 con 0x55dea3c16980 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f570009c380 con 0x55dea3c16980 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f57000ba070 con 0x55dea3c16980 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 10 client.15930 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 10 client.15930 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 20 client.15930 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c93370 0x55dea3c95790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 4 client.15930 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dea3b835a0 con 0x55dea3c93370 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.874+0000 7f570f400640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c93370 0x55dea3c95790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.875+0000 7f570f400640 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c93370 0x55dea3c95790 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2d431b326c7aaf4 server_cookie=1f3a4008559b3da4 in_seq=0 out_seq=0 2024-03-27T08:37:19.871 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:19.875+0000 7f56fa000640 10 client.15930 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:19.872 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-03-27T08:37:19.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-03-27T08:37:19.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-03-27T08:37:19.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-03-27T08:37:19.886 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-03-27T08:37:19.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-03-27T08:37:19.907 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-03-27T08:37:19.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-03-27T08:37:19.920 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-03-27T08:37:19.927 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-03-27T08:37:19.932 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-03-27T08:37:19.937 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-03-27T08:37:19.943 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-03-27T08:37:19.949 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-03-27T08:37:19.955 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-03-27T08:37:19.959 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-03-27T08:37:19.963 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-03-27T08:37:19.968 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-03-27T08:37:19.972 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-03-27T08:37:19.977 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-03-27T08:37:19.982 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-03-27T08:37:19.987 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-03-27T08:37:19.992 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-03-27T08:37:19.998 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-03-27T08:37:20.005 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-03-27T08:37:20.010 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-03-27T08:37:20.016 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-03-27T08:37:20.022 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-03-27T08:37:20.028 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-03-27T08:37:20.035 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-03-27T08:37:20.041 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-03-27T08:37:20.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-03-27T08:37:20.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-03-27T08:37:20.068 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-03-27T08:37:20.079 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-03-27T08:37:20.088 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-03-27T08:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.103+0000 7f56fa000640 1 -- 172.21.15.164:0/850343497 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dea3b835a0 con 0x55dea3c93370 2024-03-27T08:37:20.095 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.103+0000 7f56fa000640 10 client.15930 handle_command_reply: tid=0 2024-03-27T08:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.103+0000 7f5719bf6740 1 client.15930 shutdown 2024-03-27T08:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 msgr2=0x55dea3c25d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:20.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f5700098650 tx=0x7f57000cfb00 comp rx=0 tx=0).stop 2024-03-27T08:37:20.096 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 shutdown_connections 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dea3c93370 0x55dea3c95790 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dea3c1c4e0 0x55dea3c271e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dea3c17370 0x55dea3c26290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 --2- 172.21.15.164:0/850343497 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dea3c16980 0x55dea3c25d50 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 >> 172.21.15.164:0/850343497 conn(0x55dea3c11ef0 msgr2=0x55dea3c15150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f56fa000640 0 client.15930 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.104+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 shutdown_connections 2024-03-27T08:37:20.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.105+0000 7f5719bf6740 1 -- 172.21.15.164:0/850343497 wait complete. 2024-03-27T08:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.105+0000 7f5719bf6740 20 client.15930 trim_cache size 0 max 16384 2024-03-27T08:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:37:20.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 msgr2=0x7f56f40a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 0x7f56f40a5b70 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5708006010 tx=0x7f570802e040 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 msgr2=0x7f5710199fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f570000d950 tx=0x7f570000de10 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 shutdown_connections 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f56f40a36b0 0x7f56f40a5b70 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5710105950 0x7f57101a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5710104f90 0x7f571019a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 --2- 172.21.15.164:0/3929360273 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5710103da0 0x7f5710199fc0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:20.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.107+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 >> 172.21.15.164:0/3929360273 conn(0x7f57100ff310 msgr2=0x7f5710108230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.108+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 shutdown_connections 2024-03-27T08:37:20.100 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:20.108+0000 7f5717000640 1 -- 172.21.15.164:0/3929360273 wait complete. 2024-03-27T08:37:20.102 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-03-27T08:37:20.107 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-03-27T08:37:20.111 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-03-27T08:37:20.116 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-03-27T08:37:20.124 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-03-27T08:37:20.132 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-03-27T08:37:20.220 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-03-27T08:37:20.228 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-03-27T08:37:20.237 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-03-27T08:37:20.247 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-03-27T08:37:20.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-03-27T08:37:20.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-03-27T08:37:20.278 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-03-27T08:37:20.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-03-27T08:37:20.296 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-03-27T08:37:20.305 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-03-27T08:37:20.314 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-03-27T08:37:20.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-03-27T08:37:20.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-03-27T08:37:20.341 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-03-27T08:37:20.349 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-03-27T08:37:20.359 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-03-27T08:37:20.366 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-03-27T08:37:20.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-03-27T08:37:20.385 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-03-27T08:37:20.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-03-27T08:37:20.405 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-03-27T08:37:20.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-03-27T08:37:20.422 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-03-27T08:37:20.430 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-03-27T08:37:20.439 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-03-27T08:37:20.448 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-03-27T08:37:20.458 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-03-27T08:37:20.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-03-27T08:37:20.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-03-27T08:37:20.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-03-27T08:37:20.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-03-27T08:37:20.503 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-03-27T08:37:20.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-03-27T08:37:20.521 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-03-27T08:37:20.534 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-03-27T08:37:20.545 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-03-27T08:37:20.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-03-27T08:37:20.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-03-27T08:37:20.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-03-27T08:37:20.592 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-03-27T08:37:20.600 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-03-27T08:37:20.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-03-27T08:37:20.617 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-03-27T08:37:20.625 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-03-27T08:37:20.634 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-03-27T08:37:20.644 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-03-27T08:37:20.652 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-03-27T08:37:20.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-03-27T08:37:20.669 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-03-27T08:37:20.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-03-27T08:37:20.686 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-03-27T08:37:20.695 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-03-27T08:37:20.705 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-03-27T08:37:20.714 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-03-27T08:37:20.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-03-27T08:37:20.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-03-27T08:37:20.741 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-03-27T08:37:20.752 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-03-27T08:37:20.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-03-27T08:37:20.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-03-27T08:37:20.779 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-03-27T08:37:20.787 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-03-27T08:37:20.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-03-27T08:37:20.806 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-03-27T08:37:20.816 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-03-27T08:37:20.825 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-03-27T08:37:20.837 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-03-27T08:37:20.845 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-03-27T08:37:20.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-03-27T08:37:20.862 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-03-27T08:37:20.870 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-03-27T08:37:20.881 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-03-27T08:37:20.893 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-03-27T08:37:20.902 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-03-27T08:37:20.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-03-27T08:37:20.920 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-03-27T08:37:20.932 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-03-27T08:37:20.941 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-03-27T08:37:20.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-03-27T08:37:20.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-03-27T08:37:20.970 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-03-27T08:37:20.982 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-03-27T08:37:20.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-03-27T08:37:21.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-03-27T08:37:21.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:20 smithi164 ceph-mon[31788]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 610 KiB/s wr, 228 op/s 2024-03-27T08:37:21.009 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-03-27T08:37:21.020 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-03-27T08:37:21.028 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-03-27T08:37:21.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-03-27T08:37:21.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-03-27T08:37:21.059 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-03-27T08:37:21.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:20 smithi167 ceph-mon[34903]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 610 KiB/s wr, 228 op/s 2024-03-27T08:37:21.069 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-03-27T08:37:21.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:20 smithi173 ceph-mon[35397]: pgmap v501: 97 pgs: 97 active+clean; 92 MiB data, 657 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 610 KiB/s wr, 228 op/s 2024-03-27T08:37:21.080 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-03-27T08:37:21.095 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-03-27T08:37:21.105 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-03-27T08:37:21.116 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-03-27T08:37:21.126 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-03-27T08:37:21.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-03-27T08:37:21.146 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-03-27T08:37:21.173 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-03-27T08:37:21.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-03-27T08:37:21.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-03-27T08:37:21.235 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-03-27T08:37:21.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-03-27T08:37:21.253 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-03-27T08:37:21.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-03-27T08:37:21.270 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-03-27T08:37:21.282 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-03-27T08:37:21.288 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-03-27T08:37:21.298 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-03-27T08:37:21.307 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-03-27T08:37:21.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-03-27T08:37:21.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-03-27T08:37:21.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-03-27T08:37:21.342 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-03-27T08:37:21.353 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-03-27T08:37:21.363 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-03-27T08:37:21.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-03-27T08:37:21.386 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-03-27T08:37:21.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-03-27T08:37:21.402 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-03-27T08:37:21.412 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-03-27T08:37:21.422 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-03-27T08:37:21.431 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-03-27T08:37:21.439 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-03-27T08:37:21.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-03-27T08:37:21.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-03-27T08:37:21.464 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-03-27T08:37:21.472 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-03-27T08:37:21.480 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-03-27T08:37:21.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-03-27T08:37:21.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-03-27T08:37:21.509 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-03-27T08:37:21.519 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-03-27T08:37:21.528 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-03-27T08:37:21.538 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-03-27T08:37:21.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-03-27T08:37:21.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-03-27T08:37:21.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-03-27T08:37:21.577 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-03-27T08:37:21.586 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-03-27T08:37:21.594 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-03-27T08:37:21.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-03-27T08:37:21.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-03-27T08:37:21.618 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-03-27T08:37:21.628 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-03-27T08:37:21.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-03-27T08:37:21.646 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-03-27T08:37:21.653 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-03-27T08:37:21.663 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-03-27T08:37:21.673 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-03-27T08:37:21.681 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-03-27T08:37:21.690 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-03-27T08:37:21.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-03-27T08:37:21.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-03-27T08:37:21.715 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-03-27T08:37:21.725 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-03-27T08:37:21.734 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-03-27T08:37:21.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-03-27T08:37:21.756 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-03-27T08:37:21.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-03-27T08:37:21.776 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-03-27T08:37:21.785 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-03-27T08:37:21.794 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-03-27T08:37:21.802 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-03-27T08:37:21.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-03-27T08:37:21.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-03-27T08:37:21.830 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-03-27T08:37:21.838 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-03-27T08:37:21.846 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-03-27T08:37:21.857 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-03-27T08:37:21.868 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-03-27T08:37:21.879 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-03-27T08:37:21.888 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-03-27T08:37:21.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-03-27T08:37:21.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-03-27T08:37:21.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-03-27T08:37:21.925 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-03-27T08:37:21.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-03-27T08:37:21.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-03-27T08:37:21.958 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-03-27T08:37:21.967 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-03-27T08:37:21.977 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-03-27T08:37:21.987 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-03-27T08:37:21.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-03-27T08:37:22.003 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-03-27T08:37:22.011 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-03-27T08:37:22.021 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-03-27T08:37:22.029 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-03-27T08:37:22.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-03-27T08:37:22.047 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-03-27T08:37:22.056 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-03-27T08:37:22.064 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-03-27T08:37:22.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-03-27T08:37:22.082 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-03-27T08:37:22.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-03-27T08:37:22.102 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-03-27T08:37:22.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-03-27T08:37:22.118 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-03-27T08:37:22.128 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-03-27T08:37:22.138 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-03-27T08:37:22.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-03-27T08:37:22.158 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-03-27T08:37:22.167 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-03-27T08:37:22.183 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-03-27T08:37:22.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-03-27T08:37:22.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-03-27T08:37:22.415 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-03-27T08:37:22.425 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-03-27T08:37:22.436 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-03-27T08:37:22.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-03-27T08:37:22.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-03-27T08:37:22.465 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-03-27T08:37:22.474 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-03-27T08:37:22.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-03-27T08:37:22.494 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-03-27T08:37:22.504 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-03-27T08:37:22.514 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-03-27T08:37:22.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-03-27T08:37:22.534 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-03-27T08:37:22.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-03-27T08:37:22.558 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-03-27T08:37:22.570 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-03-27T08:37:22.581 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-03-27T08:37:22.591 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-03-27T08:37:22.599 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-03-27T08:37:22.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-03-27T08:37:22.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-03-27T08:37:22.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-03-27T08:37:22.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-03-27T08:37:22.641 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-03-27T08:37:22.650 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-03-27T08:37:22.658 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-03-27T08:37:22.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-03-27T08:37:22.677 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-03-27T08:37:22.685 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-03-27T08:37:22.695 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-03-27T08:37:22.704 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-03-27T08:37:22.713 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-03-27T08:37:22.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-03-27T08:37:22.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-03-27T08:37:22.740 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-03-27T08:37:22.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-03-27T08:37:22.758 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-03-27T08:37:22.767 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-03-27T08:37:22.777 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-03-27T08:37:22.786 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-03-27T08:37:22.794 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-03-27T08:37:22.805 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-03-27T08:37:22.814 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-03-27T08:37:22.824 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-03-27T08:37:22.832 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-03-27T08:37:22.840 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-03-27T08:37:22.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-03-27T08:37:22.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-03-27T08:37:22.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-03-27T08:37:22.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-03-27T08:37:22.887 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-03-27T08:37:22.898 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-03-27T08:37:22.907 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-03-27T08:37:22.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-03-27T08:37:22.925 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-03-27T08:37:22.935 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-03-27T08:37:22.947 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-03-27T08:37:22.954 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-03-27T08:37:22.962 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-03-27T08:37:22.971 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-03-27T08:37:22.981 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-03-27T08:37:22.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-03-27T08:37:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:22 smithi164 ceph-mon[31788]: pgmap v502: 97 pgs: 97 active+clean; 94 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 692 KiB/s wr, 161 op/s 2024-03-27T08:37:23.019 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-03-27T08:37:23.026 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-03-27T08:37:23.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-03-27T08:37:23.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-03-27T08:37:23.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-03-27T08:37:23.068 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-03-27T08:37:23.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:22 smithi167 ceph-mon[34903]: pgmap v502: 97 pgs: 97 active+clean; 94 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 692 KiB/s wr, 161 op/s 2024-03-27T08:37:23.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:22 smithi173 ceph-mon[35397]: pgmap v502: 97 pgs: 97 active+clean; 94 MiB data, 667 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 692 KiB/s wr, 161 op/s 2024-03-27T08:37:23.077 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-03-27T08:37:23.086 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-03-27T08:37:23.097 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-03-27T08:37:23.108 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-03-27T08:37:23.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-03-27T08:37:23.127 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-03-27T08:37:23.137 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-03-27T08:37:23.150 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-03-27T08:37:23.161 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-03-27T08:37:23.174 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-03-27T08:37:23.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-03-27T08:37:23.319 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-03-27T08:37:23.327 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-03-27T08:37:23.336 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-03-27T08:37:23.345 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-03-27T08:37:23.353 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-03-27T08:37:23.362 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-03-27T08:37:23.370 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-03-27T08:37:23.379 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-03-27T08:37:23.387 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-03-27T08:37:23.396 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-03-27T08:37:23.405 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-03-27T08:37:23.415 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-03-27T08:37:23.425 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-03-27T08:37:23.433 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-03-27T08:37:23.443 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-03-27T08:37:23.453 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-03-27T08:37:23.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-03-27T08:37:23.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-03-27T08:37:23.480 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-03-27T08:37:23.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-03-27T08:37:23.502 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-03-27T08:37:23.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-03-27T08:37:23.523 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-03-27T08:37:23.534 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-03-27T08:37:23.549 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-03-27T08:37:23.560 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-03-27T08:37:23.577 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-03-27T08:37:23.587 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-03-27T08:37:23.598 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-03-27T08:37:23.610 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-03-27T08:37:23.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-03-27T08:37:23.628 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-03-27T08:37:23.638 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-03-27T08:37:23.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-03-27T08:37:23.657 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-03-27T08:37:23.665 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-03-27T08:37:23.674 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-03-27T08:37:23.683 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-03-27T08:37:23.690 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-03-27T08:37:23.698 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-03-27T08:37:23.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-03-27T08:37:23.714 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-03-27T08:37:23.723 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-03-27T08:37:23.735 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-03-27T08:37:23.739 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-03-27T08:37:23.749 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-03-27T08:37:23.758 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-03-27T08:37:23.766 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-03-27T08:37:23.775 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-03-27T08:37:23.781 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-03-27T08:37:23.787 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-03-27T08:37:23.791 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-03-27T08:37:23.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-03-27T08:37:23.800 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-03-27T08:37:23.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-03-27T08:37:23.809 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-03-27T08:37:23.813 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-03-27T08:37:23.817 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-03-27T08:37:23.822 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-03-27T08:37:23.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-03-27T08:37:23.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-03-27T08:37:23.839 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-03-27T08:37:23.843 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-03-27T08:37:23.848 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-03-27T08:37:23.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-03-27T08:37:23.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-03-27T08:37:23.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-03-27T08:37:23.864 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-03-27T08:37:23.868 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-03-27T08:37:23.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-03-27T08:37:23.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-03-27T08:37:23.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-03-27T08:37:23.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-03-27T08:37:23.895 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-03-27T08:37:23.898 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-03-27T08:37:23.901 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-03-27T08:37:23.906 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-03-27T08:37:23.911 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-03-27T08:37:23.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-03-27T08:37:23.919 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-03-27T08:37:23.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-03-27T08:37:23.929 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-03-27T08:37:23.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-03-27T08:37:23.939 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-03-27T08:37:23.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-03-27T08:37:23.948 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-03-27T08:37:23.954 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-03-27T08:37:23.958 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-03-27T08:37:23.962 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-03-27T08:37:23.967 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-03-27T08:37:23.970 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-03-27T08:37:23.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-03-27T08:37:23.978 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-03-27T08:37:23.982 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-03-27T08:37:23.987 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-03-27T08:37:23.991 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-03-27T08:37:23.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-03-27T08:37:24.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-03-27T08:37:24.005 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-03-27T08:37:24.012 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-03-27T08:37:24.019 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-03-27T08:37:24.027 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-03-27T08:37:24.033 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-03-27T08:37:24.042 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-03-27T08:37:24.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-03-27T08:37:24.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-03-27T08:37:24.066 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-03-27T08:37:24.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-03-27T08:37:24.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-03-27T08:37:24.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-03-27T08:37:24.095 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-03-27T08:37:24.104 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-03-27T08:37:24.112 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-03-27T08:37:24.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-03-27T08:37:24.127 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-03-27T08:37:24.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-03-27T08:37:24.144 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-03-27T08:37:24.152 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-03-27T08:37:24.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-03-27T08:37:24.167 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-03-27T08:37:24.174 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-03-27T08:37:24.183 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-03-27T08:37:24.190 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-03-27T08:37:24.209 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-03-27T08:37:24.264 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-03-27T08:37:24.272 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-03-27T08:37:24.279 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-03-27T08:37:24.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-03-27T08:37:24.292 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-03-27T08:37:24.298 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-03-27T08:37:24.305 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-03-27T08:37:24.314 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-03-27T08:37:24.321 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-03-27T08:37:24.331 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-03-27T08:37:24.338 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-03-27T08:37:24.346 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-03-27T08:37:24.353 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-03-27T08:37:24.364 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-03-27T08:37:24.372 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-03-27T08:37:24.381 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-03-27T08:37:24.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-03-27T08:37:24.396 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-03-27T08:37:24.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-03-27T08:37:24.412 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-03-27T08:37:24.421 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-03-27T08:37:24.427 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-03-27T08:37:24.438 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-03-27T08:37:24.445 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-03-27T08:37:24.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-03-27T08:37:24.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-03-27T08:37:24.458 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-03-27T08:37:24.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-03-27T08:37:24.466 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-03-27T08:37:24.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-03-27T08:37:24.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-03-27T08:37:24.480 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-03-27T08:37:24.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-03-27T08:37:24.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-03-27T08:37:24.494 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-03-27T08:37:24.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-03-27T08:37:24.505 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-03-27T08:37:24.512 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-03-27T08:37:24.519 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-03-27T08:37:24.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-03-27T08:37:24.532 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-03-27T08:37:24.537 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-03-27T08:37:24.542 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-03-27T08:37:24.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-03-27T08:37:24.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-03-27T08:37:24.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-03-27T08:37:24.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-03-27T08:37:24.603 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-03-27T08:37:24.769 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-03-27T08:37:24.790 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-03-27T08:37:24.808 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-03-27T08:37:24.824 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-03-27T08:37:24.843 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-03-27T08:37:24.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/digsig.txt 2024-03-27T08:37:24.886 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-03-27T08:37:24.893 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-03-27T08:37:24.898 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-03-27T08:37:24.904 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-03-27T08:37:24.910 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-03-27T08:37:24.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-03-27T08:37:24.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dontdiff 2024-03-27T08:37:24.933 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/ 2024-03-27T08:37:24.938 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-03-27T08:37:24.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-03-27T08:37:24.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-03-27T08:37:24.957 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-03-27T08:37:24.966 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-03-27T08:37:24.971 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-03-27T08:37:24.978 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-03-27T08:37:24.985 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-03-27T08:37:24.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-03-27T08:37:24.999 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-03-27T08:37:25.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:24 smithi164 ceph-mon[31788]: pgmap v503: 97 pgs: 97 active+clean; 91 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 684 KiB/s wr, 133 op/s 2024-03-27T08:37:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:24 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:37:25.007 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/ 2024-03-27T08:37:25.014 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-03-27T08:37:25.022 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-03-27T08:37:25.029 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-03-27T08:37:25.035 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-03-27T08:37:25.043 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-03-27T08:37:25.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-03-27T08:37:25.056 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-03-27T08:37:25.064 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-03-27T08:37:25.067 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:24 smithi167 ceph-mon[34903]: pgmap v503: 97 pgs: 97 active+clean; 91 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 684 KiB/s wr, 133 op/s 2024-03-27T08:37:25.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:24 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:37:25.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:24 smithi173 ceph-mon[35397]: pgmap v503: 97 pgs: 97 active+clean; 91 MiB data, 675 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 684 KiB/s wr, 133 op/s 2024-03-27T08:37:25.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:24 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:37:25.076 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-03-27T08:37:25.084 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-03-27T08:37:25.090 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-03-27T08:37:25.098 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-03-27T08:37:25.104 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-03-27T08:37:25.114 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-03-27T08:37:25.124 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-03-27T08:37:25.132 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-03-27T08:37:25.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-03-27T08:37:25.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-03-27T08:37:25.146 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/edac.txt 2024-03-27T08:37:25.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-03-27T08:37:25.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/eisa.txt 2024-03-27T08:37:25.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-03-27T08:37:25.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/extcon/ 2024-03-27T08:37:25.173 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-03-27T08:37:25.180 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-03-27T08:37:25.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-03-27T08:37:25.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-03-27T08:37:25.198 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-03-27T08:37:25.204 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/ 2024-03-27T08:37:25.216 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-03-27T08:37:25.220 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-03-27T08:37:25.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-03-27T08:37:25.229 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-03-27T08:37:25.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-03-27T08:37:25.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-03-27T08:37:25.246 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-03-27T08:37:25.253 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-03-27T08:37:25.260 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-03-27T08:37:25.266 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-03-27T08:37:25.275 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-03-27T08:37:25.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-03-27T08:37:25.293 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-03-27T08:37:25.301 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-03-27T08:37:25.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-03-27T08:37:25.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-03-27T08:37:25.324 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-03-27T08:37:25.334 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-03-27T08:37:25.341 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-03-27T08:37:25.347 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-03-27T08:37:25.355 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-03-27T08:37:25.362 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-03-27T08:37:25.369 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-03-27T08:37:25.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-03-27T08:37:25.385 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-03-27T08:37:25.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-03-27T08:37:25.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-03-27T08:37:25.413 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-03-27T08:37:25.422 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-03-27T08:37:25.429 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-03-27T08:37:25.438 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-03-27T08:37:25.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-03-27T08:37:25.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-03-27T08:37:25.467 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-03-27T08:37:25.476 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-03-27T08:37:25.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ 2024-03-27T08:37:25.491 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-03-27T08:37:25.498 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-03-27T08:37:25.507 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-03-27T08:37:25.515 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-03-27T08:37:25.527 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-03-27T08:37:25.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-03-27T08:37:25.542 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-03-27T08:37:25.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-03-27T08:37:25.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-03-27T08:37:25.572 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-03-27T08:37:25.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-03-27T08:37:25.592 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-03-27T08:37:25.601 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-03-27T08:37:25.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-03-27T08:37:25.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-03-27T08:37:25.620 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-03-27T08:37:25.631 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-03-27T08:37:25.643 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-03-27T08:37:25.654 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-03-27T08:37:25.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-03-27T08:37:25.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-03-27T08:37:25.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-03-27T08:37:25.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-03-27T08:37:25.705 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-03-27T08:37:25.713 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-03-27T08:37:25.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-03-27T08:37:25.740 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-03-27T08:37:25.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-03-27T08:37:25.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-03-27T08:37:25.767 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-03-27T08:37:25.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-03-27T08:37:25.791 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-03-27T08:37:25.799 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-03-27T08:37:25.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-03-27T08:37:25.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-03-27T08:37:25.829 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-03-27T08:37:25.840 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-03-27T08:37:25.849 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-03-27T08:37:25.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-03-27T08:37:25.863 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-03-27T08:37:25.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-03-27T08:37:25.880 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-03-27T08:37:25.889 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-03-27T08:37:25.896 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-03-27T08:37:25.905 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-03-27T08:37:25.913 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-03-27T08:37:25.921 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-03-27T08:37:25.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-03-27T08:37:25.939 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-03-27T08:37:25.950 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-03-27T08:37:25.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-03-27T08:37:25.972 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-03-27T08:37:25.980 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-03-27T08:37:25.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-03-27T08:37:25.998 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-03-27T08:37:26.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:37:26.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:37:26.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:25 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:37:26.006 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-03-27T08:37:26.016 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-03-27T08:37:26.025 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-03-27T08:37:26.034 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-03-27T08:37:26.044 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-03-27T08:37:26.053 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-03-27T08:37:26.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-03-27T08:37:26.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:37:26.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:37:26.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:25 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:37:26.068 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-03-27T08:37:26.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:37:26.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:37:26.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:25 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:37:26.076 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-03-27T08:37:26.083 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-03-27T08:37:26.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-03-27T08:37:26.099 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-03-27T08:37:26.105 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-03-27T08:37:26.113 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-03-27T08:37:26.123 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-03-27T08:37:26.131 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-03-27T08:37:26.139 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-03-27T08:37:26.147 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-03-27T08:37:26.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-03-27T08:37:26.166 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-03-27T08:37:26.175 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-03-27T08:37:26.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-03-27T08:37:26.194 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-03-27T08:37:26.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-03-27T08:37:26.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-03-27T08:37:26.231 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-03-27T08:37:26.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-03-27T08:37:26.252 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-03-27T08:37:26.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-03-27T08:37:26.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-03-27T08:37:26.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-03-27T08:37:26.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-03-27T08:37:26.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-03-27T08:37:26.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-03-27T08:37:26.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-03-27T08:37:26.317 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-03-27T08:37:26.326 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-03-27T08:37:26.338 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-03-27T08:37:26.359 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-03-27T08:37:26.369 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-03-27T08:37:26.379 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-03-27T08:37:26.389 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-03-27T08:37:26.400 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-03-27T08:37:26.410 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-03-27T08:37:26.424 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-03-27T08:37:26.436 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-03-27T08:37:26.447 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-03-27T08:37:26.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-03-27T08:37:26.464 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-03-27T08:37:26.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-03-27T08:37:26.478 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-03-27T08:37:26.485 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-03-27T08:37:26.492 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-03-27T08:37:26.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-03-27T08:37:26.507 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-03-27T08:37:26.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-03-27T08:37:26.522 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-03-27T08:37:26.536 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-03-27T08:37:26.550 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-03-27T08:37:26.560 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-03-27T08:37:26.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-03-27T08:37:26.579 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-03-27T08:37:26.587 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-03-27T08:37:26.599 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-03-27T08:37:26.612 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/ 2024-03-27T08:37:26.618 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-03-27T08:37:26.624 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-03-27T08:37:26.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-03-27T08:37:26.637 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-03-27T08:37:26.646 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-03-27T08:37:26.654 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-03-27T08:37:26.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-03-27T08:37:26.672 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-03-27T08:37:26.679 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-03-27T08:37:26.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-03-27T08:37:26.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-03-27T08:37:26.702 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/ 2024-03-27T08:37:26.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-03-27T08:37:26.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-03-27T08:37:26.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-03-27T08:37:26.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-03-27T08:37:26.738 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-03-27T08:37:26.747 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-03-27T08:37:26.756 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-03-27T08:37:26.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-03-27T08:37:26.774 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-03-27T08:37:26.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-03-27T08:37:26.793 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-03-27T08:37:26.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gcov.txt 2024-03-27T08:37:26.813 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-03-27T08:37:26.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/ 2024-03-27T08:37:26.824 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-03-27T08:37:26.833 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-03-27T08:37:26.842 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-03-27T08:37:26.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-03-27T08:37:26.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-03-27T08:37:26.871 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-03-27T08:37:26.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-03-27T08:37:26.887 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/ 2024-03-27T08:37:26.898 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-03-27T08:37:26.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-03-27T08:37:26.917 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-03-27T08:37:26.926 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-03-27T08:37:26.934 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-03-27T08:37:26.943 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/highuid.txt 2024-03-27T08:37:26.953 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hsi.txt 2024-03-27T08:37:26.960 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-03-27T08:37:26.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ 2024-03-27T08:37:26.977 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-03-27T08:37:26.984 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-03-27T08:37:26.992 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-03-27T08:37:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:26 smithi164 ceph-mon[31788]: pgmap v504: 97 pgs: 97 active+clean; 91 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 540 KiB/s wr, 133 op/s 2024-03-27T08:37:27.005 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-03-27T08:37:27.014 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-03-27T08:37:27.023 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-03-27T08:37:27.031 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-03-27T08:37:27.040 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-03-27T08:37:27.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-03-27T08:37:27.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-03-27T08:37:27.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-03-27T08:37:27.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:26 smithi167 ceph-mon[34903]: pgmap v504: 97 pgs: 97 active+clean; 91 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 540 KiB/s wr, 133 op/s 2024-03-27T08:37:27.072 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-03-27T08:37:27.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:26 smithi173 ceph-mon[35397]: pgmap v504: 97 pgs: 97 active+clean; 91 MiB data, 682 MiB used, 1.0 TiB / 1.0 TiB avail; 460 KiB/s rd, 540 KiB/s wr, 133 op/s 2024-03-27T08:37:27.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-03-27T08:37:27.092 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-03-27T08:37:27.101 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-03-27T08:37:27.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-03-27T08:37:27.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-03-27T08:37:27.126 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-03-27T08:37:27.135 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-03-27T08:37:27.143 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-03-27T08:37:27.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-03-27T08:37:27.159 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-03-27T08:37:27.168 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-03-27T08:37:27.176 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-03-27T08:37:27.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-03-27T08:37:27.193 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-03-27T08:37:27.202 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-03-27T08:37:27.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-03-27T08:37:27.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-03-27T08:37:27.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-03-27T08:37:27.237 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-03-27T08:37:27.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-03-27T08:37:27.249 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-03-27T08:37:27.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-03-27T08:37:27.263 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-03-27T08:37:27.271 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-03-27T08:37:27.278 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-03-27T08:37:27.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-03-27T08:37:27.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-03-27T08:37:27.302 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-03-27T08:37:27.311 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-03-27T08:37:27.319 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-03-27T08:37:27.331 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-03-27T08:37:27.340 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-03-27T08:37:27.347 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-03-27T08:37:27.357 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-03-27T08:37:27.364 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-03-27T08:37:27.373 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-03-27T08:37:27.382 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-03-27T08:37:27.390 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-03-27T08:37:27.399 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-03-27T08:37:27.410 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-03-27T08:37:27.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-03-27T08:37:27.428 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-03-27T08:37:27.438 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-03-27T08:37:27.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-03-27T08:37:27.456 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-03-27T08:37:27.465 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-03-27T08:37:27.472 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-03-27T08:37:27.481 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-03-27T08:37:27.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-03-27T08:37:27.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-03-27T08:37:27.505 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-03-27T08:37:27.513 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-03-27T08:37:27.521 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-03-27T08:37:27.530 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-03-27T08:37:27.539 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-03-27T08:37:27.546 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-03-27T08:37:27.555 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-03-27T08:37:27.564 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-03-27T08:37:27.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-03-27T08:37:27.582 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-03-27T08:37:27.590 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-03-27T08:37:27.598 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-03-27T08:37:27.607 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-03-27T08:37:27.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-03-27T08:37:27.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-03-27T08:37:27.629 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-03-27T08:37:27.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-03-27T08:37:27.644 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-03-27T08:37:27.651 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-03-27T08:37:27.659 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-03-27T08:37:27.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-03-27T08:37:27.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-03-27T08:37:27.682 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-03-27T08:37:27.689 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-03-27T08:37:27.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-03-27T08:37:27.702 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-03-27T08:37:27.711 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-03-27T08:37:27.720 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-03-27T08:37:27.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-03-27T08:37:27.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-03-27T08:37:27.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-03-27T08:37:27.755 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-03-27T08:37:27.761 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-03-27T08:37:27.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-03-27T08:37:27.778 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-03-27T08:37:27.787 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-03-27T08:37:27.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-03-27T08:37:27.806 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-03-27T08:37:27.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-03-27T08:37:27.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-03-27T08:37:27.830 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-03-27T08:37:27.840 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-03-27T08:37:27.850 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-03-27T08:37:27.859 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-03-27T08:37:27.870 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-03-27T08:37:27.878 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-03-27T08:37:27.887 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-03-27T08:37:27.894 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-03-27T08:37:27.904 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-03-27T08:37:27.913 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-03-27T08:37:27.922 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-03-27T08:37:27.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-03-27T08:37:27.938 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-03-27T08:37:27.945 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-03-27T08:37:27.953 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-03-27T08:37:27.961 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-03-27T08:37:27.968 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-03-27T08:37:27.977 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-03-27T08:37:27.989 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-03-27T08:37:27.997 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-03-27T08:37:28.005 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-03-27T08:37:28.013 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-03-27T08:37:28.023 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-03-27T08:37:28.031 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-03-27T08:37:28.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-03-27T08:37:28.046 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-03-27T08:37:28.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-03-27T08:37:28.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-03-27T08:37:28.072 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-03-27T08:37:28.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-03-27T08:37:28.089 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-03-27T08:37:28.096 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-03-27T08:37:28.104 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-03-27T08:37:28.112 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-03-27T08:37:28.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-03-27T08:37:28.131 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/ 2024-03-27T08:37:28.136 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-03-27T08:37:28.142 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-03-27T08:37:28.150 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-03-27T08:37:28.158 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-03-27T08:37:28.167 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-03-27T08:37:28.175 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-03-27T08:37:28.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-03-27T08:37:28.193 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-03-27T08:37:28.201 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-03-27T08:37:28.210 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-03-27T08:37:28.219 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-03-27T08:37:28.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-03-27T08:37:28.246 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-03-27T08:37:28.254 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-03-27T08:37:28.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-03-27T08:37:28.270 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-03-27T08:37:28.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-03-27T08:37:28.286 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-03-27T08:37:28.297 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-03-27T08:37:28.308 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-03-27T08:37:28.315 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-03-27T08:37:28.322 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-03-27T08:37:28.329 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-03-27T08:37:28.341 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-03-27T08:37:28.352 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-03-27T08:37:28.361 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-03-27T08:37:28.371 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-03-27T08:37:28.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-03-27T08:37:28.387 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-03-27T08:37:28.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-03-27T08:37:28.403 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-03-27T08:37:28.414 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-03-27T08:37:28.423 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/summary 2024-03-27T08:37:28.430 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-03-27T08:37:28.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-03-27T08:37:28.446 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-03-27T08:37:28.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2o/ 2024-03-27T08:37:28.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2o/README 2024-03-27T08:37:28.471 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-03-27T08:37:28.480 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/ 2024-03-27T08:37:28.490 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-03-27T08:37:28.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-03-27T08:37:28.511 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-03-27T08:37:28.518 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/README 2024-03-27T08:37:28.526 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-03-27T08:37:28.535 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-03-27T08:37:28.542 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-03-27T08:37:28.550 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-03-27T08:37:28.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-03-27T08:37:28.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-03-27T08:37:28.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-03-27T08:37:28.585 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-03-27T08:37:28.593 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ 2024-03-27T08:37:28.600 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-03-27T08:37:28.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-03-27T08:37:28.616 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-03-27T08:37:28.624 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-03-27T08:37:28.633 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-03-27T08:37:28.640 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-03-27T08:37:28.650 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-03-27T08:37:28.659 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/ 2024-03-27T08:37:28.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-03-27T08:37:28.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-03-27T08:37:28.683 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-03-27T08:37:28.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-03-27T08:37:28.698 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-03-27T08:37:28.705 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/init.txt 2024-03-27T08:37:28.715 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/initrd.txt 2024-03-27T08:37:28.724 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/ 2024-03-27T08:37:28.730 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-03-27T08:37:28.738 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-03-27T08:37:28.748 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-03-27T08:37:28.756 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-03-27T08:37:28.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-03-27T08:37:28.776 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-03-27T08:37:28.784 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-03-27T08:37:28.793 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-03-27T08:37:28.802 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-03-27T08:37:28.809 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-03-27T08:37:28.820 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-03-27T08:37:28.830 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-03-27T08:37:28.839 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-03-27T08:37:28.848 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-03-27T08:37:28.856 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-03-27T08:37:28.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-03-27T08:37:28.874 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-03-27T08:37:28.886 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/input.txt 2024-03-27T08:37:28.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-03-27T08:37:28.906 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-03-27T08:37:28.914 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-03-27T08:37:28.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-03-27T08:37:28.933 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-03-27T08:37:28.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-03-27T08:37:28.952 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-03-27T08:37:28.961 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-03-27T08:37:28.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-03-27T08:37:28.982 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-03-27T08:37:28.991 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-03-27T08:37:28.999 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-03-27T08:37:29.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:28 smithi164 ceph-mon[31788]: pgmap v505: 97 pgs: 97 active+clean; 92 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 594 KiB/s wr, 129 op/s 2024-03-27T08:37:29.007 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-03-27T08:37:29.019 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-03-27T08:37:29.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-03-27T08:37:29.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-03-27T08:37:29.045 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/ 2024-03-27T08:37:29.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-03-27T08:37:29.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-03-27T08:37:29.066 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-03-27T08:37:29.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:28 smithi167 ceph-mon[34903]: pgmap v505: 97 pgs: 97 active+clean; 92 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 594 KiB/s wr, 129 op/s 2024-03-27T08:37:29.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:28 smithi173 ceph-mon[35397]: pgmap v505: 97 pgs: 97 active+clean; 92 MiB data, 688 MiB used, 1.0 TiB / 1.0 TiB avail; 499 KiB/s rd, 594 KiB/s wr, 129 op/s 2024-03-27T08:37:29.075 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-03-27T08:37:29.086 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-03-27T08:37:29.094 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-03-27T08:37:29.102 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/iostats.txt 2024-03-27T08:37:29.113 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-03-27T08:37:29.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-03-27T08:37:29.128 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/ 2024-03-27T08:37:29.133 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-03-27T08:37:29.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-03-27T08:37:29.147 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-03-27T08:37:29.155 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-03-27T08:37:29.169 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-03-27T08:37:29.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-03-27T08:37:29.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README 2024-03-27T08:37:29.197 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-03-27T08:37:29.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-03-27T08:37:29.218 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-03-27T08:37:29.226 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-03-27T08:37:29.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-03-27T08:37:29.241 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-03-27T08:37:29.260 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-03-27T08:37:29.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-03-27T08:37:29.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-03-27T08:37:29.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-03-27T08:37:29.292 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-03-27T08:37:29.300 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-03-27T08:37:29.309 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-03-27T08:37:29.316 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-03-27T08:37:29.324 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-03-27T08:37:29.333 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-03-27T08:37:29.341 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-03-27T08:37:29.349 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-03-27T08:37:29.357 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-03-27T08:37:29.364 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-03-27T08:37:29.375 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-03-27T08:37:29.386 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-03-27T08:37:29.398 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-03-27T08:37:29.408 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-03-27T08:37:29.417 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/java.txt 2024-03-27T08:37:29.430 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kasan.txt 2024-03-27T08:37:29.442 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/ 2024-03-27T08:37:29.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-03-27T08:37:29.461 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-03-27T08:37:29.469 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-03-27T08:37:29.481 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-03-27T08:37:29.491 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-03-27T08:37:29.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-03-27T08:37:29.515 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-03-27T08:37:29.525 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kdump/ 2024-03-27T08:37:29.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-03-27T08:37:29.541 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-03-27T08:37:29.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-03-27T08:37:29.563 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-03-27T08:37:29.576 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-03-27T08:37:29.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-03-27T08:37:29.613 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-03-27T08:37:29.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-03-27T08:37:29.634 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-03-27T08:37:29.640 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-03-27T08:37:29.653 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-03-27T08:37:29.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kobject.txt 2024-03-27T08:37:29.674 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-03-27T08:37:29.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kref.txt 2024-03-27T08:37:29.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-03-27T08:37:29.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/ 2024-03-27T08:37:29.704 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-03-27T08:37:29.712 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-03-27T08:37:29.720 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-03-27T08:37:29.728 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-03-27T08:37:29.736 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-03-27T08:37:29.746 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-03-27T08:37:29.755 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-03-27T08:37:29.763 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-03-27T08:37:29.775 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-03-27T08:37:29.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-03-27T08:37:29.792 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-03-27T08:37:29.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-03-27T08:37:29.815 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ldm.txt 2024-03-27T08:37:29.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/ 2024-03-27T08:37:29.836 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-03-27T08:37:29.846 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-03-27T08:37:29.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-03-27T08:37:29.860 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-03-27T08:37:29.868 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-03-27T08:37:29.879 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-03-27T08:37:29.889 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-03-27T08:37:29.898 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-03-27T08:37:29.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-03-27T08:37:29.919 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-03-27T08:37:29.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-03-27T08:37:29.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-03-27T08:37:29.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/ 2024-03-27T08:37:29.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-03-27T08:37:29.964 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-03-27T08:37:29.972 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-03-27T08:37:29.981 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-03-27T08:37:29.993 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-03-27T08:37:30.004 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-03-27T08:37:30.014 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-03-27T08:37:30.028 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-03-27T08:37:30.034 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-03-27T08:37:30.043 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-03-27T08:37:30.051 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-03-27T08:37:30.071 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/logo.gif 2024-03-27T08:37:30.083 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/logo.txt 2024-03-27T08:37:30.094 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/lzo.txt 2024-03-27T08:37:30.102 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/m68k/ 2024-03-27T08:37:30.109 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-03-27T08:37:30.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-03-27T08:37:30.132 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-03-27T08:37:30.146 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-03-27T08:37:30.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-03-27T08:37:30.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/md.txt 2024-03-27T08:37:30.181 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-03-27T08:37:30.190 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-03-27T08:37:30.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:37:30.273 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:37:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 -- 172.21.15.164:0/3869098271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c104f60 msgr2=0x7f536c1053e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 --2- 172.21.15.164:0/3869098271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c104f60 0x7f536c1053e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f5358009900 tx=0x7f535802bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 -- 172.21.15.164:0/3869098271 shutdown_connections 2024-03-27T08:37:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 --2- 172.21.15.164:0/3869098271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c10c1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.500 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 --2- 172.21.15.164:0/3869098271 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c104f60 0x7f536c1053e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 --2- 172.21.15.164:0/3869098271 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c103d70 0x7f536c104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 -- 172.21.15.164:0/3869098271 >> 172.21.15.164:0/3869098271 conn(0x7f536c0ff300 msgr2=0x7f536c101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 -- 172.21.15.164:0/3869098271 shutdown_connections 2024-03-27T08:37:30.501 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.508+0000 7f5373a00640 1 -- 172.21.15.164:0/3869098271 wait complete. 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 Processor -- start 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 -- start start 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c104f60 0x7f536c19a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c1a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10fa20 con 0x7f536c103d70 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10f8a0 con 0x7f536c105920 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.510+0000 7f5373a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f536c10fba0 con 0x7f536c104f60 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55388/0 (socket says 172.21.15.164:55388) 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c1a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 -- 172.21.15.164:0/3379099517 learned_addr learned my addr 172.21.15.164:0/3379099517 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.503 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f536be00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c104f60 0x7f536c19a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 -- 172.21.15.164:0/3379099517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c104f60 msgr2=0x7f536c19a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c104f60 0x7f536c19a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 -- 172.21.15.164:0/3379099517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 msgr2=0x7f536c1a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c1a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 -- 172.21.15.164:0/3379099517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f536c1a1c90 con 0x7f536c103d70 2024-03-27T08:37:30.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.511+0000 7f5371000640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f536000d950 tx=0x7f536000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.512+0000 7f5369600640 1 -- 172.21.15.164:0/3379099517 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5360017070 con 0x7f536c103d70 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.512+0000 7f5369600640 1 -- 172.21.15.164:0/3379099517 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5360009c30 con 0x7f536c103d70 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.512+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f536c1a1f80 con 0x7f536c103d70 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.512+0000 7f5369600640 1 -- 172.21.15.164:0/3379099517 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536000f620 con 0x7f536c103d70 2024-03-27T08:37:30.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.512+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f536c1a23e0 con 0x7f536c103d70 2024-03-27T08:37:30.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.515+0000 7f5376669740 1 Processor -- start 2024-03-27T08:37:30.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.515+0000 7f5369600640 1 -- 172.21.15.164:0/3379099517 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f536001a070 con 0x7f536c103d70 2024-03-27T08:37:30.507 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.515+0000 7f5376669740 1 -- start start 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008e29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008e3010 0x55eb008e54a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb008436b0 con 0x55eb008ddea0 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb007eb750 con 0x55eb008dd4b0 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5376669740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb0083f660 con 0x55eb008e3010 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5371000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008e29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5371a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.509 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5371000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008e29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55404/0 (socket says 172.21.15.164:55404) 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5371000640 1 -- 172.21.15.164:0/3384151671 learned_addr learned my addr 172.21.15.164:0/3384151671 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f5371a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35336/0 (socket says 172.21.15.164:35336) 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.516+0000 7f536be00640 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008e3010 0x55eb008e54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 -- 172.21.15.164:0/3384151671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008e3010 msgr2=0x55eb008e54a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008e3010 0x55eb008e54a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 -- 172.21.15.164:0/3384151671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 msgr2=0x55eb008e29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008e29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 -- 172.21.15.164:0/3384151671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb006217d0 con 0x55eb008dd4b0 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371a00640 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5364005fd0 tx=0x7f5364011bf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6352c2b20fc31a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5369600640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 0x7f53540a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5371000640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 0x7f53540a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f535e000640 1 -- 172.21.15.164:0/3384151671 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364004d20 con 0x55eb008dd4b0 2024-03-27T08:37:30.510 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.517+0000 7f5369600640 1 -- 172.21.15.164:0/3379099517 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f53600cf6f0 con 0x7f536c103d70 2024-03-27T08:37:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f535e000640 1 -- 172.21.15.164:0/3384151671 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f536400f9a0 con 0x55eb008dd4b0 2024-03-27T08:37:30.511 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f535e000640 1 -- 172.21.15.164:0/3384151671 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5364004440 con 0x55eb008dd4b0 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 -- 172.21.15.164:0/3384151671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 msgr2=0x55eb008dd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5371000640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 0x7f53540a5b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5360098030 tx=0x7f53600d5550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5364005fd0 tx=0x7f5364011bf0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 -- 172.21.15.164:0/3384151671 shutdown_connections 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008e3010 0x55eb008e54a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.514 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008e29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 --2- 172.21.15.164:0/3384151671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008dd4b0 0x55eb008dd8d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.518+0000 7f5376669740 1 -- 172.21.15.164:0/3384151671 >> 172.21.15.164:0/3384151671 conn(0x55eb008d8a20 msgr2=0x55eb008d8e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.519+0000 7f5376669740 1 -- 172.21.15.164:0/3384151671 shutdown_connections 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.519+0000 7f5376669740 1 -- 172.21.15.164:0/3384151671 wait complete. 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.519+0000 7f5376669740 1 -- start start 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.519+0000 7f5376669740 1 Processor -- start 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008e7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 0x55eb008e7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55eb008e5fc0 con 0x55eb008e3010 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb007fea80 con 0x55eb008ddea0 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55eb008e6140 con 0x55eb008dd4b0 2024-03-27T08:37:30.515 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5376669740 10 client.0 _ll_register_callbacks cb 0x55eb007fe470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5371a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f536be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 0x55eb008e7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5371a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55408/0 (socket says 172.21.15.164:55408) 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5371a00640 1 -- 172.21.15.164:0/1612626267 learned_addr learned my addr 172.21.15.164:0/1612626267 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f536be00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 0x55eb008e7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35352/0 (socket says 172.21.15.164:35352) 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.520+0000 7f5371a00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008e7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 -- 172.21.15.164:0/1612626267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 msgr2=0x55eb008e7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008e7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 -- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 msgr2=0x55eb008e7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 0x55eb008e7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 -- 172.21.15.164:0/1612626267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb005573f0 con 0x55eb008e3010 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5371a00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f536400ff90 tx=0x7f5364005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9327fc31ffd684b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.516 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5352a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f536401e040 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f53640041c0 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f536400f9a0 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5364003e30 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5376669740 10 client.15942 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.521+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eb005170f0 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f536400f9a0 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5364024070 con 0x55eb008e3010 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 10 client.15942 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 10 client.15942 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 20 client.15942 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb008f35c0 0x55eb008f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 4 client.15942 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb00850bf0 con 0x55eb008f35c0 2024-03-27T08:37:30.517 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.522+0000 7f536be00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb008f35c0 0x55eb008f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.523+0000 7f536be00640 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb008f35c0 0x55eb008f59f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=121923d7189bb55d server_cookie=20501bb755574c57 in_seq=0 out_seq=0 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.523+0000 7f5352a00640 10 client.15942 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.525+0000 7f5352a00640 1 -- 172.21.15.164:0/1612626267 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55eb00850bf0 con 0x55eb008f35c0 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.525+0000 7f5352a00640 10 client.15942 handle_command_reply: tid=0 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.525+0000 7f5376669740 1 client.15942 shutdown 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 msgr2=0x55eb008eeee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f536400ff90 tx=0x7f5364005bd0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 shutdown_connections 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb008f35c0 0x55eb008f59f0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008e3010 0x55eb008eeee0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.519 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008ddea0 0x55eb008e7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 --2- 172.21.15.164:0/1612626267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008e7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5352a00640 0 client.15942 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 >> 172.21.15.164:0/1612626267 conn(0x55eb008d8a20 msgr2=0x55eb008d7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 shutdown_connections 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 1 -- 172.21.15.164:0/1612626267 wait complete. 2024-03-27T08:37:30.520 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.526+0000 7f5376669740 20 client.15942 trim_cache size 0 max 16384 2024-03-27T08:37:30.537 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 Processor -- start 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 -- start start 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008d3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008d7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1ada80 con 0x55eb008ddea0 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1ab350 con 0x55eb008e3010 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f5376669740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1a91a0 con 0x55eb008dd4b0 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.545+0000 7f536be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55412/0 (socket says 172.21.15.164:55412) 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f5371a00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008d7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 -- 172.21.15.164:0/3843765332 learned_addr learned my addr 172.21.15.164:0/3843765332 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f5371a00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008d3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 -- 172.21.15.164:0/3843765332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 msgr2=0x55eb008d3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008d3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 -- 172.21.15.164:0/3843765332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 msgr2=0x55eb008d7390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008d7390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 -- 172.21.15.164:0/3843765332 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb008e6290 con 0x55eb008ddea0 2024-03-27T08:37:30.539 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f5371a00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008d7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:30.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.546+0000 7f536be00640 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5358009900 tx=0x7f5358009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792cfb4c8b9a8e27 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f535d600640 1 -- 172.21.15.164:0/3843765332 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358047070 con 0x55eb008ddea0 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f535d600640 1 -- 172.21.15.164:0/3843765332 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5358004040 con 0x55eb008ddea0 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f535d600640 1 -- 172.21.15.164:0/3843765332 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5358005040 con 0x55eb008ddea0 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 -- 172.21.15.164:0/3843765332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 msgr2=0x55eb008eeea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5358009900 tx=0x7f5358009620 comp rx=0 tx=0).stop 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 -- 172.21.15.164:0/3843765332 shutdown_connections 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008d7390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008eeea0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 --2- 172.21.15.164:0/3843765332 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008d3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.547+0000 7f5376669740 1 -- 172.21.15.164:0/3843765332 >> 172.21.15.164:0/3843765332 conn(0x55eb008d8a20 msgr2=0x55eb008d8e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.548+0000 7f5376669740 1 -- 172.21.15.164:0/3843765332 shutdown_connections 2024-03-27T08:37:30.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.548+0000 7f5376669740 1 -- 172.21.15.164:0/3843765332 wait complete. 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.548+0000 7f5376669740 1 -- start start 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.548+0000 7f5376669740 1 Processor -- start 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008ec720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008edc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1a9810 con 0x55eb008ddea0 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1aac80 con 0x55eb008e3010 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f536c1a9ee0 con 0x55eb008dd4b0 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5376669740 10 client.0 _ll_register_callbacks cb 0x7f536400fe50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55426/0 (socket says 172.21.15.164:55426) 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 -- 172.21.15.164:0/1324456716 learned_addr learned my addr 172.21.15.164:0/1324456716 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5371a00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008edc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 -- 172.21.15.164:0/1324456716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 msgr2=0x55eb008ec720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008ec720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 -- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 msgr2=0x55eb008edc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008edc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f536be00640 1 -- 172.21.15.164:0/1324456716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb008ee260 con 0x55eb008ddea0 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.549+0000 7f5371a00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f536be00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5358005ab0 tx=0x7f535802cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b87efea8510b72d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5352a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53580043f0 con 0x55eb008ddea0 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f5358049ab0 con 0x55eb008ddea0 2024-03-27T08:37:30.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5358004040 con 0x55eb008ddea0 2024-03-27T08:37:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5358049cb0 con 0x55eb008ddea0 2024-03-27T08:37:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5376669740 10 client.15948 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.550+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55eb00959a10 con 0x55eb008ddea0 2024-03-27T08:37:30.546 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5358004040 con 0x55eb008ddea0 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f5358004b40 con 0x55eb008ddea0 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 10 client.15948 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 10 client.15948 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 20 client.15948 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb0095a440 0x55eb0095c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 4 client.15948 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55eb0084af40 con 0x55eb0095a440 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.551+0000 7f5371a00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb0095a440 0x55eb0095c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.552+0000 7f5371a00640 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb0095a440 0x55eb0095c860 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=178954e5942454a2 server_cookie=1f7991eb4ed01283 in_seq=0 out_seq=0 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.552+0000 7f5352a00640 10 client.15948 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.552+0000 7f5352a00640 1 -- 172.21.15.164:0/1324456716 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55eb0084af40 con 0x55eb0095a440 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.552+0000 7f5352a00640 10 client.15948 handle_command_reply: tid=0 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.552+0000 7f5376669740 1 client.15948 shutdown 2024-03-27T08:37:30.547 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 msgr2=0x55eb008ecc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5358005ab0 tx=0x7f535802cc70 comp rx=0 tx=0).stop 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 shutdown_connections 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55eb0095a440 0x55eb0095c860 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb008e3010 0x55eb008edc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55eb008ddea0 0x55eb008ecc60 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 --2- 172.21.15.164:0/1324456716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55eb008dd4b0 0x55eb008ec720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5352a00640 0 client.15948 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 >> 172.21.15.164:0/1324456716 conn(0x55eb008d8a20 msgr2=0x55eb008df360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 shutdown_connections 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 1 -- 172.21.15.164:0/1324456716 wait complete. 2024-03-27T08:37:30.548 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.553+0000 7f5376669740 20 client.15948 trim_cache size 0 max 16384 2024-03-27T08:37:30.549 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:37:30.549 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "no active scrubs running", 2024-03-27T08:37:30.549 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": {} 2024-03-27T08:37:30.549 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:37:30.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 msgr2=0x7f53540a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 0x7f53540a5b50 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5360098030 tx=0x7f53600d5550 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 msgr2=0x7f536c19a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f536000d950 tx=0x7f536000de10 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 shutdown_connections 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f53540a3690 0x7f53540a5b50 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f536c105920 0x7f536c1a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f536c104f60 0x7f536c19a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 --2- 172.21.15.164:0/3379099517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f536c103d70 0x7f536c19a070 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 >> 172.21.15.164:0/3379099517 conn(0x7f536c0ff300 msgr2=0x7f536c108260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 shutdown_connections 2024-03-27T08:37:30.550 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.554+0000 7f5373a00640 1 -- 172.21.15.164:0/3379099517 wait complete. 2024-03-27T08:37:30.562 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-03-27T08:37:30.566 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T08:37:30.567 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:37:30.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-03-27T08:37:30.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-03-27T08:37:30.582 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/metag/ 2024-03-27T08:37:30.585 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-03-27T08:37:30.589 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-03-27T08:37:30.594 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/ 2024-03-27T08:37:30.598 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-03-27T08:37:30.603 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-03-27T08:37:30.607 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-03-27T08:37:30.610 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-03-27T08:37:30.614 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-03-27T08:37:30.619 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-03-27T08:37:30.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-03-27T08:37:30.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-03-27T08:37:30.635 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-03-27T08:37:30.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-03-27T08:37:30.648 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mips/ 2024-03-27T08:37:30.655 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-03-27T08:37:30.660 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-03-27T08:37:30.664 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-03-27T08:37:30.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-03-27T08:37:30.676 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-03-27T08:37:30.680 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-03-27T08:37:30.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-03-27T08:37:30.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-03-27T08:37:30.699 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-03-27T08:37:30.705 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-03-27T08:37:30.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-03-27T08:37:30.716 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-03-27T08:37:30.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-03-27T08:37:30.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-03-27T08:37:30.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-03-27T08:37:30.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-03-27T08:37:30.743 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-03-27T08:37:30.750 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-03-27T08:37:30.757 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-03-27T08:37:30.764 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-03-27T08:37:30.772 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-03-27T08:37:30.780 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mmc/ 2024-03-27T08:37:30.785 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-03-27T08:37:30.789 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-03-27T08:37:30.793 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.801+0000 7f744aa00640 1 -- 172.21.15.164:0/3989901195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7444105fc0 msgr2=0x7f74441083b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.801+0000 7f744aa00640 1 --2- 172.21.15.164:0/3989901195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7444105fc0 0x7f74441083b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f743c009900 tx=0x7f743c02bc40 comp rx=0 tx=0).stop 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.801+0000 7f744aa00640 1 -- 172.21.15.164:0/3989901195 shutdown_connections 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.801+0000 7f744aa00640 1 --2- 172.21.15.164:0/3989901195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7444105fc0 0x7f74441083b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.802+0000 7f744aa00640 1 --2- 172.21.15.164:0/3989901195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f74441012c0 0x7f7444101740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.802+0000 7f744aa00640 1 --2- 172.21.15.164:0/3989901195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f7444100d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.802+0000 7f744aa00640 1 -- 172.21.15.164:0/3989901195 >> 172.21.15.164:0/3989901195 conn(0x7f74440fb100 msgr2=0x7f74440fd540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.802+0000 7f744aa00640 1 -- 172.21.15.164:0/3989901195 shutdown_connections 2024-03-27T08:37:30.794 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.802+0000 7f744aa00640 1 -- 172.21.15.164:0/3989901195 wait complete. 2024-03-27T08:37:30.795 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 Processor -- start 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 -- start start 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74441012c0 0x7f7444109d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7444105fc0 0x7f744410a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f744410d620 con 0x7f7444067fd0 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f744410d4a0 con 0x7f74441012c0 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.803+0000 7f744aa00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f744410d7a0 con 0x7f7444105fc0 2024-03-27T08:37:30.797 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55448/0 (socket says 172.21.15.164:55448) 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 -- 172.21.15.164:0/1519359997 learned_addr learned my addr 172.21.15.164:0/1519359997 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7448c00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74441012c0 0x7f7444109d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f744a000640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7444105fc0 0x7f744410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 -- 172.21.15.164:0/1519359997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7444105fc0 msgr2=0x7f744410a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7444105fc0 0x7f744410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 -- 172.21.15.164:0/1519359997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74441012c0 msgr2=0x7f7444109d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74441012c0 0x7f7444109d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 -- 172.21.15.164:0/1519359997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f744410ab10 con 0x7f7444067fd0 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.804+0000 7f7449600640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f743400d950 tx=0x7f743400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.798 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.805+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7434017020 con 0x7f7444067fd0 2024-03-27T08:37:30.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.805+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74441a1ce0 con 0x7f7444067fd0 2024-03-27T08:37:30.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.805+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7434009c30 con 0x7f7444067fd0 2024-03-27T08:37:30.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.805+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f743400f6b0 con 0x7f7444067fd0 2024-03-27T08:37:30.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.805+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74441a21d0 con 0x7f7444067fd0 2024-03-27T08:37:30.799 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-03-27T08:37:30.799 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.806+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7444104dd0 con 0x7f7444067fd0 2024-03-27T08:37:30.800 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.808+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f743401a020 con 0x7f7444067fd0 2024-03-27T08:37:30.801 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mn10300/ 2024-03-27T08:37:30.801 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.810+0000 7f7442000640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 0x7f742c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.810+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f74340d0110 con 0x7f7444067fd0 2024-03-27T08:37:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.810+0000 7f7448c00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 0x7f742c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:30.802 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.811+0000 7f7448c00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 0x7f742c0a5ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f744410b470 tx=0x7f7438007600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:30.804 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-03-27T08:37:30.804 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:30.813+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f7434021020 con 0x7f7444067fd0 2024-03-27T08:37:30.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-03-27T08:37:30.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-03-27T08:37:30.816 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mono.txt 2024-03-27T08:37:30.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mtd/ 2024-03-27T08:37:30.825 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-03-27T08:37:30.828 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-03-27T08:37:30.833 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-03-27T08:37:30.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-03-27T08:37:30.847 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/namespaces/ 2024-03-27T08:37:30.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-03-27T08:37:30.858 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-03-27T08:37:30.864 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/ 2024-03-27T08:37:30.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-03-27T08:37:30.874 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-03-27T08:37:30.877 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:30 smithi173 ceph-mon[35397]: pgmap v506: 97 pgs: 97 active+clean; 96 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 791 KiB/s wr, 145 op/s 2024-03-27T08:37:30.879 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-03-27T08:37:30.888 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-03-27T08:37:30.894 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-03-27T08:37:30.901 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ 2024-03-27T08:37:30.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-03-27T08:37:30.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-03-27T08:37:30.923 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-03-27T08:37:30.931 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-03-27T08:37:30.937 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-03-27T08:37:30.945 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-03-27T08:37:30.954 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-03-27T08:37:30.963 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-03-27T08:37:30.973 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-03-27T08:37:30.979 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-03-27T08:37:30.987 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-03-27T08:37:30.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-03-27T08:37:31.002 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-03-27T08:37:31.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:30 smithi164 ceph-mon[31788]: pgmap v506: 97 pgs: 97 active+clean; 96 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 791 KiB/s wr, 145 op/s 2024-03-27T08:37:31.009 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-03-27T08:37:31.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-03-27T08:37:31.041 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-03-27T08:37:31.048 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-03-27T08:37:31.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-03-27T08:37:31.063 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-03-27T08:37:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:30 smithi167 ceph-mon[34903]: pgmap v506: 97 pgs: 97 active+clean; 96 MiB data, 702 MiB used, 1.0 TiB / 1.0 TiB avail; 431 KiB/s rd, 791 KiB/s wr, 145 op/s 2024-03-27T08:37:31.073 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-03-27T08:37:31.087 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.095+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f744402d540 con 0x7f7444067fd0 2024-03-27T08:37:31.088 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.097+0000 7f7442000640 1 -- 172.21.15.164:0/1519359997 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11891 (secure 0 0 0) 0x7f7434009de0 con 0x7f7444067fd0 2024-03-27T08:37:31.089 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:37:31.089 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:37:11.330796+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:37:31.089 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 26 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 msgr2=0x7f742c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 0x7f742c0a5ad0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f744410b470 tx=0x7f7438007600 comp rx=0 tx=0).stop 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 msgr2=0x7f744410b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f743400d950 tx=0x7f743400de10 comp rx=0 tx=0).stop 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 shutdown_connections 2024-03-27T08:37:31.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f742c0a3610 0x7f742c0a5ad0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.099+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7444105fc0 0x7f744410a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.100+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74441012c0 0x7f7444109d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.100+0000 7f744aa00640 1 --2- 172.21.15.164:0/1519359997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7444067fd0 0x7f744410b700 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.100+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 >> 172.21.15.164:0/1519359997 conn(0x7f74440fb100 msgr2=0x7f7444101fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.100+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 shutdown_connections 2024-03-27T08:37:31.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.100+0000 7f744aa00640 1 -- 172.21.15.164:0/1519359997 wait complete. 2024-03-27T08:37:31.092 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-03-27T08:37:31.096 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-03-27T08:37:31.099 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-03-27T08:37:31.105 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-03-27T08:37:31.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T08:37:31.112 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-03-27T08:37:31.120 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-03-27T08:37:31.131 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-03-27T08:37:31.138 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-03-27T08:37:31.143 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-03-27T08:37:31.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-03-27T08:37:31.152 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-03-27T08:37:31.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-03-27T08:37:31.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-03-27T08:37:31.168 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-03-27T08:37:31.172 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-03-27T08:37:31.177 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-03-27T08:37:31.182 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-03-27T08:37:31.188 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-03-27T08:37:31.195 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-03-27T08:37:31.200 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-03-27T08:37:31.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-03-27T08:37:31.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-03-27T08:37:31.217 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-03-27T08:37:31.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-03-27T08:37:31.232 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-03-27T08:37:31.238 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-03-27T08:37:31.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-03-27T08:37:31.254 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-03-27T08:37:31.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-03-27T08:37:31.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 -- 172.21.15.164:0/1339767385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 msgr2=0x7fe2b0105400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/1339767385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b0105400 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fe298009900 tx=0x7fe29802bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 -- 172.21.15.164:0/1339767385 shutdown_connections 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/1339767385 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 0x7fe2b010c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/1339767385 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b0105400 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/1339767385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b01041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 -- 172.21.15.164:0/1339767385 >> 172.21.15.164:0/1339767385 conn(0x7fe2b00ff300 msgr2=0x7fe2b0101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 -- 172.21.15.164:0/1339767385 shutdown_connections 2024-03-27T08:37:31.342 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.350+0000 7fe2b4e00640 1 -- 172.21.15.164:0/1339767385 wait complete. 2024-03-27T08:37:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 Processor -- start 2024-03-27T08:37:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 -- start start 2024-03-27T08:37:31.344 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b019a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 0x7fe2b01a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b010fa50 con 0x7fe2b0104f80 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b010f8d0 con 0x7fe2b0103d90 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.351+0000 7fe2b4e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b010fbd0 con 0x7fe2b0105940 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55464/0 (socket says 172.21.15.164:55464) 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2ade00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b019a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 -- 172.21.15.164:0/2358176458 learned_addr learned my addr 172.21.15.164:0/2358176458 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2ae800640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 0x7fe2b01a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 -- 172.21.15.164:0/2358176458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 msgr2=0x7fe2b01a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 0x7fe2b01a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.345 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 -- 172.21.15.164:0/2358176458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 msgr2=0x7fe2b019a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b019a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 -- 172.21.15.164:0/2358176458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b01a1cc0 con 0x7fe2b0104f80 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.352+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe298000c00 tx=0x7fe298004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.353+0000 7fe2a7400640 1 -- 172.21.15.164:0/2358176458 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298043020 con 0x7fe2b0104f80 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.353+0000 7fe2a7400640 1 -- 172.21.15.164:0/2358176458 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe298005460 con 0x7fe2b0104f80 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.353+0000 7fe2a7400640 1 -- 172.21.15.164:0/2358176458 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298003d00 con 0x7fe2b0104f80 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.353+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b01a1f50 con 0x7fe2b0104f80 2024-03-27T08:37:31.346 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.353+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b01a23c0 con 0x7fe2b0104f80 2024-03-27T08:37:31.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.356+0000 7fe2b7a7b740 1 Processor -- start 2024-03-27T08:37:31.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.356+0000 7fe2a7400640 1 -- 172.21.15.164:0/2358176458 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fe298046020 con 0x7fe2b0104f80 2024-03-27T08:37:31.348 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.356+0000 7fe2b7a7b740 1 -- start start 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfd4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd5420 0x55949dfd78b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55949df977b0 con 0x55949dfcf8c0 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55949df34670 con 0x55949dfd02b0 2024-03-27T08:37:31.349 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55949dedc970 con 0x55949dfd5420 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55472/0 (socket says 172.21.15.164:55472) 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 -- 172.21.15.164:0/3132593077 learned_addr learned my addr 172.21.15.164:0/3132593077 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ade00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfd4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 -- 172.21.15.164:0/3132593077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd5420 msgr2=0x55949dfd78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd5420 0x55949dfd78b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 -- 172.21.15.164:0/3132593077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 msgr2=0x55949dfd4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfd4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.357+0000 7fe2ae800640 1 -- 172.21.15.164:0/3132593077 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55949dc483f0 con 0x55949dfcf8c0 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe2a7400640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 0x7fe2940a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.350 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe2ae800640 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8008d00 tx=0x7fe2a800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c9db6cd9a299d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe2a7400640 1 -- 172.21.15.164:0/2358176458 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe2980f1f80 con 0x7fe2b0104f80 2024-03-27T08:37:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 0x7fe2940a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.353 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe29f400640 1 -- 172.21.15.164:0/3132593077 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a8018680 con 0x55949dfcf8c0 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe29f400640 1 -- 172.21.15.164:0/3132593077 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2a800f8f0 con 0x55949dfcf8c0 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.358+0000 7fe29f400640 1 -- 172.21.15.164:0/3132593077 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a800ea10 con 0x55949dfcf8c0 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/3132593077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 msgr2=0x55949dfcfce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 0x7fe2940a5ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55949dfd06b0 tx=0x7fe2a0005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fe2a8008d00 tx=0x7fe2a800d710 comp rx=0 tx=0).stop 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/3132593077 shutdown_connections 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd5420 0x55949dfd78b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfd4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/3132593077 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfcfce0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/3132593077 >> 172.21.15.164:0/3132593077 conn(0x55949dfcae30 msgr2=0x55949dfcb230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/3132593077 shutdown_connections 2024-03-27T08:37:31.354 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.359+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/3132593077 wait complete. 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 -- start start 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 Processor -- start 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfcf8c0 0x55949dfd9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfe1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55949deefca0 con 0x55949dfd5420 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55949df30620 con 0x55949dfd02b0 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55949dfd83d0 con 0x55949dfcf8c0 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.360+0000 7fe2b7a7b740 10 client.0 _ll_register_callbacks cb 0x55949df2c160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfe1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35450/0 (socket says 172.21.15.164:35450) 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 -- 172.21.15.164:0/2641607277 learned_addr learned my addr 172.21.15.164:0/2641607277 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.355 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfcf8c0 0x55949dfd9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 -- 172.21.15.164:0/2641607277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfcf8c0 msgr2=0x55949dfd9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfcf8c0 0x55949dfd9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 -- 172.21.15.164:0/2641607277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 msgr2=0x55949dfe1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfe1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 -- 172.21.15.164:0/2641607277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55949dd127d0 con 0x55949dfd02b0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2ae800640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfe1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe2a5400640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2980ba8c0 tx=0x7fe2980be230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d0296c775e86e0c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.361+0000 7fe293e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298004c70 con 0x55949dfd02b0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe2980bc760 con 0x55949dfd02b0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a800f8f0 con 0x55949dfd02b0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe298005610 con 0x55949dfd02b0 2024-03-27T08:37:31.356 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe2b7a7b740 10 client.35645 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.357 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55949dfe43d0 con 0x55949dfd02b0 2024-03-27T08:37:31.358 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2a800f8f0 con 0x55949dfd02b0 2024-03-27T08:37:31.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.362+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe2980c6c40 con 0x55949dfd02b0 2024-03-27T08:37:31.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 10 client.35645 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 10 client.35645 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:37:31.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 20 client.35645 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.359 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949dfe5b50 0x55949dfe7f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 4 client.35645 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55949df41bb0 con 0x55949dfe5b50 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.363+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949dfe5b50 0x55949dfe7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.364+0000 7fe2ade00640 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949dfe5b50 0x55949dfe7f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f2d325283d11491 server_cookie=e51a63b43aa9ab2b in_seq=0 out_seq=0 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.364+0000 7fe293e00640 10 client.35645 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe293e00640 1 -- 172.21.15.164:0/2641607277 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55949df41bb0 con 0x55949dfe5b50 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe293e00640 10 client.35645 handle_command_reply: tid=0 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 client.35645 shutdown 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 msgr2=0x55949dfda020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe2980ba8c0 tx=0x7fe2980be230 comp rx=0 tx=0).stop 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 shutdown_connections 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949dfe5b50 0x55949dfe7f40 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfe1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd02b0 0x55949dfda020 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/2641607277 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfcf8c0 0x55949dfd9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 >> 172.21.15.164:0/2641607277 conn(0x55949dfcae30 msgr2=0x55949dfca030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe293e00640 0 client.35645 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 shutdown_connections 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/2641607277 wait complete. 2024-03-27T08:37:31.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.365+0000 7fe2b7a7b740 20 client.35645 trim_cache size 0 max 16384 2024-03-27T08:37:31.364 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-03-27T08:37:31.368 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-03-27T08:37:31.372 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-03-27T08:37:31.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.381+0000 7fe2b7a7b740 1 Processor -- start 2024-03-27T08:37:31.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.381+0000 7fe2b7a7b740 1 -- start start 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.381+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfe1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 0x55949dfd1b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01adca0 con 0x55949dfcf8c0 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01ab570 con 0x55949dfd5420 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01a93c0 con 0x55949dfd02b0 2024-03-27T08:37:31.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2ade00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2ade00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55490/0 (socket says 172.21.15.164:55490) 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 0x55949dfd1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2ade00640 1 -- 172.21.15.164:0/775439456 learned_addr learned my addr 172.21.15.164:0/775439456 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2a5400640 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfe1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.382+0000 7fe2ade00640 1 -- 172.21.15.164:0/775439456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 msgr2=0x55949dfe1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ade00640 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfe1020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ade00640 1 -- 172.21.15.164:0/775439456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 msgr2=0x55949dfd1b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ade00640 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 0x55949dfd1b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ade00640 1 -- 172.21.15.164:0/775439456 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55949dfcbba0 con 0x55949dfcf8c0 2024-03-27T08:37:31.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ae800640 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 0x55949dfd1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe2ade00640 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55949dfd0d20 tx=0x7fe2a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56295f3293adbb13 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe29ea00640 1 -- 172.21.15.164:0/775439456 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0003c40 con 0x55949dfcf8c0 2024-03-27T08:37:31.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe29ea00640 1 -- 172.21.15.164:0/775439456 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2a0031070 con 0x55949dfcf8c0 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.383+0000 7fe29ea00640 1 -- 172.21.15.164:0/775439456 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a000fd30 con 0x55949dfcf8c0 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/775439456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 msgr2=0x55949dfd1630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x55949dfd0d20 tx=0x7fe2a0017000 comp rx=0 tx=0).stop 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/775439456 shutdown_connections 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfd5420 0x55949dfd1b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfe1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/775439456 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfcf8c0 0x55949dfd1630 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/775439456 >> 172.21.15.164:0/775439456 conn(0x55949dfcae30 msgr2=0x55949dfcb210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/775439456 shutdown_connections 2024-03-27T08:37:31.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.384+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/775439456 wait complete. 2024-03-27T08:37:31.378 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-03-27T08:37:31.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.385+0000 7fe2b7a7b740 1 -- start start 2024-03-27T08:37:31.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.385+0000 7fe2b7a7b740 1 Processor -- start 2024-03-27T08:37:31.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.385+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 0x55949dfde5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfdeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfdfad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01a9a30 con 0x55949dfd5420 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01aaea0 con 0x55949dfcf8c0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b01aa100 con 0x55949dfd02b0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2b7a7b740 10 client.0 _ll_register_callbacks cb 0x7fe298009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfdfad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2ade00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 0x55949dfde5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2ae800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfdfad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55504/0 (socket says 172.21.15.164:55504) 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2ae800640 1 -- 172.21.15.164:0/939670284 learned_addr learned my addr 172.21.15.164:0/939670284 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.386+0000 7fe2a5400640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfdeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 -- 172.21.15.164:0/939670284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 msgr2=0x55949dfdeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfdeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 -- 172.21.15.164:0/939670284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 msgr2=0x55949dfdfad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfdfad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 -- 172.21.15.164:0/939670284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55949dfc6680 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe2ade00640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 0x55949dfde5d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2a002bfa0 tx=0x7fe2a0004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d77dc00623a042e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe293e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.387+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0039070 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe2a000f560 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2a0031070 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe2a0045050 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 10 client.35651 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55949dfe11f0 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe2a0031070 con 0x55949dfcf8c0 2024-03-27T08:37:31.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fe2a001e450 con 0x55949dfcf8c0 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 10 client.35651 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 10 client.35651 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 20 client.35651 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.388+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949e04c3d0 0x55949e04e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.389+0000 7fe2b7a7b740 4 client.35651 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.389+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55949df3bf00 con 0x55949e04c3d0 2024-03-27T08:37:31.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.389+0000 7fe2a5400640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949e04c3d0 0x55949e04e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.389+0000 7fe2a5400640 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949e04c3d0 0x55949e04e7f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=627b5f039949eec6 server_cookie=b40c03c6316d42f in_seq=0 out_seq=0 2024-03-27T08:37:31.384 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.389+0000 7fe293e00640 10 client.35651 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe293e00640 1 -- 172.21.15.164:0/939670284 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55949df3bf00 con 0x55949e04c3d0 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe293e00640 10 client.35651 handle_command_reply: tid=0 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 client.35651 shutdown 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 msgr2=0x55949dfde5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 0x55949dfde5d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe2a002bfa0 tx=0x7fe2a0004360 comp rx=0 tx=0).stop 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 shutdown_connections 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x55949e04c3d0 0x55949e04e7f0 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55949dfd5420 0x55949dfdfad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55949dfd02b0 0x55949dfdeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe293e00640 0 client.35651 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 --2- 172.21.15.164:0/939670284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55949dfcf8c0 0x55949dfde5d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 >> 172.21.15.164:0/939670284 conn(0x55949dfcae30 msgr2=0x55949dfd9920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 shutdown_connections 2024-03-27T08:37:31.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 1 -- 172.21.15.164:0/939670284 wait complete. 2024-03-27T08:37:31.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.390+0000 7fe2b7a7b740 20 client.35651 trim_cache size 0 max 16384 2024-03-27T08:37:31.386 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:37:31.386 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 msgr2=0x7fe2940a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 0x7fe2940a5ad0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x55949dfd06b0 tx=0x7fe2a0005f90 comp rx=0 tx=0).stop 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 msgr2=0x7fe2b019a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fe298000c00 tx=0x7fe298004e20 comp rx=0 tx=0).stop 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 shutdown_connections 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.391+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe2940a3610 0x7fe2940a5ad0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe2b0105940 0x7fe2b01a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe2b0104f80 0x7fe2b019a5e0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 --2- 172.21.15.164:0/2358176458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe2b0103d90 0x7fe2b019a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 >> 172.21.15.164:0/2358176458 conn(0x7fe2b00ff300 msgr2=0x7fe2b0108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 shutdown_connections 2024-03-27T08:37:31.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.392+0000 7fe2b4e00640 1 -- 172.21.15.164:0/2358176458 wait complete. 2024-03-27T08:37:31.388 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-03-27T08:37:31.390 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-03-27T08:37:31.394 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-03-27T08:37:31.400 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-03-27T08:37:31.402 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T08:37:31.408 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-03-27T08:37:31.414 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-03-27T08:37:31.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-03-27T08:37:31.423 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-03-27T08:37:31.428 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-03-27T08:37:31.434 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-03-27T08:37:31.439 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-03-27T08:37:31.445 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-03-27T08:37:31.448 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-03-27T08:37:31.453 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-03-27T08:37:31.458 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-03-27T08:37:31.463 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-03-27T08:37:31.469 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-03-27T08:37:31.474 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-03-27T08:37:31.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-03-27T08:37:31.484 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-03-27T08:37:31.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-03-27T08:37:31.492 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-03-27T08:37:31.497 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-03-27T08:37:31.501 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-03-27T08:37:31.507 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-03-27T08:37:31.512 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-03-27T08:37:31.520 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-03-27T08:37:31.526 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-03-27T08:37:31.532 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-03-27T08:37:31.536 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-03-27T08:37:31.543 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-03-27T08:37:31.548 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-03-27T08:37:31.554 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-03-27T08:37:31.560 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-03-27T08:37:31.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-03-27T08:37:31.574 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-03-27T08:37:31.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-03-27T08:37:31.589 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-03-27T08:37:31.598 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-03-27T08:37:31.605 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-03-27T08:37:31.611 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-03-27T08:37:31.617 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-03-27T08:37:31.622 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-03-27T08:37:31.626 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-03-27T08:37:31.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-03-27T08:37:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.643+0000 7f424fe00640 1 -- 172.21.15.164:0/3527494014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 msgr2=0x7f424810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.643+0000 7f424fe00640 1 --2- 172.21.15.164:0/3527494014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f424810c1d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f4240009ca0 tx=0x7f424002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 -- 172.21.15.164:0/3527494014 shutdown_connections 2024-03-27T08:37:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 --2- 172.21.15.164:0/3527494014 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f424810c1d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.635 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 --2- 172.21.15.164:0/3527494014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248104f80 0x7f4248105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 --2- 172.21.15.164:0/3527494014 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248103d90 0x7f42481041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 -- 172.21.15.164:0/3527494014 >> 172.21.15.164:0/3527494014 conn(0x7f42480ff300 msgr2=0x7f4248101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 -- 172.21.15.164:0/3527494014 shutdown_connections 2024-03-27T08:37:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.644+0000 7f424fe00640 1 -- 172.21.15.164:0/3527494014 wait complete. 2024-03-27T08:37:31.636 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 Processor -- start 2024-03-27T08:37:31.636 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-03-27T08:37:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 -- start start 2024-03-27T08:37:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 0x7f424819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f42481a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.638 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f424810f9f0 con 0x7f4248105940 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f424810f870 con 0x7f4248103d90 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.645+0000 7f424fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f424810fb70 con 0x7f4248104f80 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35484/0 (socket says 172.21.15.164:35484) 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 -- 172.21.15.164:0/1407549304 learned_addr learned my addr 172.21.15.164:0/1407549304 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424ca00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 0x7f424819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424de00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f42481a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 -- 172.21.15.164:0/1407549304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 msgr2=0x7f424819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 0x7f424819a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 -- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 msgr2=0x7f42481a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f42481a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424d400640 1 -- 172.21.15.164:0/1407549304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42481a1c10 con 0x7f4248103d90 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424ca00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 0x7f424819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:31.639 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.646+0000 7f424de00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f42481a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:37:31.640 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f424d400640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f423c00d770 tx=0x7f423c00dc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f4246000640 1 -- 172.21.15.164:0/1407549304 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c017070 con 0x7f4248103d90 2024-03-27T08:37:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f4246000640 1 -- 172.21.15.164:0/1407549304 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f423c009c30 con 0x7f4248103d90 2024-03-27T08:37:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42481a1f00 con 0x7f4248103d90 2024-03-27T08:37:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f4246000640 1 -- 172.21.15.164:0/1407549304 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c003e10 con 0x7f4248103d90 2024-03-27T08:37:31.641 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.647+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42481a23c0 con 0x7f4248103d90 2024-03-27T08:37:31.641 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-03-27T08:37:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.651+0000 7f4252a3a740 1 Processor -- start 2024-03-27T08:37:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.651+0000 7f4246000640 1 -- 172.21.15.164:0/1407549304 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f423c003fb0 con 0x7f4248103d90 2024-03-27T08:37:31.643 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.651+0000 7f4252a3a740 1 -- start start 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be83ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 0x556a3be8b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x556a3be4b7b0 con 0x556a3be89420 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556a3bde8670 con 0x556a3be842b0 2024-03-27T08:37:31.644 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f4252a3a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556a3bd90970 con 0x556a3be838c0 2024-03-27T08:37:31.645 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 0x556a3be8b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35492/0 (socket says 172.21.15.164:35492) 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 0x556a3be8b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55540/0 (socket says 172.21.15.164:55540) 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424d400640 1 -- 172.21.15.164:0/1597187435 learned_addr learned my addr 172.21.15.164:0/1597187435 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.652+0000 7f424de00640 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be83ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 -- 172.21.15.164:0/1597187435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 msgr2=0x556a3be83ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be83ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 -- 172.21.15.164:0/1597187435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 msgr2=0x556a3be8b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 0x556a3be8b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.646 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 -- 172.21.15.164:0/1597187435 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3bafc3f0 con 0x556a3be842b0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f424d400640 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f423c0d3c70 tx=0x7f423c0d3d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb71f21ffdd92ab6 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f4246000640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 0x7f42300a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f423a600640 1 -- 172.21.15.164:0/1597187435 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c09b400 con 0x556a3be842b0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f423a600640 1 -- 172.21.15.164:0/1597187435 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f423c0e1070 con 0x556a3be842b0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.653+0000 7f423a600640 1 -- 172.21.15.164:0/1597187435 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c09b730 con 0x556a3be842b0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.654+0000 7f4246000640 1 -- 172.21.15.164:0/1407549304 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f423c0cfad0 con 0x7f4248103d90 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.654+0000 7f424de00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 0x7f42300a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.654+0000 7f4252a3a740 1 -- 172.21.15.164:0/1597187435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 msgr2=0x556a3be88db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.647 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.654+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f423c0d3c70 tx=0x7f423c0d3d60 comp rx=0 tx=0).stop 2024-03-27T08:37:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f424de00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 0x7f42300a5b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f424002c700 tx=0x7f4240004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 -- 172.21.15.164:0/1597187435 shutdown_connections 2024-03-27T08:37:31.648 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be89420 0x556a3be8b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be88db0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1597187435 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be83ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 -- 172.21.15.164:0/1597187435 >> 172.21.15.164:0/1597187435 conn(0x556a3be7ee30 msgr2=0x556a3be7f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 -- 172.21.15.164:0/1597187435 shutdown_connections 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 -- 172.21.15.164:0/1597187435 wait complete. 2024-03-27T08:37:31.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.655+0000 7f4252a3a740 1 -- start start 2024-03-27T08:37:31.649 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-03-27T08:37:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 Processor -- start 2024-03-27T08:37:31.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be8ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be94f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x556a3bda3ca0 con 0x556a3be838c0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556a3bde4620 con 0x556a3be842b0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x556a3be8c370 con 0x556a3be89420 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f424d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55546/0 (socket says 172.21.15.164:55546) 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 -- 172.21.15.164:0/2351395513 learned_addr learned my addr 172.21.15.164:0/2351395513 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.656+0000 7f4252a3a740 10 client.0 _ll_register_callbacks cb 0x556a3bde0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424ca00640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be8ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424de00640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be94f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 -- 172.21.15.164:0/2351395513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 msgr2=0x556a3be94f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be94f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 -- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 msgr2=0x556a3be8ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be8ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 -- 172.21.15.164:0/2351395513 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3bbc67d0 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f424d400640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f423c0a46f0 tx=0x7f423c003650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff1acacaf388577d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.657+0000 7f422ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423c020030 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f423c09a2b0 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f423c0e1070 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f423c09b910 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f4252a3a740 10 client.15981 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556a3be98280 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.658+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f423c0e1070 con 0x556a3be838c0 2024-03-27T08:37:31.655 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f423c0042a0 con 0x556a3be838c0 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 10 client.15981 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 10 client.15981 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 20 client.15981 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3be995d0 0x556a3be9b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 4 client.15981 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a3bdf5bb0 con 0x556a3be995d0 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.659+0000 7f424ca00640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3be995d0 0x556a3be9b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.660+0000 7f424ca00640 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3be995d0 0x556a3be9b9c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ebe8e7bddfecfb0b server_cookie=44630825f1cd19bb in_seq=0 out_seq=0 2024-03-27T08:37:31.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.660+0000 7f422ea00640 10 client.15981 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:37:31.656 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-03-27T08:37:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f422ea00640 1 -- 172.21.15.164:0/2351395513 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x556a3bdf5bb0 con 0x556a3be995d0 2024-03-27T08:37:31.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f422ea00640 10 client.15981 handle_command_reply: tid=0 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 client.15981 shutdown 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 msgr2=0x556a3be8d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f423c0a46f0 tx=0x7f423c003650 comp rx=0 tx=0).stop 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 shutdown_connections 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3be995d0 0x556a3be9b9c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be94f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be842b0 0x556a3be8ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f422ea00640 0 client.15981 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 --2- 172.21.15.164:0/2351395513 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be838c0 0x556a3be8d990 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 >> 172.21.15.164:0/2351395513 conn(0x556a3be7ee30 msgr2=0x556a3be7e030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 shutdown_connections 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.661+0000 7f4252a3a740 1 -- 172.21.15.164:0/2351395513 wait complete. 2024-03-27T08:37:31.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.662+0000 7f4252a3a740 20 client.15981 trim_cache size 0 max 16384 2024-03-27T08:37:31.659 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-03-27T08:37:31.659 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-03-27T08:37:31.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-03-27T08:37:31.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-03-27T08:37:31.668 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-03-27T08:37:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.678+0000 7f4252a3a740 1 Processor -- start 2024-03-27T08:37:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.678+0000 7f4252a3a740 1 -- start start 2024-03-27T08:37:31.672 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be8c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be89420 0x556a3be8cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f42481adac0 con 0x556a3be842b0 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42481ab390 con 0x556a3be89420 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f4252a3a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42481a91e0 con 0x556a3be838c0 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55562/0 (socket says 172.21.15.164:55562) 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f424ca00640 1 -- 172.21.15.164:0/1925566771 learned_addr learned my addr 172.21.15.164:0/1925566771 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.673 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f424de00640 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be89420 0x556a3be8cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.679+0000 7f424d400640 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be8c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 -- 172.21.15.164:0/1925566771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 msgr2=0x556a3be8c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be8c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 -- 172.21.15.164:0/1925566771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be89420 msgr2=0x556a3be8cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be89420 0x556a3be8cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 -- 172.21.15.164:0/1925566771 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3be7fba0 con 0x556a3be842b0 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f424ca00640 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e60 tx=0x7f4234005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=678e209029c0cc17 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.674 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f4239c00640 1 -- 172.21.15.164:0/1925566771 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234021360 con 0x556a3be842b0 2024-03-27T08:37:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f4239c00640 1 -- 172.21.15.164:0/1925566771 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4234021500 con 0x556a3be842b0 2024-03-27T08:37:31.675 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.680+0000 7f4239c00640 1 -- 172.21.15.164:0/1925566771 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f423401e650 con 0x556a3be842b0 2024-03-27T08:37:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 -- 172.21.15.164:0/1925566771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 msgr2=0x556a3be94ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f4234009e60 tx=0x7f4234005f90 comp rx=0 tx=0).stop 2024-03-27T08:37:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 -- 172.21.15.164:0/1925566771 shutdown_connections 2024-03-27T08:37:31.676 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be89420 0x556a3be8cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be94ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1925566771 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be838c0 0x556a3be8c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 -- 172.21.15.164:0/1925566771 >> 172.21.15.164:0/1925566771 conn(0x556a3be7ee30 msgr2=0x556a3be82920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 -- 172.21.15.164:0/1925566771 shutdown_connections 2024-03-27T08:37:31.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.681+0000 7f4252a3a740 1 -- 172.21.15.164:0/1925566771 wait complete. 2024-03-27T08:37:31.677 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-03-27T08:37:31.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 -- start start 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 Processor -- start 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 0x556a3be92250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be93730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f42481a9850 con 0x556a3be842b0 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42481aacc0 con 0x556a3be838c0 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.682+0000 7f4252a3a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f42481a9f20 con 0x556a3be89420 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f4252a3a740 10 client.0 _ll_register_callbacks cb 0x7f42340095d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 0x556a3be92250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55570/0 (socket says 172.21.15.164:55570) 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 -- 172.21.15.164:0/1526149443 learned_addr learned my addr 172.21.15.164:0/1526149443 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 0x556a3be92250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35514/0 (socket says 172.21.15.164:35514) 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 -- 172.21.15.164:0/1526149443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 msgr2=0x556a3be93730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be93730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 -- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 msgr2=0x556a3be92250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 0x556a3be92250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 -- 172.21.15.164:0/1526149443 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3be93d20 con 0x556a3be842b0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f424ca00640 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4234021730 tx=0x7f4234021760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1d63cdde9758d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.683+0000 7f422ea00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4234004040 con 0x556a3be842b0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4234021500 con 0x556a3be842b0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f42340041e0 con 0x556a3be842b0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f42340043e0 con 0x556a3be842b0 2024-03-27T08:37:31.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f4252a3a740 10 client.15987 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556a3be950c0 con 0x556a3be842b0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.684+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4234021500 con 0x556a3be842b0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f4234004c80 con 0x556a3be842b0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 10 client.15987 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 10 client.15987 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 20 client.15987 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3beffdf0 0x556a3bf02210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 4 client.15987 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556a3bdeff00 con 0x556a3beffdf0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.685+0000 7f424d400640 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3beffdf0 0x556a3bf02210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f424d400640 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3beffdf0 0x556a3bf02210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e46285846ed12234 server_cookie=c9b131ee79c8d9d1 in_seq=0 out_seq=0 2024-03-27T08:37:31.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f422ea00640 10 client.15987 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:37:31.684 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f422ea00640 1 -- 172.21.15.164:0/1526149443 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556a3bdeff00 con 0x556a3beffdf0 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f422ea00640 10 client.15987 handle_command_reply: tid=0 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 client.15987 shutdown 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 msgr2=0x556a3be92790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4234021730 tx=0x7f4234021760 comp rx=0 tx=0).stop 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 shutdown_connections 2024-03-27T08:37:31.685 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x556a3beffdf0 0x556a3bf02210 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x556a3be89420 0x556a3be93730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x556a3be842b0 0x556a3be92790 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 --2- 172.21.15.164:0/1526149443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3be838c0 0x556a3be92250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 >> 172.21.15.164:0/1526149443 conn(0x556a3be7ee30 msgr2=0x556a3be7d7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.686+0000 7f422ea00640 0 client.15987 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.687+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 shutdown_connections 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.687+0000 7f4252a3a740 1 -- 172.21.15.164:0/1526149443 wait complete. 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.687+0000 7f4252a3a740 20 client.15987 trim_cache size 0 max 16384 2024-03-27T08:37:31.686 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:37:31.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 msgr2=0x7f42300a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 0x7f42300a5b50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f424002c700 tx=0x7f4240004a40 comp rx=0 tx=0).stop 2024-03-27T08:37:31.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 msgr2=0x7f4248199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.687 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f423c00d770 tx=0x7f423c00dc30 comp rx=0 tx=0).stop 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 shutdown_connections 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f42300a3690 0x7f42300a5b50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4248105940 0x7f42481a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4248104f80 0x7f424819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 --2- 172.21.15.164:0/1407549304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4248103d90 0x7f4248199ff0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 >> 172.21.15.164:0/1407549304 conn(0x7f42480ff300 msgr2=0x7f4248108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 shutdown_connections 2024-03-27T08:37:31.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.688+0000 7f424fe00640 1 -- 172.21.15.164:0/1407549304 wait complete. 2024-03-27T08:37:31.688 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-03-27T08:37:31.688 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-03-27T08:37:31.689 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-03-27T08:37:31.693 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-03-27T08:37:31.695 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:31 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1519359997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:37:31.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-03-27T08:37:31.698 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T08:37:31.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-03-27T08:37:31.705 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-03-27T08:37:31.709 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-03-27T08:37:31.713 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-03-27T08:37:31.717 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-03-27T08:37:31.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-03-27T08:37:31.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-03-27T08:37:31.731 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-03-27T08:37:31.735 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-03-27T08:37:31.740 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-03-27T08:37:31.745 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-03-27T08:37:31.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-03-27T08:37:31.757 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-03-27T08:37:31.764 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-03-27T08:37:31.771 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-03-27T08:37:31.777 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-03-27T08:37:31.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-03-27T08:37:31.786 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-03-27T08:37:31.791 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-03-27T08:37:31.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nfc/ 2024-03-27T08:37:31.800 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-03-27T08:37:31.805 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-03-27T08:37:31.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nios2/ 2024-03-27T08:37:31.815 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nios2/README 2024-03-27T08:37:31.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-03-27T08:37:31.830 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/numastat.txt 2024-03-27T08:37:31.835 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-03-27T08:37:31.841 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/padata.txt 2024-03-27T08:37:31.847 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parisc/ 2024-03-27T08:37:31.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-03-27T08:37:31.858 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-03-27T08:37:31.865 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parisc/registers 2024-03-27T08:37:31.870 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-03-27T08:37:31.882 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/parport.txt 2024-03-27T08:37:31.890 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-03-27T08:37:31.896 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-03-27T08:37:31.904 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-03-27T08:37:31.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-03-27T08:37:31.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 -- 172.21.15.164:0/3857803756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c1024b0 msgr2=0x7ff07c1048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 --2- 172.21.15.164:0/3857803756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c1024b0 0x7ff07c1048a0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7ff074009ca0 tx=0x7ff07402c0f0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 -- 172.21.15.164:0/3857803756 shutdown_connections 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 --2- 172.21.15.164:0/3857803756 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 0x7ff07c109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 --2- 172.21.15.164:0/3857803756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c104de0 0x7ff07c1071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 --2- 172.21.15.164:0/3857803756 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c1024b0 0x7ff07c1048a0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.922 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 -- 172.21.15.164:0/3857803756 >> 172.21.15.164:0/3857803756 conn(0x7ff07c0fbec0 msgr2=0x7ff07c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 -- 172.21.15.164:0/3857803756 shutdown_connections 2024-03-27T08:37:31.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.930+0000 7ff081800640 1 -- 172.21.15.164:0/3857803756 wait complete. 2024-03-27T08:37:31.923 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.931+0000 7ff081800640 1 Processor -- start 2024-03-27T08:37:31.923 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 -- start start 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 0x7ff07c199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 0x7ff07c1a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c10d690 con 0x7ff07c104de0 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c10d510 con 0x7ff07c1024b0 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff081800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c10d810 con 0x7ff07c107710 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.932+0000 7ff07be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 0x7ff07c199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.925 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55586/0 (socket says 172.21.15.164:55586) 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 -- 172.21.15.164:0/1992659095 learned_addr learned my addr 172.21.15.164:0/1992659095 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 0x7ff07c199f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35532/0 (socket says 172.21.15.164:35532) 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff080e00640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 0x7ff07c1a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 -- 172.21.15.164:0/1992659095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 msgr2=0x7ff07c1a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 0x7ff07c1a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 -- 172.21.15.164:0/1992659095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 msgr2=0x7ff07c199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 0x7ff07c199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.933+0000 7ff07b400640 1 -- 172.21.15.164:0/1992659095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff07c1a1b20 con 0x7ff07c104de0 2024-03-27T08:37:31.926 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff07b400640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff06800d770 tx=0x7ff06800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff078c00640 1 -- 172.21.15.164:0/1992659095 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068017070 con 0x7ff07c104de0 2024-03-27T08:37:31.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff07c1a1e10 con 0x7ff07c104de0 2024-03-27T08:37:31.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff078c00640 1 -- 172.21.15.164:0/1992659095 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff068009c30 con 0x7ff07c104de0 2024-03-27T08:37:31.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff078c00640 1 -- 172.21.15.164:0/1992659095 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800f620 con 0x7ff07c104de0 2024-03-27T08:37:31.927 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.934+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff07c1a2320 con 0x7ff07c104de0 2024-03-27T08:37:31.928 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-03-27T08:37:31.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 Processor -- start 2024-03-27T08:37:31.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 -- start start 2024-03-27T08:37:31.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.930 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07b8fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b9610 0x5579b07bbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.933 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5579b077b7b0 con 0x5579b07b44a0 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5579b0718670 con 0x5579b07b3ab0 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.938+0000 7ff0859e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5579b06c0970 con 0x5579b07b9610 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff07be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07b8fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35538/0 (socket says 172.21.15.164:35538) 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 -- 172.21.15.164:0/481612950 learned_addr learned my addr 172.21.15.164:0/481612950 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff078c00640 1 -- 172.21.15.164:0/1992659095 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7ff06801a070 con 0x7ff07c104de0 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 -- 172.21.15.164:0/481612950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b9610 msgr2=0x5579b07bbaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b9610 0x5579b07bbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 -- 172.21.15.164:0/481612950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 msgr2=0x5579b07b8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07b8fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.939+0000 7ff080e00640 1 -- 172.21.15.164:0/481612950 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b042c3f0 con 0x5579b07b3ab0 2024-03-27T08:37:31.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.940+0000 7ff080e00640 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cbe0 tx=0x7ff06c00e720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da0ec57f9758c584 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.935 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-03-27T08:37:31.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.940+0000 7ff071600640 1 -- 172.21.15.164:0/481612950 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c005220 con 0x5579b07b3ab0 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.940+0000 7ff071600640 1 -- 172.21.15.164:0/481612950 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff06c004c70 con 0x5579b07b3ab0 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.940+0000 7ff071600640 1 -- 172.21.15.164:0/481612950 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c010850 con 0x5579b07b3ab0 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.941+0000 7ff078c00640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 0x7ff0600a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.941+0000 7ff0859e0740 1 -- 172.21.15.164:0/481612950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 msgr2=0x5579b07b3ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.941+0000 7ff0859e0740 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00cbe0 tx=0x7ff06c00e720 comp rx=0 tx=0).stop 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.941+0000 7ff078c00640 1 -- 172.21.15.164:0/1992659095 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff0680cf7d0 con 0x7ff07c104de0 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.941+0000 7ff07be00640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 0x7ff0600a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 -- 172.21.15.164:0/481612950 shutdown_connections 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b9610 0x5579b07bbaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07b8fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 --2- 172.21.15.164:0/481612950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07b3ed0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 -- 172.21.15.164:0/481612950 >> 172.21.15.164:0/481612950 conn(0x5579b07af020 msgr2=0x5579b07af420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 -- 172.21.15.164:0/481612950 shutdown_connections 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 -- 172.21.15.164:0/481612950 wait complete. 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff0859e0740 1 -- start start 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.942+0000 7ff07be00640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 0x7ff0600a5b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff07402c630 tx=0x7ff074032340 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 Processor -- start 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07bdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07be110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5579b06d3ca0 con 0x5579b07b44a0 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5579b0714620 con 0x5579b07b9610 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5579b07bc5c0 con 0x5579b07b3ab0 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.943+0000 7ff0859e0740 10 client.0 _ll_register_callbacks cb 0x5579b0710160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35554/0 (socket says 172.21.15.164:35554) 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 -- 172.21.15.164:0/1507527531 learned_addr learned my addr 172.21.15.164:0/1507527531 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.939 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff07b400640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07be110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.940 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff07be00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07bdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 -- 172.21.15.164:0/1507527531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 msgr2=0x5579b07bdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07bdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 -- 172.21.15.164:0/1507527531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 msgr2=0x5579b07be110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07be110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff080e00640 1 -- 172.21.15.164:0/1507527531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b04f67d0 con 0x5579b07b9610 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff07be00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.944+0000 7ff07b400640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff080e00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c920 tx=0x7ff06c00cf80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e6283e191f6c7c72 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff066000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:31.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06c029060 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff06c005230 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff06c004c70 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff06c005430 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff0859e0740 10 client.35681 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.945+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579b07c84c0 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff06c004c70 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff06c01a4a0 con 0x5579b07b9610 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 10 client.35681 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 10 client.35681 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 20 client.35681 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07c9810 0x5579b07cbc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 4 client.35681 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.946+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579b0725bb0 con 0x5579b07c9810 2024-03-27T08:37:31.943 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.947+0000 7ff07be00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07c9810 0x5579b07cbc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.947+0000 7ff07be00640 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07c9810 0x5579b07cbc00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c0f3f03e9a9aec7 server_cookie=c39398c60fdad456 in_seq=0 out_seq=0 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.947+0000 7ff066000640 10 client.35681 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff066000640 1 -- 172.21.15.164:0/1507527531 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5579b0725bb0 con 0x5579b07c9810 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff066000640 10 client.35681 handle_command_reply: tid=0 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 client.35681 shutdown 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 msgr2=0x5579b07c5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.944 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff06c00c920 tx=0x7ff06c00cf80 comp rx=0 tx=0).stop 2024-03-27T08:37:31.944 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/phy.txt 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 shutdown_connections 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07c9810 0x5579b07cbc00 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b9610 0x5579b07c5150 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07b44a0 0x5579b07be110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 --2- 172.21.15.164:0/1507527531 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff066000640 0 client.35681 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:31.945 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 >> 172.21.15.164:0/1507527531 conn(0x5579b07af020 msgr2=0x5579b07ae240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 shutdown_connections 2024-03-27T08:37:31.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 1 -- 172.21.15.164:0/1507527531 wait complete. 2024-03-27T08:37:31.946 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.949+0000 7ff0859e0740 20 client.35681 trim_cache size 0 max 16384 2024-03-27T08:37:31.946 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/phy/ 2024-03-27T08:37:31.948 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-03-27T08:37:31.951 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-03-27T08:37:31.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-03-27T08:37:31.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.967+0000 7ff0859e0740 1 Processor -- start 2024-03-27T08:37:31.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.967+0000 7ff0859e0740 1 -- start start 2024-03-27T08:37:31.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.967+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.959 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.967+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07c5110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b44a0 0x5579b07bdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff0859e0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1ad9c0 con 0x5579b07af020 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff0859e0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1ab290 con 0x5579b07b3ab0 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff0859e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1a90e0 con 0x5579b07b44a0 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55620/0 (socket says 172.21.15.164:55620) 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 -- 172.21.15.164:0/3151388024 learned_addr learned my addr 172.21.15.164:0/3151388024 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.960 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07b400640 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff080e00640 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b44a0 0x5579b07bdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 -- 172.21.15.164:0/3151388024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b44a0 msgr2=0x5579b07bdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b44a0 0x5579b07bdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 -- 172.21.15.164:0/3151388024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 msgr2=0x5579b07c5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07c5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.968+0000 7ff07be00640 1 -- 172.21.15.164:0/3151388024 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579b07bc6d0 con 0x5579b07af020 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.969+0000 7ff07be00640 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff074005e30 tx=0x7ff074045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15ee5219cae761aa server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.969+0000 7ff070c00640 1 -- 172.21.15.164:0/3151388024 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074057070 con 0x5579b07af020 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.969+0000 7ff070c00640 1 -- 172.21.15.164:0/3151388024 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff074048040 con 0x5579b07af020 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.969+0000 7ff070c00640 1 -- 172.21.15.164:0/3151388024 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff074039040 con 0x5579b07af020 2024-03-27T08:37:31.962 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 -- 172.21.15.164:0/3151388024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 msgr2=0x5579b07aa390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7ff074005e30 tx=0x7ff074045000 comp rx=0 tx=0).stop 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 -- 172.21.15.164:0/3151388024 shutdown_connections 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b44a0 0x5579b07bdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b3ab0 0x5579b07c5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 --2- 172.21.15.164:0/3151388024 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07aa390 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 -- 172.21.15.164:0/3151388024 >> 172.21.15.164:0/3151388024 conn(0x5579b07b90e0 msgr2=0x5579b07af400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 -- 172.21.15.164:0/3151388024 shutdown_connections 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.970+0000 7ff0859e0740 1 -- 172.21.15.164:0/3151388024 wait complete. 2024-03-27T08:37:31.963 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 -- start start 2024-03-27T08:37:31.964 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 Processor -- start 2024-03-27T08:37:31.964 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/platform/ 2024-03-27T08:37:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07c2490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.966 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 0x5579b082daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1a9750 con 0x5579b07af020 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1aabc0 con 0x5579b07b44a0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.971+0000 7ff0859e0740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7ff07c1a9e20 con 0x5579b07b3ab0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff0859e0740 10 client.0 _ll_register_callbacks cb 0x7ff06c014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55632/0 (socket says 172.21.15.164:55632) 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 -- 172.21.15.164:0/2224790992 learned_addr learned my addr 172.21.15.164:0/2224790992 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff080e00640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 0x5579b082daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07b400640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07c2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 -- 172.21.15.164:0/2224790992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 msgr2=0x5579b07c2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07c2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 -- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 msgr2=0x5579b082daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:31.967 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 0x5579b082daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07be00640 1 -- 172.21.15.164:0/2224790992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579b082e030 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff080e00640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 0x5579b082daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.972+0000 7ff07b400640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff07be00640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff074055040 tx=0x7ff074009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b870450ac3d20b7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff066000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07405f070 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7ff0740043a0 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff074048040 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff074057040 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff0859e0740 10 client.16005 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5579b082f1f0 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.973+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff074048040 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7ff07405a050 con 0x5579b07af020 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 10 client.16005 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:31.968 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 10 client.16005 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 20 client.16005 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07b9610 0x5579b0831c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 4 client.16005 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:37:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579b071ff00 con 0x5579b07b9610 2024-03-27T08:37:31.969 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.974+0000 7ff07b400640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07b9610 0x5579b0831c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:31.969 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-03-27T08:37:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff066000640 10 client.16005 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff07b400640 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07b9610 0x5579b0831c70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db31a2ac429abcb1 server_cookie=5fa93fc7c2913089 in_seq=0 out_seq=0 2024-03-27T08:37:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff066000640 1 -- 172.21.15.164:0/2224790992 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579b071ff00 con 0x5579b07b9610 2024-03-27T08:37:31.970 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff066000640 10 client.16005 handle_command_reply: tid=0 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 client.16005 shutdown 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 msgr2=0x5579b07c1f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7ff074055040 tx=0x7ff074009540 comp rx=0 tx=0).stop 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 shutdown_connections 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5579b07b9610 0x5579b0831c70 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5579b07b44a0 0x5579b082daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5579b07b3ab0 0x5579b07c2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 --2- 172.21.15.164:0/2224790992 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5579b07af020 0x5579b07c1f50 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff066000640 0 client.16005 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.975+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 >> 172.21.15.164:0/2224790992 conn(0x5579b07b90e0 msgr2=0x5579b07b8940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 shutdown_connections 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff0859e0740 1 -- 172.21.15.164:0/2224790992 wait complete. 2024-03-27T08:37:31.971 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff0859e0740 20 client.16005 trim_cache size 0 max 16384 2024-03-27T08:37:31.972 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:37:31.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 msgr2=0x7ff0600a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.972 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 0x7ff0600a5b50 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7ff07402c630 tx=0x7ff074032340 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 msgr2=0x7ff07c19a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7ff06800d770 tx=0x7ff06800dc30 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 shutdown_connections 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7ff0600a3690 0x7ff0600a5b50 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7ff07c107710 0x7ff07c1a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7ff07c104de0 0x7ff07c19a440 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 --2- 172.21.15.164:0/1992659095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff07c1024b0 0x7ff07c199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.976+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 >> 172.21.15.164:0/1992659095 conn(0x7ff07c0fbec0 msgr2=0x7ff07c101b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.977+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 shutdown_connections 2024-03-27T08:37:31.973 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:31.977+0000 7ff081800640 1 -- 172.21.15.164:0/1992659095 wait complete. 2024-03-27T08:37:31.973 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pnp.txt 2024-03-27T08:37:31.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/ 2024-03-27T08:37:31.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-03-27T08:37:31.980 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-03-27T08:37:31.984 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-03-27T08:37:31.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-03-27T08:37:31.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-03-27T08:37:32.001 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-03-27T08:37:32.008 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-03-27T08:37:32.014 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-03-27T08:37:32.022 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-03-27T08:37:32.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-03-27T08:37:32.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-03-27T08:37:32.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-03-27T08:37:32.059 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-03-27T08:37:32.066 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-03-27T08:37:32.067 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:31 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1519359997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:37:32.070 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-03-27T08:37:32.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:31 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1519359997' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:37:32.079 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-03-27T08:37:32.089 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-03-27T08:37:32.097 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-03-27T08:37:32.106 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-03-27T08:37:32.114 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-03-27T08:37:32.124 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-03-27T08:37:32.133 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-03-27T08:37:32.148 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-03-27T08:37:32.158 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/states.txt 2024-03-27T08:37:32.166 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-03-27T08:37:32.176 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-03-27T08:37:32.186 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-03-27T08:37:32.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-03-27T08:37:32.200 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-03-27T08:37:32.209 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-03-27T08:37:32.216 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-03-27T08:37:32.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/power/video.txt 2024-03-27T08:37:32.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/ 2024-03-27T08:37:32.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-03-27T08:37:32.252 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-03-27T08:37:32.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-03-27T08:37:32.270 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-03-27T08:37:32.291 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-03-27T08:37:32.400 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-03-27T08:37:32.409 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-03-27T08:37:32.418 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-03-27T08:37:32.428 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-03-27T08:37:32.435 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-03-27T08:37:32.443 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-03-27T08:37:32.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-03-27T08:37:32.458 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-03-27T08:37:32.467 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pps/ 2024-03-27T08:37:32.475 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-03-27T08:37:32.482 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/ 2024-03-27T08:37:32.491 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-03-27T08:37:32.499 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-03-27T08:37:32.505 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-03-27T08:37:32.514 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-03-27T08:37:32.523 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-03-27T08:37:32.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-03-27T08:37:32.541 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-03-27T08:37:32.550 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-03-27T08:37:32.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-03-27T08:37:32.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pti/ 2024-03-27T08:37:32.575 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-03-27T08:37:32.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/ 2024-03-27T08:37:32.590 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-03-27T08:37:32.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-03-27T08:37:32.606 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-03-27T08:37:32.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-03-27T08:37:32.624 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-03-27T08:37:32.633 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/pwm.txt 2024-03-27T08:37:32.645 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-03-27T08:37:32.651 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rapidio/ 2024-03-27T08:37:32.657 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-03-27T08:37:32.667 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-03-27T08:37:32.675 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-03-27T08:37:32.682 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-03-27T08:37:32.694 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-03-27T08:37:32.702 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-03-27T08:37:32.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-03-27T08:37:32.717 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-03-27T08:37:32.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-03-27T08:37:32.737 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/rtc.txt 2024-03-27T08:37:32.747 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/ 2024-03-27T08:37:32.752 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-03-27T08:37:32.760 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-03-27T08:37:32.768 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-03-27T08:37:32.776 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-03-27T08:37:32.786 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/DASD 2024-03-27T08:37:32.796 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-03-27T08:37:32.812 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-03-27T08:37:32.823 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-03-27T08:37:32.834 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-03-27T08:37:32.844 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-03-27T08:37:32.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-03-27T08:37:32.865 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-03-27T08:37:32.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-03-27T08:37:32.884 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-03-27T08:37:32.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/ 2024-03-27T08:37:32.902 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-03-27T08:37:32.911 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-03-27T08:37:32.920 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-03-27T08:37:32.929 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-03-27T08:37:32.936 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-03-27T08:37:32.947 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-03-27T08:37:32.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-03-27T08:37:32.965 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-03-27T08:37:32.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-03-27T08:37:32.983 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-03-27T08:37:32.988 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-03-27T08:37:32.988 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:37:32.988 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph tell mds.1:0 scrub start / force,recursive 2024-03-27T08:37:32.997 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ 2024-03-27T08:37:33.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-03-27T08:37:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:32 smithi164 ceph-mon[31788]: pgmap v507: 97 pgs: 97 active+clean; 97 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 854 KiB/s wr, 139 op/s 2024-03-27T08:37:33.009 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-03-27T08:37:33.016 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-03-27T08:37:33.023 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-03-27T08:37:33.031 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-03-27T08:37:33.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-03-27T08:37:33.042 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-03-27T08:37:33.051 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-03-27T08:37:33.059 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-03-27T08:37:33.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-03-27T08:37:33.067 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:32 smithi167 ceph-mon[34903]: pgmap v507: 97 pgs: 97 active+clean; 97 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 854 KiB/s wr, 139 op/s 2024-03-27T08:37:33.070 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-03-27T08:37:33.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:32 smithi173 ceph-mon[35397]: pgmap v507: 97 pgs: 97 active+clean; 97 MiB data, 707 MiB used, 1.0 TiB / 1.0 TiB avail; 419 KiB/s rd, 854 KiB/s wr, 139 op/s 2024-03-27T08:37:33.077 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-03-27T08:37:33.081 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-03-27T08:37:33.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-03-27T08:37:33.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-03-27T08:37:33.099 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-03-27T08:37:33.103 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-03-27T08:37:33.108 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-03-27T08:37:33.113 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-03-27T08:37:33.118 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-03-27T08:37:33.125 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-03-27T08:37:33.132 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-03-27T08:37:33.137 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-03-27T08:37:33.143 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-03-27T08:37:33.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-03-27T08:37:33.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-03-27T08:37:33.162 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-03-27T08:37:33.168 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-03-27T08:37:33.172 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-03-27T08:37:33.179 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-03-27T08:37:33.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-03-27T08:37:33.189 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-03-27T08:37:33.196 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-03-27T08:37:33.202 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-03-27T08:37:33.208 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-03-27T08:37:33.212 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-03-27T08:37:33.216 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-03-27T08:37:33.221 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-03-27T08:37:33.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 -- 172.21.15.164:0/4161760997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 msgr2=0x7fb0541041b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 --2- 172.21.15.164:0/4161760997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb0541041b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb044009860 tx=0x7fb04402bb90 comp rx=0 tx=0).stop 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 -- 172.21.15.164:0/4161760997 shutdown_connections 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 --2- 172.21.15.164:0/4161760997 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 0x7fb05410c1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 --2- 172.21.15.164:0/4161760997 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 0x7fb054105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 --2- 172.21.15.164:0/4161760997 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb0541041b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 -- 172.21.15.164:0/4161760997 >> 172.21.15.164:0/4161760997 conn(0x7fb0540ff300 msgr2=0x7fb054101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 -- 172.21.15.164:0/4161760997 shutdown_connections 2024-03-27T08:37:33.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.237+0000 7fb05ac00640 1 -- 172.21.15.164:0/4161760997 wait complete. 2024-03-27T08:37:33.232 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.238+0000 7fb05ac00640 1 Processor -- start 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.238+0000 7fb05ac00640 1 -- start start 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.238+0000 7fb05ac00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb05ac00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 0x7fb05419a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb05ac00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 0x7fb0541a1660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb05ac00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb05410f9f0 con 0x7fb054105940 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb05ac00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb05410f870 con 0x7fb054103d90 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb05ac00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb05410fb70 con 0x7fb054104f80 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35586/0 (socket says 172.21.15.164:35586) 2024-03-27T08:37:33.233 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 -- 172.21.15.164:0/31109362 learned_addr learned my addr 172.21.15.164:0/31109362 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb058c00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 0x7fb0541a1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053400640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 0x7fb05419a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 -- 172.21.15.164:0/31109362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 msgr2=0x7fb05419a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 0x7fb05419a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 -- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 msgr2=0x7fb0541a1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 0x7fb0541a1660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.239+0000 7fb053e00640 1 -- 172.21.15.164:0/31109362 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0541a1cd0 con 0x7fb054103d90 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.240+0000 7fb053e00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb04402c0d0 tx=0x7fb044034830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.234 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.240+0000 7fb050c00640 1 -- 172.21.15.164:0/31109362 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb044039050 con 0x7fb054103d90 2024-03-27T08:37:33.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.240+0000 7fb050c00640 1 -- 172.21.15.164:0/31109362 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb044045070 con 0x7fb054103d90 2024-03-27T08:37:33.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.240+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0541a1f60 con 0x7fb054103d90 2024-03-27T08:37:33.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.241+0000 7fb050c00640 1 -- 172.21.15.164:0/31109362 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0440035f0 con 0x7fb054103d90 2024-03-27T08:37:33.235 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.241+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0541a23c0 con 0x7fb054103d90 2024-03-27T08:37:33.235 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-03-27T08:37:33.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.244+0000 7fb05d9ac740 1 Processor -- start 2024-03-27T08:37:33.236 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 -- start start 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb050c00640 1 -- 172.21.15.164:0/31109362 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb044032740 con 0x7fb054103d90 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d80550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d80a90 0x555f88d87320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555f88ce4280 con 0x555f88d7ef00 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555f88c8c6f0 con 0x555f88d800d0 2024-03-27T08:37:33.239 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f88ce0230 con 0x555f88d80a90 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.245+0000 7fb058c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb053e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d80550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55650/0 (socket says 172.21.15.164:55650) 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb053e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d80550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35592/0 (socket says 172.21.15.164:35592) 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 -- 172.21.15.164:0/3053151763 learned_addr learned my addr 172.21.15.164:0/3053151763 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb053400640 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d80a90 0x555f88d87320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 -- 172.21.15.164:0/3053151763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d80a90 msgr2=0x555f88d87320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d80a90 0x555f88d87320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 -- 172.21.15.164:0/3053151763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 msgr2=0x555f88d80550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d80550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 -- 172.21.15.164:0/3053151763 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f88ac07e0 con 0x555f88d7ef00 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.246+0000 7fb058c00640 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e580 tx=0x7fb04c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384df389aa28c0f2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb049200640 1 -- 172.21.15.164:0/3053151763 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x555f88d7ef00 2024-03-27T08:37:33.240 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb050c00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 0x7fb0380a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb049200640 1 -- 172.21.15.164:0/3053151763 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb04c00d830 con 0x555f88d7ef00 2024-03-27T08:37:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb049200640 1 -- 172.21.15.164:0/3053151763 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004530 con 0x555f88d7ef00 2024-03-27T08:37:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb050c00640 1 -- 172.21.15.164:0/31109362 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb0440f1fb0 con 0x7fb054103d90 2024-03-27T08:37:33.241 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.247+0000 7fb053e00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 0x7fb0380a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3053151763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 msgr2=0x555f88d7f320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00e580 tx=0x7fb04c0095c0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb053e00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 0x7fb0380a5b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb044032570 tx=0x7fb0440f5a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3053151763 shutdown_connections 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d80a90 0x555f88d87320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d80550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3053151763 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d7ef00 0x555f88d7f320 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3053151763 >> 172.21.15.164:0/3053151763 conn(0x555f88d7a2f0 msgr2=0x555f88d7a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3053151763 shutdown_connections 2024-03-27T08:37:33.242 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.248+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3053151763 wait complete. 2024-03-27T08:37:33.243 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-03-27T08:37:33.245 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.249+0000 7fb05d9ac740 1 -- start start 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.249+0000 7fb05d9ac740 1 Processor -- start 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d89a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d90a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555f88d87aa0 con 0x555f88d80a90 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555f88c9faa0 con 0x555f88d7ef00 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555f88d87c20 con 0x555f88d800d0 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb05d9ac740 10 client.0 _ll_register_callbacks cb 0x555f88c9f490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb058c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb058c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35606/0 (socket says 172.21.15.164:35606) 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb058c00640 1 -- 172.21.15.164:0/2176419314 learned_addr learned my addr 172.21.15.164:0/2176419314 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.246 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb058c00640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d90a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.250+0000 7fb053400640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d89a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 -- 172.21.15.164:0/2176419314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 msgr2=0x555f88d89a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d89a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 -- 172.21.15.164:0/2176419314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 msgr2=0x555f88d90a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d90a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 -- 172.21.15.164:0/2176419314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f88b20f70 con 0x555f88d7ef00 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb058c00640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00dd90 tx=0x7fb04c005bd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0974793158a5b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb03d600640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c0047c0 con 0x555f88d7ef00 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x555f88d7ef00 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.251+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c00d830 con 0x555f88d7ef00 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.252+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb04c003b70 con 0x555f88d7ef00 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.252+0000 7fb05d9ac740 10 client.35699 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:33.247 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.252+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555f889b8170 con 0x555f88d7ef00 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.252+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb04c00d830 con 0x555f88d7ef00 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.252+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb04c031020 con 0x555f88d7ef00 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 10 client.35699 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 10 client.35699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 20 client.35699 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88d950a0 0x555f88d974c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 4 client.35699 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:33.248 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f88cf17c0 con 0x555f88d950a0 2024-03-27T08:37:33.249 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-03-27T08:37:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.253+0000 7fb053400640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88d950a0 0x555f88d974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.254+0000 7fb053400640 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88d950a0 0x555f88d974c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae1088d8c6f9ddf server_cookie=af00ff3398e3e016 in_seq=0 out_seq=0 2024-03-27T08:37:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.254+0000 7fb03d600640 10 client.35699 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.249 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.256+0000 7fb03d600640 1 -- 172.21.15.164:0/2176419314 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555f88cf17c0 con 0x555f88d950a0 2024-03-27T08:37:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.256+0000 7fb03d600640 10 client.35699 handle_command_reply: tid=0 2024-03-27T08:37:33.250 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.256+0000 7fb05d9ac740 1 client.35699 shutdown 2024-03-27T08:37:33.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 msgr2=0x555f88d894e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00dd90 tx=0x7fb04c005bd0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 shutdown_connections 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88d950a0 0x555f88d974c0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d90a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d89a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/2176419314 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d894e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 >> 172.21.15.164:0/2176419314 conn(0x555f88d7a2f0 msgr2=0x555f88d79550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb03d600640 0 client.35699 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 shutdown_connections 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.257+0000 7fb05d9ac740 1 -- 172.21.15.164:0/2176419314 wait complete. 2024-03-27T08:37:33.251 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.258+0000 7fb05d9ac740 20 client.35699 trim_cache size 0 max 16384 2024-03-27T08:37:33.252 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 -- 172.21.15.164:0/565984577 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 msgr2=0x7f5248101fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 --2- 172.21.15.164:0/565984577 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248101fa0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5238009900 tx=0x7f523802bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 -- 172.21.15.164:0/565984577 shutdown_connections 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 --2- 172.21.15.164:0/565984577 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 0x7f5248109fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 --2- 172.21.15.164:0/565984577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 0x7f52481031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 --2- 172.21.15.164:0/565984577 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248101fa0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 -- 172.21.15.164:0/565984577 >> 172.21.15.164:0/565984577 conn(0x7f52480fd110 msgr2=0x7f52480ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 -- 172.21.15.164:0/565984577 shutdown_connections 2024-03-27T08:37:33.253 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.261+0000 7f524f000640 1 -- 172.21.15.164:0/565984577 wait complete. 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.262+0000 7f524f000640 1 Processor -- start 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.262+0000 7f524f000640 1 -- start start 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 0x7f52481960d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 0x7f524819d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f524810b5f0 con 0x7f5248101b80 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f524810b470 con 0x7f5248102d70 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524f000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f524810b770 con 0x7f5248103730 2024-03-27T08:37:33.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55672/0 (socket says 172.21.15.164:55672) 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 -- 172.21.15.164:0/847587384 learned_addr learned my addr 172.21.15.164:0/847587384 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247400640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 0x7f52481960d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f524d000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 0x7f524819d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 -- 172.21.15.164:0/847587384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 msgr2=0x7f524819d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 0x7f524819d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 -- 172.21.15.164:0/847587384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 msgr2=0x7f52481960d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 0x7f52481960d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.263+0000 7f5247e00640 1 -- 172.21.15.164:0/847587384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f524819d7b0 con 0x7f5248101b80 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f5247e00640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f523802c880 tx=0x7f5238004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f5244c00640 1 -- 172.21.15.164:0/847587384 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238043020 con 0x7f5248101b80 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f5244c00640 1 -- 172.21.15.164:0/847587384 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52380054f0 con 0x7f5248101b80 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f524819da40 con 0x7f5248101b80 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f5244c00640 1 -- 172.21.15.164:0/847587384 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5238003cd0 con 0x7f5248101b80 2024-03-27T08:37:33.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.264+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f524819dfe0 con 0x7f5248101b80 2024-03-27T08:37:33.258 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-03-27T08:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.268+0000 7f5251df6740 1 Processor -- start 2024-03-27T08:37:33.260 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.268+0000 7f5251df6740 1 -- start start 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07dae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 0x55f7d07dd970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f7d073ad10 con 0x55f7d07d5980 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7d06e3260 con 0x55f7d07db4e0 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5251df6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7d0736cc0 con 0x55f7d07d6370 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5244c00640 1 -- 172.21.15.164:0/847587384 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f5238046020 con 0x7f5248101b80 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f524d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f5247400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 0x55f7d07dd970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f524d000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55688/0 (socket says 172.21.15.164:55688) 2024-03-27T08:37:33.261 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.269+0000 7f524d000640 1 -- 172.21.15.164:0/1185667949 learned_addr learned my addr 172.21.15.164:0/1185667949 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 -- 172.21.15.164:0/1185667949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 msgr2=0x55f7d07dae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247e00640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07dae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07dae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 -- 172.21.15.164:0/1185667949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 msgr2=0x55f7d07d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 -- 172.21.15.164:0/1185667949 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d06daaa0 con 0x55f7d07db4e0 2024-03-27T08:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f524d000640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:33.263 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247e00640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07dae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:37:33.263 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-03-27T08:37:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f5247400640 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 0x55f7d07dd970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5234009bf0 tx=0x7f5234011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3c9a6026840adf4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f523d600640 1 -- 172.21.15.164:0/1185667949 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234004050 con 0x55f7d07db4e0 2024-03-27T08:37:33.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f523d600640 1 -- 172.21.15.164:0/1185667949 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52340054f0 con 0x55f7d07db4e0 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.270+0000 7f523d600640 1 -- 172.21.15.164:0/1185667949 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5234004da0 con 0x55f7d07db4e0 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.271+0000 7f5244c00640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 0x7f522c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.271+0000 7f5244c00640 1 -- 172.21.15.164:0/847587384 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f52380f19e0 con 0x7f5248101b80 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.271+0000 7f5251df6740 1 -- 172.21.15.164:0/1185667949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 msgr2=0x55f7d07dd970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.271+0000 7f5251df6740 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 0x55f7d07dd970 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5234009bf0 tx=0x7f5234011810 comp rx=0 tx=0).stop 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 -- 172.21.15.164:0/1185667949 shutdown_connections 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07db4e0 0x55f7d07dd970 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07dae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 --2- 172.21.15.164:0/1185667949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 -- 172.21.15.164:0/1185667949 >> 172.21.15.164:0/1185667949 conn(0x55f7d07d0ef0 msgr2=0x55f7d07d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f524d000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 0x7f522c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 -- 172.21.15.164:0/1185667949 shutdown_connections 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.272+0000 7f5251df6740 1 -- 172.21.15.164:0/1185667949 wait complete. 2024-03-27T08:37:33.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f524d000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 0x7f522c0a5bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f524000d5e0 tx=0x7f524000d040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 -- start start 2024-03-27T08:37:33.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 Processor -- start 2024-03-27T08:37:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07e7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f7d07de490 con 0x55f7d07d6370 2024-03-27T08:37:33.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f7d06f6630 con 0x55f7d07d5980 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f7d07de610 con 0x55f7d07db4e0 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.273+0000 7f5251df6740 10 client.0 _ll_register_callbacks cb 0x55f7d06fbc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35644/0 (socket says 172.21.15.164:35644) 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 -- 172.21.15.164:0/663165899 learned_addr learned my addr 172.21.15.164:0/663165899 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55692/0 (socket says 172.21.15.164:55692) 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f524d000640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07e7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 -- 172.21.15.164:0/663165899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 msgr2=0x55f7d07e7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07e7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 -- 172.21.15.164:0/663165899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 msgr2=0x55f7d07e0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247e00640 1 -- 172.21.15.164:0/663165899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d07025f0 con 0x55f7d07d5980 2024-03-27T08:37:33.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.274+0000 7f5247400640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5247e00640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5238006010 tx=0x7f5238004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203519a47b7a83b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5232000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380bd7c0 con 0x55f7d07d5980 2024-03-27T08:37:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f52380d7190 con 0x55f7d07d5980 2024-03-27T08:37:33.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52340054f0 con 0x55f7d07d5980 2024-03-27T08:37:33.269 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-03-27T08:37:33.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5238004c70 con 0x55f7d07d5980 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.275+0000 7f5251df6740 10 client.35711 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f7d044f210 con 0x55f7d07d5980 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52340054f0 con 0x55f7d07d5980 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f52380be0c0 con 0x55f7d07d5980 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 10 client.35711 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 10 client.35711 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 20 client.35711 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d07eba50 0x55f7d07edf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 4 client.35711 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.276+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7d0748250 con 0x55f7d07eba50 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.277+0000 7f5247400640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d07eba50 0x55f7d07edf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.277+0000 7f5247400640 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d07eba50 0x55f7d07edf10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1788c993cce983a server_cookie=8839ff308e5beccc in_seq=0 out_seq=0 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.277+0000 7f5232000640 10 client.35711 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.278+0000 7f5232000640 1 -- 172.21.15.164:0/663165899 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f7d0748250 con 0x55f7d07eba50 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.278+0000 7f5232000640 10 client.35711 handle_command_reply: tid=0 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 client.35711 shutdown 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 msgr2=0x55f7d07dfcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5238006010 tx=0x7f5238004f90 comp rx=0 tx=0).stop 2024-03-27T08:37:33.272 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 shutdown_connections 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d07eba50 0x55f7d07edf10 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07e7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d6370 0x55f7d07e0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 --2- 172.21.15.164:0/663165899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07dfcf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5232000640 0 client.35711 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 >> 172.21.15.164:0/663165899 conn(0x55f7d07d0ef0 msgr2=0x55f7d07d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.279+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 shutdown_connections 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.280+0000 7f5251df6740 1 -- 172.21.15.164:0/663165899 wait complete. 2024-03-27T08:37:33.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.280+0000 7f5251df6740 20 client.35711 trim_cache size 0 max 16384 2024-03-27T08:37:33.275 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-03-27T08:37:33.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 Processor -- start 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 -- start start 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d90a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d7dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541adab0 con 0x555f88d80a90 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541ab380 con 0x555f88d7ef00 2024-03-27T08:37:33.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541a91d0 con 0x555f88d800d0 2024-03-27T08:37:33.280 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.287+0000 7fb058c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35646/0 (socket says 172.21.15.164:35646) 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 -- 172.21.15.164:0/3644764955 learned_addr learned my addr 172.21.15.164:0/3644764955 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d7dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb053400640 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d90a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 -- 172.21.15.164:0/3644764955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 msgr2=0x555f88d90a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d90a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 -- 172.21.15.164:0/3644764955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 msgr2=0x555f88d7dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d7dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.288+0000 7fb058c00640 1 -- 172.21.15.164:0/3644764955 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f88d7b060 con 0x555f88d7ef00 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.289+0000 7fb058c00640 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00ef50 tx=0x7fb04c003d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=932d7ee25316f77c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.289+0000 7fb03fe00640 1 -- 172.21.15.164:0/3644764955 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x555f88d7ef00 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.289+0000 7fb03fe00640 1 -- 172.21.15.164:0/3644764955 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb04c00ddc0 con 0x555f88d7ef00 2024-03-27T08:37:33.281 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.289+0000 7fb03fe00640 1 -- 172.21.15.164:0/3644764955 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004a20 con 0x555f88d7ef00 2024-03-27T08:37:33.282 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3644764955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 msgr2=0x555f88d89980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb04c00ef50 tx=0x7fb04c003d10 comp rx=0 tx=0).stop 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3644764955 shutdown_connections 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d7dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d800d0 0x555f88d90a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.285 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/3644764955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d7ef00 0x555f88d89980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3644764955 >> 172.21.15.164:0/3644764955 conn(0x555f88d7a2f0 msgr2=0x555f88d7d550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3644764955 shutdown_connections 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- 172.21.15.164:0/3644764955 wait complete. 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.290+0000 7fb05d9ac740 1 -- start start 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 Processor -- start 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d7ef00 0x555f88d90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541a9840 con 0x555f88d80a90 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541aacb0 con 0x555f88d800d0 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb0541a9f10 con 0x555f88d7ef00 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb05d9ac740 10 client.0 _ll_register_callbacks cb 0x7fb04c00dc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:33.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb058c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb053400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d909b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb053400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d909b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35652/0 (socket says 172.21.15.164:35652) 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb053400640 1 -- 172.21.15.164:0/1222919517 learned_addr learned my addr 172.21.15.164:0/1222919517 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.291+0000 7fb058c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55706/0 (socket says 172.21.15.164:55706) 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d7ef00 0x555f88d90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 -- 172.21.15.164:0/1222919517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d7ef00 msgr2=0x555f88d90470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d7ef00 0x555f88d90470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 -- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 msgr2=0x555f88d909b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d909b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 -- 172.21.15.164:0/1222919517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f88d8f330 con 0x555f88d80a90 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb058c00640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009ba0 tx=0x7fb04c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c41ea5745f996f7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb03d600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb04c004160 con 0x555f88d80a90 2024-03-27T08:37:33.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb04c003970 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.292+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb04c00ddc0 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb04c00d830 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 10 client.16035 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x555f88e047e0 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb04c00ddc0 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7fb04c00b040 con 0x555f88d80a90 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 10 client.16035 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 10 client.16035 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 20 client.16035 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88e050d0 0x555f88e074f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 4 client.16035 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.293+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555f88cebb10 con 0x555f88e050d0 2024-03-27T08:37:33.288 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.294+0000 7fb053400640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88e050d0 0x555f88e074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.294+0000 7fb053400640 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88e050d0 0x555f88e074f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea3cca08d0f8825c server_cookie=5bb3d5af88594d6 in_seq=0 out_seq=0 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.294+0000 7fb03d600640 10 client.16035 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.295+0000 7fb03d600640 1 -- 172.21.15.164:0/1222919517 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555f88cebb10 con 0x555f88e050d0 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.295+0000 7fb03d600640 10 client.16035 handle_command_reply: tid=0 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.295+0000 7fb05d9ac740 1 client.16035 shutdown 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.295+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 msgr2=0x555f88d8eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.295+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fb04c009ba0 tx=0x7fb04c009780 comp rx=0 tx=0).stop 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 shutdown_connections 2024-03-27T08:37:33.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555f88e050d0 0x555f88e074f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555f88d80a90 0x555f88d8eb00 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555f88d800d0 0x555f88d909b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 --2- 172.21.15.164:0/1222919517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555f88d7ef00 0x555f88d90470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 >> 172.21.15.164:0/1222919517 conn(0x555f88d7a2f0 msgr2=0x555f88d89800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb03d600640 0 client.16035 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 shutdown_connections 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 1 -- 172.21.15.164:0/1222919517 wait complete. 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.296+0000 7fb05d9ac740 20 client.16035 trim_cache size 0 max 16384 2024-03-27T08:37:33.291 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:37:33.292 INFO:teuthology.orchestra.run.smithi164.stdout: "return_code": 0, 2024-03-27T08:37:33.292 INFO:teuthology.orchestra.run.smithi164.stdout: "scrub_tag": "39b84006-77a4-4d52-b8d8-278a9fae3e45", 2024-03-27T08:37:33.292 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": "asynchronous" 2024-03-27T08:37:33.292 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:37:33.292 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 msgr2=0x7fb0380a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 0x7fb0380a5b50 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb044032570 tx=0x7fb0440f5a90 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 msgr2=0x7fb05419a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb04402c0d0 tx=0x7fb044034830 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 shutdown_connections 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb0380a3690 0x7fb0380a5b50 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb054105940 0x7fb0541a1660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb054104f80 0x7fb05419a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 --2- 172.21.15.164:0/31109362 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb054103d90 0x7fb05419a0b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 >> 172.21.15.164:0/31109362 conn(0x7fb0540ff300 msgr2=0x7fb054108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.293 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 shutdown_connections 2024-03-27T08:37:33.294 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-03-27T08:37:33.294 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.297+0000 7fb05ac00640 1 -- 172.21.15.164:0/31109362 wait complete. 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 Processor -- start 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 -- start start 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07d4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a9620 con 0x55f7d07d5980 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a6ef0 con 0x55f7d07d6370 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.302+0000 7f5251df6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a4d40 con 0x55f7d07db4e0 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35658/0 (socket says 172.21.15.164:35658) 2024-03-27T08:37:33.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247400640 1 -- 172.21.15.164:0/2212366755 learned_addr learned my addr 172.21.15.164:0/2212366755 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f524d000640 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07d4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 -- 172.21.15.164:0/2212366755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 msgr2=0x55f7d07d4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07d4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 -- 172.21.15.164:0/2212366755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 msgr2=0x55f7d07e7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247e00640 1 -- 172.21.15.164:0/2212366755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7d051b620 con 0x55f7d07d5980 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.303+0000 7f5247400640 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.304+0000 7f5247e00640 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d12d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5238005ab0 tx=0x7f52380f1c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76252722a9c5fa8d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.304+0000 7f523cc00640 1 -- 172.21.15.164:0/2212366755 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380bdc30 con 0x55f7d07d5980 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.304+0000 7f523cc00640 1 -- 172.21.15.164:0/2212366755 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5238004c70 con 0x55f7d07d5980 2024-03-27T08:37:33.297 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.304+0000 7f523cc00640 1 -- 172.21.15.164:0/2212366755 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380c6640 con 0x55f7d07d5980 2024-03-27T08:37:33.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 -- 172.21.15.164:0/2212366755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 msgr2=0x55f7d07d12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d12d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f5238005ab0 tx=0x7f52380f1c60 comp rx=0 tx=0).stop 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 -- 172.21.15.164:0/2212366755 shutdown_connections 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07db4e0 0x55f7d07d4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d6370 0x55f7d07e7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 --2- 172.21.15.164:0/2212366755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07d5980 0x55f7d07d12d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 -- 172.21.15.164:0/2212366755 >> 172.21.15.164:0/2212366755 conn(0x55f7d07d0ef0 msgr2=0x55f7d07d6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 -- 172.21.15.164:0/2212366755 shutdown_connections 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.305+0000 7f5251df6740 1 -- 172.21.15.164:0/2212366755 wait complete. 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.306+0000 7f5251df6740 1 -- start start 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.306+0000 7f5251df6740 1 Processor -- start 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07e46c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07db4e0 0x55f7d084fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a53b0 con 0x55f7d07db4e0 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a6820 con 0x55f7d07d5980 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f52481a5a80 con 0x55f7d07d6370 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5251df6740 10 client.0 _ll_register_callbacks cb 0x7f52380f4f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5247e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5247e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:35668/0 (socket says 172.21.15.164:35668) 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5247e00640 1 -- 172.21.15.164:0/936556023 learned_addr learned my addr 172.21.15.164:0/936556023 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f524d000640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07db4e0 0x55f7d084fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.307+0000 7f5247400640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07e46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 -- 172.21.15.164:0/936556023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 msgr2=0x55f7d07e46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07e46c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 -- 172.21.15.164:0/936556023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07db4e0 msgr2=0x55f7d084fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07db4e0 0x55f7d084fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 -- 172.21.15.164:0/936556023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7d0850380 con 0x55f7d07d5980 2024-03-27T08:37:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5247e00640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52380bdb60 tx=0x7f5238004f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bf889ae448565 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5232000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52380bdc30 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f52380bd4b0 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.308+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5238004c70 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.309+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f52380ef5a0 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.309+0000 7f5251df6740 10 client.35723 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.309+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f7d0850380 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.309+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5238004c70 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.309+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f52380c3430 con 0x55f7d07d5980 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 10 client.35723 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:33.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 10 client.35723 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 20 client.35723 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d0851c20 0x55f7d0854040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 4 client.35723 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:37:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f7d07425a0 con 0x55f7d0851c20 2024-03-27T08:37:33.304 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-03-27T08:37:33.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.310+0000 7f5247400640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d0851c20 0x55f7d0854040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.311+0000 7f5247400640 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d0851c20 0x55f7d0854040 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a989683f52131a4d server_cookie=59ada400471f0c3b in_seq=0 out_seq=0 2024-03-27T08:37:33.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:33.311+0000 7f5232000640 10 client.35723 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:37:33.309 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:37:33.480 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-03-27T08:37:33.487 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-03-27T08:37:33.500 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-03-27T08:37:33.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-03-27T08:37:33.519 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-03-27T08:37:33.527 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-03-27T08:37:33.533 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-03-27T08:37:33.540 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/ 2024-03-27T08:37:33.545 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-03-27T08:37:33.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-03-27T08:37:33.558 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-03-27T08:37:33.564 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-03-27T08:37:33.571 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-03-27T08:37:33.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.584+0000 7f3f36a00640 1 -- 172.21.15.164:0/2132749072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30077750 msgr2=0x7f3f30077bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.576 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.584+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2132749072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30077750 0x7f3f30077bb0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c009900 tx=0x7f3f1c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 -- 172.21.15.164:0/2132749072 shutdown_connections 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2132749072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f30078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2132749072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30077750 0x7f3f30077bb0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2132749072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30076510 0x7f3f30076930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 -- 172.21.15.164:0/2132749072 >> 172.21.15.164:0/2132749072 conn(0x7f3f300ff300 msgr2=0x7f3f30101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 -- 172.21.15.164:0/2132749072 shutdown_connections 2024-03-27T08:37:33.577 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.585+0000 7f3f36a00640 1 -- 172.21.15.164:0/2132749072 wait complete. 2024-03-27T08:37:33.578 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-03-27T08:37:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.586+0000 7f3f36a00640 1 Processor -- start 2024-03-27T08:37:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.586+0000 7f3f36a00640 1 -- start start 2024-03-27T08:37:33.578 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 0x7f3f3019ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f301a5ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113e30 con 0x7f3f30076510 2024-03-27T08:37:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113cb0 con 0x7f3f30077750 2024-03-27T08:37:33.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f36a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f30113fb0 con 0x7f3f300780f0 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f2fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f2fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55742/0 (socket says 172.21.15.164:55742) 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f2fe00640 1 -- 172.21.15.164:0/2477476514 learned_addr learned my addr 172.21.15.164:0/2477476514 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.587+0000 7f3f2f400640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 0x7f3f3019ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f34a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f301a5ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2f400640 1 -- 172.21.15.164:0/2477476514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 msgr2=0x7f3f301a5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2f400640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f301a5ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2f400640 1 -- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 msgr2=0x7f3f3019e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2f400640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2f400640 1 -- 172.21.15.164:0/2477476514 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f301a6150 con 0x7f3f30077750 2024-03-27T08:37:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f34a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f301a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:37:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.588+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:33.581 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.589+0000 7f3f2f400640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 0x7f3f3019ea70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c036040 tx=0x7f3f1c004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.590+0000 7f3f2cc00640 1 -- 172.21.15.164:0/2477476514 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c043020 con 0x7f3f30077750 2024-03-27T08:37:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.590+0000 7f3f2cc00640 1 -- 172.21.15.164:0/2477476514 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f1c005460 con 0x7f3f30077750 2024-03-27T08:37:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.590+0000 7f3f2cc00640 1 -- 172.21.15.164:0/2477476514 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c003cd0 con 0x7f3f30077750 2024-03-27T08:37:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.590+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f301a63e0 con 0x7f3f30077750 2024-03-27T08:37:33.582 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.590+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f301a68b0 con 0x7f3f30077750 2024-03-27T08:37:33.583 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-03-27T08:37:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.594+0000 7f3f39792740 1 Processor -- start 2024-03-27T08:37:33.586 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 -- start start 2024-03-27T08:37:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c3ea0 0x55b5791c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c9010 0x55b5791cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b5791296b0 con 0x55b5791c34b0 2024-03-27T08:37:33.587 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5790d1750 con 0x55b5791c9010 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f39792740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b579125660 con 0x55b5791c3ea0 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f34a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f34a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55750/0 (socket says 172.21.15.164:55750) 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.595+0000 7f3f34a00640 1 -- 172.21.15.164:0/1329345782 learned_addr learned my addr 172.21.15.164:0/1329345782 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c3ea0 0x55b5791c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f2f400640 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c9010 0x55b5791cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 -- 172.21.15.164:0/1329345782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c3ea0 msgr2=0x55b5791c89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c3ea0 0x55b5791c89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 -- 172.21.15.164:0/1329345782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c9010 msgr2=0x55b5791cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c9010 0x55b5791cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 -- 172.21.15.164:0/1329345782 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b578f077d0 con 0x55b5791c34b0 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.596+0000 7f3f34a00640 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f28008dd0 tx=0x7f3f2800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba693ed1bd946b1b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.597+0000 7f3f25200640 1 -- 172.21.15.164:0/1329345782 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800f830 con 0x55b5791c34b0 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.597+0000 7f3f25200640 1 -- 172.21.15.164:0/1329345782 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f2800de20 con 0x55b5791c34b0 2024-03-27T08:37:33.589 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.597+0000 7f3f25200640 1 -- 172.21.15.164:0/1329345782 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f2800ede0 con 0x55b5791c34b0 2024-03-27T08:37:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 -- 172.21.15.164:0/1329345782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 msgr2=0x55b5791c38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f3f28008dd0 tx=0x7f3f2800d710 comp rx=0 tx=0).stop 2024-03-27T08:37:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 -- 172.21.15.164:0/1329345782 shutdown_connections 2024-03-27T08:37:33.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c9010 0x55b5791cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c3ea0 0x55b5791c89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 --2- 172.21.15.164:0/1329345782 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c34b0 0x55b5791c38d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f39792740 1 -- 172.21.15.164:0/1329345782 >> 172.21.15.164:0/1329345782 conn(0x55b5791bea20 msgr2=0x55b5791bee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.598+0000 7f3f2cc00640 1 -- 172.21.15.164:0/2477476514 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3f1c046020 con 0x7f3f30077750 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.599+0000 7f3f39792740 1 -- 172.21.15.164:0/1329345782 shutdown_connections 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.599+0000 7f3f39792740 1 -- 172.21.15.164:0/1329345782 wait complete. 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.599+0000 7f3f39792740 1 -- start start 2024-03-27T08:37:33.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.599+0000 7f3f39792740 1 Processor -- start 2024-03-27T08:37:33.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55b5791cbfc0 con 0x55b5791d30c0 2024-03-27T08:37:33.593 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b5790e4a80 con 0x55b5791c3ea0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55b5791cc140 con 0x55b5791c34b0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.600+0000 7f3f39792740 10 client.0 _ll_register_callbacks cb 0x55b5790e4470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2cc00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 0x7f3f140a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:55766/0 (socket says 172.21.15.164:55766) 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 -- 172.21.15.164:0/3543138503 learned_addr learned my addr 172.21.15.164:0/3543138503 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f34a00640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2cc00640 1 -- 172.21.15.164:0/2477476514 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3f1c0f8a90 con 0x7f3f30077750 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f34a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 0x7f3f140a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 -- 172.21.15.164:0/3543138503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 msgr2=0x55b5791cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.594 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 -- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 msgr2=0x55b5791ce090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.601+0000 7f3f2f400640 1 -- 172.21.15.164:0/3543138503 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b578e3d3f0 con 0x55b5791d30c0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0f65a0 tx=0x7f3f1c02bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd08854800ad2de7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f19600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0c4950 con 0x55b5791d30c0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f34a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 0x7f3f140a5a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f28008da0 tx=0x7f3f2800d710 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3f1c0c32f0 con 0x55b5791d30c0 2024-03-27T08:37:33.595 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f2800de20 con 0x55b5791d30c0 2024-03-27T08:37:33.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3f1c0c3130 con 0x55b5791d30c0 2024-03-27T08:37:33.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f39792740 10 client.16053 fetch_fsmap learned FSMap version 26 2024-03-27T08:37:33.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.602+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b578dfd0f0 con 0x55b5791d30c0 2024-03-27T08:37:33.596 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f2800de20 con 0x55b5791d30c0 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 26) ==== 8346+0+0 (secure 0 0 0) 0x7f3f1c0de120 con 0x55b5791d30c0 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 10 client.16053 fetch_fsmap finished waiting for FSMap version 26 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 10 client.16053 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 20 client.16053 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5791d9de0 0x55b5791dc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 4 client.16053 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.603+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b579136bf0 con 0x55b5791d9de0 2024-03-27T08:37:33.597 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.604+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5791d9de0 0x55b5791dc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:33.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-03-27T08:37:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.605+0000 7f3f19600640 10 client.16053 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:33.598 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:33.605+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5791d9de0 0x55b5791dc200 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d285a3473d32319a server_cookie=b829604b683f426b in_seq=0 out_seq=0 2024-03-27T08:37:33.602 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-03-27T08:37:33.607 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-03-27T08:37:33.614 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-03-27T08:37:33.618 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-03-27T08:37:33.627 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-03-27T08:37:33.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-03-27T08:37:33.639 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/ 2024-03-27T08:37:33.644 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-03-27T08:37:33.650 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-03-27T08:37:33.656 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/driver 2024-03-27T08:37:33.663 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-03-27T08:37:33.668 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-03-27T08:37:33.674 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-03-27T08:37:33.680 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-03-27T08:37:33.687 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-03-27T08:37:33.693 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-03-27T08:37:33.701 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sh/ 2024-03-27T08:37:33.706 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-03-27T08:37:33.711 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-03-27T08:37:33.715 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-03-27T08:37:33.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/ 2024-03-27T08:37:33.726 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-03-27T08:37:33.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-03-27T08:37:33.744 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-03-27T08:37:33.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-03-27T08:37:33.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:33 smithi164 ceph-mon[31788]: scrub queued for path: / 2024-03-27T08:37:33.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:33 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:33.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:33 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:37:33.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:33 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:37:33.757 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-03-27T08:37:33.762 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-03-27T08:37:33.766 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-03-27T08:37:33.773 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-03-27T08:37:33.777 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-03-27T08:37:33.784 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-03-27T08:37:33.790 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-03-27T08:37:33.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-03-27T08:37:33.803 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-03-27T08:37:33.808 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-03-27T08:37:33.815 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-03-27T08:37:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-mon[34903]: scrub queued for path: / 2024-03-27T08:37:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:37:33.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.564+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000312 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl auth v114 ap=1 s=21084 n(v0 rc2024-03-27T08:37:00.743698+0000 b21084 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafd2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000312:[<0x10000000310/80211.tmpl v114>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000312:[<0x10000000310/80211.tmpl v114>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.566+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000323 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl auth v153 ap=1 s=12313 n(v0 rc2024-03-27T08:37:00.958520+0000 b12313 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000323:[<0x10000000310/lsm.tmpl v38>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000323:[<0x10000000310/lsm.tmpl v153>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.566+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000321 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl auth v149 ap=1 s=47759 n(v0 rc2024-03-27T08:37:00.939272+0000 b47759 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafa7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000321:[<0x10000000310/libata.tmpl v34>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000321:[<0x10000000310/libata.tmpl v149>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.566+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ea [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl auth v197 ap=1 s=3019 n(v0 rc2024-03-27T08:37:03.239788+0000 b3019 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2ead38680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ea:[<0x10000000310/networking.tmpl v82>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ea:[<0x10000000310/networking.tmpl v197>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.567+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl auth v138 ap=1 s=42994 n(v0 rc2024-03-27T08:37:00.891660+0000 b42994 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2e9e68b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031e:[<0x10000000310/kernel-hacking.tmpl v138>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031e:[<0x10000000310/kernel-hacking.tmpl v138>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.567+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003eb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl auth v199 ap=1 s=4673 n(v0 rc2024-03-27T08:37:03.247977+0000 b4673 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003eb:[<0x10000000310/rapidio.tmpl v84>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003eb:[<0x10000000310/rapidio.tmpl v199>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.568+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl auth v223 ap=1 s=17434 n(v0 rc2024-03-27T08:37:03.391212+0000 b17434 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f7:[<0x10000000310/writing_usb_driver.tmpl v108>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f7:[<0x10000000310/writing_usb_driver.tmpl v223>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.569+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl auth v221 ap=1 s=32788 n(v0 rc2024-03-27T08:37:03.380364+0000 b32788 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f6:[<0x10000000310/writing_musb_glue_layer.tmpl v106>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f6:[<0x10000000310/writing_musb_glue_layer.tmpl v221>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.569+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl auth v134 ap=1 s=17776 n(v0 rc2024-03-27T08:37:00.869442+0000 b17776 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafd4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031c:[<0x10000000310/genericirq.tmpl v134>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031c:[<0x10000000310/genericirq.tmpl v134>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.569+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl auth v130 ap=1 s=13396 n(v0 rc2024-03-27T08:37:00.849347+0000 b13396 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafd3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031a:[<0x10000000310/filesystems.tmpl v130>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031a:[<0x10000000310/filesystems.tmpl v130>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.820 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.570+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl auth v219 ap=1 s=204945 n(v0 rc2024-03-27T08:37:03.368327+0000 b204945 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f5:[<0x10000000310/writing-an-alsa-driver.tmpl v104>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f5:[<0x10000000310/writing-an-alsa-driver.tmpl v219>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.571+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000314 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl auth v118 ap=1 s=4083 n(v0 rc2024-03-27T08:37:00.762292+0000 b4083 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafd4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000314:[<0x10000000310/alsa-driver-api.tmpl v118>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000314:[<0x10000000310/alsa-driver-api.tmpl v118>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.571+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl auth v132 ap=1 s=30636 n(v0 rc2024-03-27T08:37:00.861475+0000 b30636 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafd4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031b:[<0x10000000310/gadget.tmpl v132>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031b:[<0x10000000310/gadget.tmpl v132>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.571+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl auth v225 ap=1 s=15068 n(v0 rc2024-03-27T08:37:03.400915+0000 b15068 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb010000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f8:[<0x10000000310/z8530book.tmpl v110>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f8:[<0x10000000310/z8530book.tmpl v225>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.571+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl auth v217 ap=1 s=2565 n(v0 rc2024-03-27T08:37:03.336174+0000 b2565 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eafd5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f4:[<0x10000000310/w1.tmpl v102>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f4:[<0x10000000310/w1.tmpl v217>,<0x10000000203/DocBook v1365>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.574+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl auth v209 ap=1 s=445 n(v0 rc2024-03-27T08:37:03.297616+0000 b445 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb010580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f0:[<0x10000000310/stylesheet.xsl v94>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f0:[<0x10000000310/stylesheet.xsl v209>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.574+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000315 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl auth v120 ap=1 s=42733 n(v0 rc2024-03-27T08:37:00.775167+0000 b42733 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb011b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000315:[<0x10000000310/crypto-API.tmpl v120>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000315:[<0x10000000310/crypto-API.tmpl v120>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.821 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-03-27T08:37:33.824 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.574+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl auth v213 ap=1 s=36757 n(v0 rc2024-03-27T08:37:03.317102+0000 b36757 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb010b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f2:[<0x10000000310/uio-howto.tmpl v98>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f2:[<0x10000000310/uio-howto.tmpl v213>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.575+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000313 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile auth v116 ap=1 s=7239 n(v0 rc2024-03-27T08:37:00.752347+0000 b7239 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb011080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000313:[<0x10000000310/Makefile v116>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000313:[<0x10000000310/Makefile v116>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.576+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ed [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl auth v203 ap=1 s=5529 n(v0 rc2024-03-27T08:37:03.266913+0000 b5529 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb011600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ed:[<0x10000000310/s390-drivers.tmpl v88>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ed:[<0x10000000310/s390-drivers.tmpl v203>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.576+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000319 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl auth v128 ap=1 s=176629 n(v0 rc2024-03-27T08:37:00.837760+0000 b176629 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb012680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000319:[<0x10000000310/drm.tmpl v128>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000319:[<0x10000000310/drm.tmpl v128>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.577+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000317 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl auth v124 ap=1 s=15099 n(v0 rc2024-03-27T08:37:00.798675+0000 b15099 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb012c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000317:[<0x10000000310/device-drivers.tmpl v124>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000317:[<0x10000000310/device-drivers.tmpl v124>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.577+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ee [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl auth v205 ap=1 s=14839 n(v0 rc2024-03-27T08:37:03.279443+0000 b14839 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb012100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ee:[<0x10000000310/scsi.tmpl v90>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ee:[<0x10000000310/scsi.tmpl v205>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.577+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000318 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl auth v126 ap=1 s=11289 n(v0 rc2024-03-27T08:37:00.807146+0000 b11289 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb013700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000318:[<0x10000000310/deviceiobook.tmpl v126>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000318:[<0x10000000310/deviceiobook.tmpl v126>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.578+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000320 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl auth v147 ap=1 s=42592 n(v0 rc2024-03-27T08:37:00.926726+0000 b42592 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb013180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000320:[<0x10000000310/kgdb.tmpl v32>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000320:[<0x10000000310/kgdb.tmpl v147>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.578+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl auth v193 ap=1 s=6754 n(v0 rc2024-03-27T08:37:03.217082+0000 b6754 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb016000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e8:[<0x10000000310/media_api.tmpl v78>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e8:[<0x10000000310/media_api.tmpl v193>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.580+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000322 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl auth v151 ap=1 s=8222 n(v0 rc2024-03-27T08:37:00.950065+0000 b8222 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb016b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000322:[<0x10000000310/librs.tmpl v36>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000322:[<0x10000000310/librs.tmpl v151>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.580+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl auth v140 ap=1 s=67799 n(v0 rc2024-03-27T08:37:00.911300+0000 b67799 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb016580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031f:[<0x10000000310/kernel-locking.tmpl v140>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031f:[<0x10000000310/kernel-locking.tmpl v140>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.581+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000311 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore auth v112 ap=1 s=116 n(v0 rc2024-03-27T08:37:00.732598+0000 b116 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb017600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000311:[<0x10000000310/.gitignore v112>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000311:[<0x10000000310/.gitignore v112>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.825 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.581+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl auth v211 ap=1 s=3410 n(v0 rc2024-03-27T08:37:03.305909+0000 b3410 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb017080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f1:[<0x10000000310/tracepoint.tmpl v96>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f1:[<0x10000000310/tracepoint.tmpl v211>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.581+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000316 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl auth v122 ap=1 s=15870 n(v0 rc2024-03-27T08:37:00.787683+0000 b15870 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb017b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000316:[<0x10000000310/debugobjects.tmpl v122>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000316:[<0x10000000310/debugobjects.tmpl v122>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.582+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl auth v136 ap=1 s=8816 n(v0 rc2024-03-27T08:37:00.878178+0000 b8816 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb018100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000031d:[<0x10000000310/kernel-api.tmpl v136>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000031d:[<0x10000000310/kernel-api.tmpl v136>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.582+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ef [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl auth v207 ap=1 s=2671 n(v0 rc2024-03-27T08:37:03.288930+0000 b2671 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb019180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ef:[<0x10000000310/sh.tmpl v92>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ef:[<0x10000000310/sh.tmpl v207>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.583+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000324 [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/ auth v191 ap=1 f(v0 m2024-03-27T08:37:03.199383+0000 16=14+2) n(v1 rc2024-03-27T08:37:03.208657+0000 b2354416 196=193+3) (inest lock) (ifile excl) caps={15285=pAsLsXsFsx/AsLsXsFsx@1},l=15285 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb019700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000324:[<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x10000000324:[<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:37:03.199383+0000 16=14+2)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:37:03.204733+0000 b2354416 196=193+3)","memory_value.dirstat":"f(v0 m2024-03-27T08:37:03.199383+0000 16=14+2)","memory_value.rstat":"n(v1 rc2024-03-27T08:37:03.208657+0000 b2354416 196=193+3)","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.583+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl auth v195 ap=1 s=44428 n(v0 rc2024-03-27T08:37:03.230586+0000 b44428 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb020000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e9:[<0x10000000310/mtdnand.tmpl v80>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e9:[<0x10000000310/mtdnand.tmpl v195>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.591+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ec [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl auth v201 ap=1 s=10042 n(v0 rc2024-03-27T08:37:03.258003+0000 b10042 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb018680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ec:[<0x10000000310/regulator.tmpl v86>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ec:[<0x10000000310/regulator.tmpl v201>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.591+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 auth v441 ap=1 s=16389 n(v0 rc2024-03-27T08:37:01.240929+0000 b16389 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb020580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033c:[<0x10000000324/pipeline.png.b64 v48>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000033c:[<0x10000000324/pipeline.png.b64 v441>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.592+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/ auth fragtree_t(*^3) v777 ap=1 f(v0 m2024-03-27T08:37:03.164276+0000 166=166+0) n(v0 rc2024-03-27T08:37:03.174585+0000 b1802353 167=166+1) (inest lock) (ifile excl) caps={15285=pAsLsXsFsx/AsLsXsFsx@1},l=15285 | importingcaps=0 dirfrag=8 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb020b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000033e:[<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x1000000033e:[<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:37:03.164276+0000 166=166+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:37:03.170459+0000 b1802353 167=166+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:37:03.164276+0000 166=166+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:37:03.174585+0000 b1802353 167=166+1)","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.593+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003f3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl auth v215 ap=1 s=39371 n(v0 rc2024-03-27T08:37:03.328950+0000 b39371 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb018c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003f3:[<0x10000000310/usb.tmpl v100>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003f3:[<0x10000000310/usb.tmpl v215>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.593+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 auth v779 ap=1 s=6408 n(v0 rc2024-03-27T08:37:03.184297+0000 b6408 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb021080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e5:[<0x10000000324/vbi_525.gif.b64 v388>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e5:[<0x10000000324/vbi_525.gif.b64 v779>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.594+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000337 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 auth v431 ap=1 s=30606 n(v0 rc2024-03-27T08:37:01.187072+0000 b30606 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb021600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000337:[<0x10000000324/dvbstb.png.b64 v38>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000337:[<0x10000000324/dvbstb.png.b64 v431>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.826 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.595+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000326 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 auth v397 ap=1 s=13139 n(v0 rc2024-03-27T08:37:00.985314+0000 b13139 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb021b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000326:[<0x10000000324/bayer.png.b64 v4>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000326:[<0x10000000324/bayer.png.b64 v397>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.595+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64 auth v443 ap=1 s=15830 n(v0 rc2024-03-27T08:37:01.251202+0000 b15830 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb022100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033d:[<0x10000000324/selection.png.b64 v50>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000033d:[<0x10000000324/selection.png.b64 v443>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.596+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000325 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile auth v395 ap=1 s=13518 n(v0 rc2024-03-27T08:37:00.975529+0000 b13518 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb022680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000325:[<0x10000000324/Makefile v2>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000325:[<0x10000000324/Makefile v395>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.598+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 auth v783 ap=1 s=3243 n(v0 rc2024-03-27T08:37:03.204733+0000 b3243 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb023700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e7:[<0x10000000324/vbi_hsync.gif.b64 v392>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e7:[<0x10000000324/vbi_hsync.gif.b64 v783>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.599+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000339 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 auth v435 ap=1 s=34209 n(v0 rc2024-03-27T08:37:01.210725+0000 b34209 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb022c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000339:[<0x10000000324/fieldseq_tb.gif.b64 v42>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000339:[<0x10000000324/fieldseq_tb.gif.b64 v435>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.599+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 auth v781 ap=1 s=6886 n(v0 rc2024-03-27T08:37:03.195139+0000 b6886 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb023180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e6:[<0x10000000324/vbi_625.gif.b64 v390>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e6:[<0x10000000324/vbi_625.gif.b64 v781>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.599+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000328 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 auth v401 ap=1 s=8061 n(v0 rc2024-03-27T08:37:01.002591+0000 b8061 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000328:[<0x10000000324/crop.gif.b64 v8>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000328:[<0x10000000324/crop.gif.b64 v401>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.600+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 auth v437 ap=1 s=2849 n(v0 rc2024-03-27T08:37:01.219357+0000 b2849 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033a:[<0x10000000324/nv12mt.gif.b64 v44>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000033a:[<0x10000000324/nv12mt.gif.b64 v437>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.827 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.601+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000329 [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ auth v429 ap=1 f(v0 m2024-03-27T08:37:01.159615+0000 13=13+0) n(v0 rc2024-03-27T08:37:01.175421+0000 b352826 14=13+1) (inest lock) (ifile excl) caps={15285=pAsLsXsFsx/AsLsXsFsx@1},l=15285 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000329:[<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x10000000329:[<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:37:01.159615+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:37:01.170729+0000 b352826 14=13+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:37:01.159615+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:37:01.175421+0000 b352826 14=13+1)","error_str":""},"return_code":0} 2024-03-27T08:37:33.828 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.601+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000327 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 auth v399 ap=1 s=4479 n(v0 rc2024-03-27T08:37:00.994638+0000 b4479 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000327:[<0x10000000324/constraints.png.b64 v6>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000327:[<0x10000000324/constraints.png.b64 v399>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.828 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.602+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000338 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 auth v433 ap=1 s=34355 n(v0 rc2024-03-27T08:37:01.198497+0000 b34355 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000338:[<0x10000000324/fieldseq_bt.gif.b64 v40>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000338:[<0x10000000324/fieldseq_bt.gif.b64 v433>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.828 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.602+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 auth v439 ap=1 s=9265 n(v0 rc2024-03-27T08:37:01.229365+0000 b9265 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033b:[<0x10000000324/nv12mt_example.gif.b64 v46>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000033b:[<0x10000000324/nv12mt_example.gif.b64 v439>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.828 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.602+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000363 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml auth v314 ap=1 s=5857 n(v0 rc2024-03-27T08:37:01.679479+0000 b5857 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000363:[<0x1000000033e/keytable.c.xml v74>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000363:[<0x1000000033e/keytable.c.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.828 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.603+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml auth v312 ap=1 s=15212 n(v0 rc2024-03-27T08:37:01.462348+0000 b15212 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034e:[<0x1000000033e/dev-raw-vbi.xml v32>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034e:[<0x1000000033e/dev-raw-vbi.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.604+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000341 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml auth v308 ap=1 s=19821 n(v0 rc2024-03-27T08:37:01.287747+0000 b19821 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000341:[<0x1000000033e/capture.c.xml v6>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000341:[<0x1000000033e/capture.c.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.605+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml auth v342 ap=1 s=2055 n(v0 rc2024-03-27T08:37:03.060055+0000 b2055 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d9:[<0x1000000033e/vidioc-querystd.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d9:[<0x1000000033e/vidioc-querystd.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.605+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000364 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml auth v316 ap=1 s=8441 n(v0 rc2024-03-27T08:37:01.691308+0000 b8441 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb034000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000364:[<0x1000000033e/libv4l.xml v76>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000364:[<0x1000000033e/libv4l.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.605+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml auth v322 ap=1 s=2287 n(v0 rc2024-03-27T08:37:01.918772+0000 b2287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb02f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037a:[<0x1000000033e/pixfmt-sbggr8.xml v120>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037a:[<0x1000000033e/pixfmt-sbggr8.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.605+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000373 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml auth v320 ap=1 s=2648 n(v0 rc2024-03-27T08:37:01.843521+0000 b2648 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb034580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000373:[<0x1000000033e/pixfmt-nv12mt.xml v106>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000373:[<0x1000000033e/pixfmt-nv12mt.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.606+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml auth v344 ap=1 s=5103 n(v0 rc2024-03-27T08:37:03.151336+0000 b5103 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb034b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e2:[<0x1000000033e/vidioc-subdev-g-frame-interval.xml v306>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e2:[<0x1000000033e/vidioc-subdev-g-frame-interval.xml v344>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.606+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003af [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml auth v328 ap=1 s=6709 n(v0 rc2024-03-27T08:37:02.486965+0000 b6709 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb035080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003af:[<0x1000000033e/vidioc-dv-timings-cap.xml v226>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003af:[<0x1000000033e/vidioc-dv-timings-cap.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.606+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000343 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml auth v310 ap=1 s=105367 n(v0 rc2024-03-27T08:37:01.323428+0000 b105367 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb035b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000343:[<0x1000000033e/compat.xml v10>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000343:[<0x1000000033e/compat.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.829 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.607+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml auth v340 ap=1 s=8979 n(v0 rc2024-03-27T08:37:02.774266+0000 b8979 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb036100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cd:[<0x1000000033e/vidioc-g-selection.xml v286>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003cd:[<0x1000000033e/vidioc-g-selection.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.608+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml auth v332 ap=1 s=6193 n(v0 rc2024-03-27T08:37:02.665348+0000 b6193 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb035600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c2:[<0x1000000033e/vidioc-g-enc-index.xml v264>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c2:[<0x1000000033e/vidioc-g-enc-index.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.608+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf auth v318 ap=1 s=20276 n(v0 rc2024-03-27T08:37:01.795310+0000 b20276 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb036680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036e:[<0x1000000033e/pipeline.pdf v96>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036e:[<0x1000000033e/pipeline.pdf v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.609+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml auth v334 ap=1 s=17143 n(v0 rc2024-03-27T08:37:02.674616+0000 b17143 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb037180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c3:[<0x1000000033e/vidioc-g-ext-ctrls.xml v266>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c3:[<0x1000000033e/vidioc-g-ext-ctrls.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.609+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml auth v336 ap=1 s=7285 n(v0 rc2024-03-27T08:37:02.693580+0000 b7285 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb036c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c5:[<0x1000000033e/vidioc-g-fmt.xml v270>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c5:[<0x1000000033e/vidioc-g-fmt.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.609+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml auth v330 ap=1 s=10512 n(v0 rc2024-03-27T08:37:02.569906+0000 b10512 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eaf9c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b8:[<0x1000000033e/vidioc-enuminput.xml v244>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b8:[<0x1000000033e/vidioc-enuminput.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.609+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000393 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml auth v326 ap=1 s=5269 n(v0 rc2024-03-27T08:37:02.154317+0000 b5269 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb037700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000393:[<0x1000000033e/pixfmt-yuv420m.xml v170>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000393:[<0x1000000033e/pixfmt-yuv420m.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.611+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml auth v326 ap=1 s=2832 n(v0 rc2024-03-27T08:37:02.093916+0000 b2832 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038d:[<0x1000000033e/pixfmt-y12.xml v158>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038d:[<0x1000000033e/pixfmt-y12.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.611+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000387 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml auth v324 ap=1 s=2287 n(v0 rc2024-03-27T08:37:02.040667+0000 b2287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000387:[<0x1000000033e/pixfmt-srggb8.xml v146>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000387:[<0x1000000033e/pixfmt-srggb8.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.830 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.611+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml auth v324 ap=1 s=1528 n(v0 rc2024-03-27T08:37:02.083836+0000 b1528 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038c:[<0x1000000033e/pixfmt-y10b.xml v156>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038c:[<0x1000000033e/pixfmt-y10b.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.831 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.612+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000390 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml auth v328 ap=1 s=4559 n(v0 rc2024-03-27T08:37:02.123808+0000 b4559 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000390:[<0x1000000033e/pixfmt-yuv410.xml v164>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000390:[<0x1000000033e/pixfmt-yuv410.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.612+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml auth v338 ap=1 s=5234 n(v0 rc2024-03-27T08:37:02.723210+0000 b5234 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c8:[<0x1000000033e/vidioc-g-jpegcomp.xml v276>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c8:[<0x1000000033e/vidioc-g-jpegcomp.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.613+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000365 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml auth v312 ap=1 s=10738 n(v0 rc2024-03-27T08:37:01.705362+0000 b10738 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb03fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000365:[<0x1000000033e/lirc_device_interface.xml v78>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000365:[<0x1000000033e/lirc_device_interface.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.613+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000370 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml auth v316 ap=1 s=4771 n(v0 rc2024-03-27T08:37:01.813928+0000 b4771 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb040100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000370:[<0x1000000033e/pixfmt-m420.xml v100>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000370:[<0x1000000033e/pixfmt-m420.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.614+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000344 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml auth v304 ap=1 s=216066 n(v0 rc2024-03-27T08:37:01.363205+0000 b216066 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb040c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000344:[<0x1000000033e/controls.xml v12>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000344:[<0x1000000033e/controls.xml v304>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.615+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000362 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml auth v310 ap=1 s=63089 n(v0 rc2024-03-27T08:37:01.670828+0000 b63089 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb040680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000362:[<0x1000000033e/io.xml v72>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000362:[<0x1000000033e/io.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.833 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.615+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg auth v332 ap=1 s=4607 n(v0 rc2024-03-27T08:37:02.307297+0000 b4607 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb041180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039f:[<0x1000000033e/subdev-image-processing-crop.svg v194>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039f:[<0x1000000033e/subdev-image-processing-crop.svg v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.615+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml auth v338 ap=1 s=2065 n(v0 rc2024-03-27T08:37:02.552822+0000 b2065 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb041700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b6:[<0x1000000033e/vidioc-enumaudio.xml v240>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b6:[<0x1000000033e/vidioc-enumaudio.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.615+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml auth v342 ap=1 s=8303 n(v0 rc2024-03-27T08:37:02.848094+0000 b8303 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb048000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d4:[<0x1000000033e/vidioc-qbuf.xml v300>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d4:[<0x1000000033e/vidioc-qbuf.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.616+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bf [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml auth v340 ap=1 s=4114 n(v0 rc2024-03-27T08:37:02.639177+0000 b4114 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb048580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bf:[<0x1000000033e/vidioc-g-ctrl.xml v258>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003bf:[<0x1000000033e/vidioc-g-ctrl.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.616+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000353 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml auth v308 ap=1 s=1545 n(v0 rc2024-03-27T08:37:01.515940+0000 b1545 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb048b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000353:[<0x1000000033e/dev-teletext.xml v42>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000353:[<0x1000000033e/dev-teletext.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.616+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000384 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml auth v320 ap=1 s=1178 n(v0 rc2024-03-27T08:37:02.012275+0000 b1178 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb049080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000384:[<0x1000000033e/pixfmt-srggb10dpcm8.xml v140>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000384:[<0x1000000033e/pixfmt-srggb10dpcm8.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.617+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml auth v314 ap=1 s=2340 n(v0 rc2024-03-27T08:37:01.734509+0000 b2340 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb049600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000368:[<0x1000000033e/media-func-ioctl.xml v84>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000368:[<0x1000000033e/media-func-ioctl.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.617+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000348 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml auth v306 ap=1 s=597 n(v0 rc2024-03-27T08:37:01.403913+0000 b597 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb049b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000348:[<0x1000000033e/dev-effect.xml v20>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000348:[<0x1000000033e/dev-effect.xml v306>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.618+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia auth v334 ap=1 s=55850 n(v0 rc2024-03-27T08:37:02.323145+0000 b55850 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb04ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a0:[<0x1000000033e/subdev-image-processing-full.dia v196>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a0:[<0x1000000033e/subdev-image-processing-full.dia v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.618+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml auth v318 ap=1 s=1687 n(v0 rc2024-03-27T08:37:01.937042+0000 b1687 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb04a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037c:[<0x1000000033e/pixfmt-sdr-cs14le.xml v124>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037c:[<0x1000000033e/pixfmt-sdr-cs14le.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.619+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml auth v348 ap=1 s=4047 n(v0 rc2024-03-27T08:37:02.762780+0000 b4047 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb052000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cc:[<0x1000000033e/vidioc-g-priority.xml v284>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003cc:[<0x1000000033e/vidioc-g-priority.xml v348>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.834 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.619+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000388 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml auth v322 ap=1 s=1986 n(v0 rc2024-03-27T08:37:02.050501+0000 b1986 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb04b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000388:[<0x1000000033e/pixfmt-uv8.xml v148>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000388:[<0x1000000033e/pixfmt-uv8.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.619+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml auth v330 ap=1 s=136955 n(v0 rc2024-03-27T08:37:02.286842+0000 b136955 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb04a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039d:[<0x1000000033e/subdev-formats.xml v190>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039d:[<0x1000000033e/subdev-formats.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.620+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml auth v336 ap=1 s=8281 n(v0 rc2024-03-27T08:37:02.524129+0000 b8281 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb04b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b3:[<0x1000000033e/vidioc-enum-frameintervals.xml v234>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b3:[<0x1000000033e/vidioc-enum-frameintervals.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.620+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf auth v336 ap=1 s=3395 n(v0 rc2024-03-27T08:37:02.394591+0000 b3395 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb052580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a6:[<0x1000000033e/vbi_525.pdf v208>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a6:[<0x1000000033e/vbi_525.pdf v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.621+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000349 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml auth v310 ap=1 s=2082 n(v0 rc2024-03-27T08:37:01.412984+0000 b2082 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb053080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000349:[<0x1000000033e/dev-event.xml v22>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000349:[<0x1000000033e/dev-event.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.621+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000395 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml auth v328 ap=1 s=4225 n(v0 rc2024-03-27T08:37:02.173629+0000 b4225 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb052b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000395:[<0x1000000033e/pixfmt-yuyv.xml v174>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000395:[<0x1000000033e/pixfmt-yuyv.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.623+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000371 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml auth v318 ap=1 s=5122 n(v0 rc2024-03-27T08:37:01.824236+0000 b5122 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb054100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000371:[<0x1000000033e/pixfmt-nv12.xml v102>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000371:[<0x1000000033e/pixfmt-nv12.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.624+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml auth v354 ap=1 s=3287 n(v0 rc2024-03-27T08:37:02.858324+0000 b3287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb053b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d5:[<0x1000000033e/vidioc-query-dv-timings.xml v302>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d5:[<0x1000000033e/vidioc-query-dv-timings.xml v354>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.624+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml auth v338 ap=1 s=4956 n(v0 rc2024-03-27T08:37:02.514926+0000 b4956 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb053600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b2:[<0x1000000033e/vidioc-enum-fmt.xml v232>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b2:[<0x1000000033e/vidioc-enum-fmt.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.624+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003db [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml auth v358 ap=1 s=6866 n(v0 rc2024-03-27T08:37:03.081298+0000 b6866 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb054680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003db:[<0x1000000033e/vidioc-s-hw-freq-seek.xml v306>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003db:[<0x1000000033e/vidioc-s-hw-freq-seek.xml v358>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.624+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml auth v346 ap=1 s=11061 n(v0 rc2024-03-27T08:37:02.753550+0000 b11061 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb054c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cb:[<0x1000000033e/vidioc-g-parm.xml v282>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003cb:[<0x1000000033e/vidioc-g-parm.xml v346>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.624+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml auth v326 ap=1 s=2832 n(v0 rc2024-03-27T08:37:02.075665+0000 b2832 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb055180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038b:[<0x1000000033e/pixfmt-y10.xml v154>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038b:[<0x1000000033e/pixfmt-y10.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.835 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.626+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000382 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml auth v324 ap=1 s=3505 n(v0 rc2024-03-27T08:37:01.993480+0000 b3505 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb055700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000382:[<0x1000000033e/pixfmt-srggb10.xml v136>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000382:[<0x1000000033e/pixfmt-srggb10.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.627+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml auth v340 ap=1 s=6594 n(v0 rc2024-03-27T08:37:02.543815+0000 b6594 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b5:[<0x1000000033e/vidioc-enum-freq-bands.xml v238>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b5:[<0x1000000033e/vidioc-enum-freq-bands.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.628+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml auth v322 ap=1 s=1432 n(v0 rc2024-03-27T08:37:01.946693+0000 b1432 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037d:[<0x1000000033e/pixfmt-sdr-cu08.xml v126>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037d:[<0x1000000033e/pixfmt-sdr-cu08.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.628+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003df [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml auth v360 ap=1 s=3708 n(v0 rc2024-03-27T08:37:03.120295+0000 b3708 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003df:[<0x1000000033e/vidioc-subdev-enum-mbus-code.xml v308>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003df:[<0x1000000033e/vidioc-subdev-enum-mbus-code.xml v360>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.628+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000350 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml auth v314 ap=1 s=4469 n(v0 rc2024-03-27T08:37:01.480495+0000 b4469 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000350:[<0x1000000033e/dev-sdr.xml v36>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000350:[<0x1000000033e/dev-sdr.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.628+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml auth v356 ap=1 s=3763 n(v0 rc2024-03-27T08:37:03.028637+0000 b3763 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d6:[<0x1000000033e/vidioc-querybuf.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d6:[<0x1000000033e/vidioc-querybuf.xml v356>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.631+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000396 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml auth v330 ap=1 s=5276 n(v0 rc2024-03-27T08:37:02.182795+0000 b5276 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb060100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000396:[<0x1000000033e/pixfmt-yvu420m.xml v176>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000396:[<0x1000000033e/pixfmt-yvu420m.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.631+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000397 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml auth v332 ap=1 s=4152 n(v0 rc2024-03-27T08:37:02.191584+0000 b4152 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb060680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000397:[<0x1000000033e/pixfmt-yvyu.xml v178>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000397:[<0x1000000033e/pixfmt-yvyu.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.633+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml auth v334 ap=1 s=20009 n(v0 rc2024-03-27T08:37:02.372495+0000 b20009 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb05fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a4:[<0x1000000033e/v4l2.xml v204>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a4:[<0x1000000033e/v4l2.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.633+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml auth v316 ap=1 s=4630 n(v0 rc2024-03-27T08:37:01.754329+0000 b4630 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb060c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036a:[<0x1000000033e/media-ioc-device-info.xml v88>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036a:[<0x1000000033e/media-ioc-device-info.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.634+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml auth v312 ap=1 s=6990 n(v0 rc2024-03-27T08:37:01.471490+0000 b6990 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb061180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034f:[<0x1000000033e/dev-rds.xml v34>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034f:[<0x1000000033e/dev-rds.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.836 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.634+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml auth v352 ap=1 s=1930 n(v0 rc2024-03-27T08:37:02.828682+0000 b1930 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb061700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d2:[<0x1000000033e/vidioc-overlay.xml v296>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d2:[<0x1000000033e/vidioc-overlay.xml v352>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.635+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000374 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml auth v320 ap=1 s=5926 n(v0 rc2024-03-27T08:37:01.851801+0000 b5926 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb068000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000374:[<0x1000000033e/pixfmt-nv16.xml v108>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000374:[<0x1000000033e/pixfmt-nv16.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.635+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ce [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml auth v350 ap=1 s=8060 n(v0 rc2024-03-27T08:37:02.783924+0000 b8060 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb068580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ce:[<0x1000000033e/vidioc-g-sliced-vbi-cap.xml v288>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ce:[<0x1000000033e/vidioc-g-sliced-vbi-cap.xml v350>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.636+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml auth v344 ap=1 s=2420 n(v0 rc2024-03-27T08:37:02.712263+0000 b2420 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb068b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c7:[<0x1000000033e/vidioc-g-input.xml v274>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c7:[<0x1000000033e/vidioc-g-input.xml v344>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.636+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml auth v342 ap=1 s=17873 n(v0 rc2024-03-27T08:37:02.684639+0000 b17873 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb069080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c4:[<0x1000000033e/vidioc-g-fbuf.xml v268>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c4:[<0x1000000033e/vidioc-g-fbuf.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.636+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ab [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml auth v334 ap=1 s=6868 n(v0 rc2024-03-27T08:37:02.444448+0000 b6868 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb06a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ab:[<0x1000000033e/vidioc-dbg-g-chip-info.xml v218>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ab:[<0x1000000033e/vidioc-dbg-g-chip-info.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.639+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000378 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml auth v326 ap=1 s=8650 n(v0 rc2024-03-27T08:37:01.895443+0000 b8650 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb069b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000378:[<0x1000000033e/pixfmt-packed-yuv.xml v116>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000378:[<0x1000000033e/pixfmt-packed-yuv.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.837 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.639+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ac [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml auth v336 ap=1 s=7575 n(v0 rc2024-03-27T08:37:02.456464+0000 b7575 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb069600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ac:[<0x1000000033e/vidioc-dbg-g-register.xml v220>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ac:[<0x1000000033e/vidioc-dbg-g-register.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.838 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-03-27T08:37:33.839 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.639+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml auth v342 ap=1 s=13334 n(v0 rc2024-03-27T08:37:03.039409+0000 b13334 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb06ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d7:[<0x1000000033e/vidioc-querycap.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d7:[<0x1000000033e/vidioc-querycap.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.640+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml auth v346 ap=1 s=5691 n(v0 rc2024-03-27T08:37:03.130288+0000 b5691 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb06a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e0:[<0x1000000033e/vidioc-subdev-g-crop.xml v308>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e0:[<0x1000000033e/vidioc-subdev-g-crop.xml v346>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.640+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml auth v314 ap=1 s=16302 n(v0 rc2024-03-27T08:37:01.442513+0000 b16302 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb06b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034c:[<0x1000000033e/dev-overlay.xml v28>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034c:[<0x1000000033e/dev-overlay.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.642+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000383 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml auth v330 ap=1 s=1217 n(v0 rc2024-03-27T08:37:02.002724+0000 b1217 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb06b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000383:[<0x1000000033e/pixfmt-srggb10alaw8.xml v138>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000383:[<0x1000000033e/pixfmt-srggb10alaw8.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.642+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml auth v348 ap=1 s=6571 n(v0 rc2024-03-27T08:37:03.140433+0000 b6571 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb072580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e1:[<0x1000000033e/vidioc-subdev-g-fmt.xml v310>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e1:[<0x1000000033e/vidioc-subdev-g-fmt.xml v348>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.644+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml auth v322 ap=1 s=4866 n(v0 rc2024-03-27T08:37:01.635386+0000 b4866 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb072b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035f:[<0x1000000033e/func-select.xml v66>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035f:[<0x1000000033e/func-select.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.644+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000385 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml auth v332 ap=1 s=3661 n(v0 rc2024-03-27T08:37:02.021239+0000 b3661 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb072000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000385:[<0x1000000033e/pixfmt-srggb10p.xml v142>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000385:[<0x1000000033e/pixfmt-srggb10p.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.644+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000380 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml auth v328 ap=1 s=2287 n(v0 rc2024-03-27T08:37:01.974424+0000 b2287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb073080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000380:[<0x1000000033e/pixfmt-sgbrg8.xml v132>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000380:[<0x1000000033e/pixfmt-sgbrg8.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.645+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml auth v340 ap=1 s=5314 n(v0 rc2024-03-27T08:37:02.608566+0000 b5314 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb073600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bc:[<0x1000000033e/vidioc-g-audio.xml v252>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003bc:[<0x1000000033e/vidioc-g-audio.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.645+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml auth v350 ap=1 s=8425 n(v0 rc2024-03-27T08:37:03.170459+0000 b8425 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb073b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e4:[<0x1000000033e/vidioc-subscribe-event.xml v312>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e4:[<0x1000000033e/vidioc-subscribe-event.xml v350>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.646+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml auth v344 ap=1 s=4559 n(v0 rc2024-03-27T08:37:03.090873+0000 b4559 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb074100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003dc:[<0x1000000033e/vidioc-streamon.xml v306>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003dc:[<0x1000000033e/vidioc-streamon.xml v344>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.647+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000357 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf auth v318 ap=1 s=9173 n(v0 rc2024-03-27T08:37:01.559121+0000 b9173 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb074680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000357:[<0x1000000033e/fieldseq_tb.pdf v50>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000357:[<0x1000000033e/fieldseq_tb.pdf v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.840 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.647+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml auth v316 ap=1 s=5476 n(v0 rc2024-03-27T08:37:01.527715+0000 b5476 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb074c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000354:[<0x1000000033e/driver.xml v44>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000354:[<0x1000000033e/driver.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.647+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml auth v320 ap=1 s=2264 n(v0 rc2024-03-27T08:37:01.599135+0000 b2264 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb075180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035b:[<0x1000000033e/func-munmap.xml v58>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035b:[<0x1000000033e/func-munmap.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.648+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000360 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml auth v324 ap=1 s=3866 n(v0 rc2024-03-27T08:37:01.645299+0000 b3866 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb075700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000360:[<0x1000000033e/func-write.xml v68>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000360:[<0x1000000033e/func-write.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.649+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ad [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml auth v338 ap=1 s=8759 n(v0 rc2024-03-27T08:37:02.467147+0000 b8759 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ad:[<0x1000000033e/vidioc-decoder-cmd.xml v222>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ad:[<0x1000000033e/vidioc-decoder-cmd.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.650+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000398 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml auth v328 ap=1 s=77227 n(v0 rc2024-03-27T08:37:02.210313+0000 b77227 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000398:[<0x1000000033e/pixfmt.xml v180>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000398:[<0x1000000033e/pixfmt.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.650+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ca [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml auth v344 ap=1 s=2472 n(v0 rc2024-03-27T08:37:02.743192+0000 b2472 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ca:[<0x1000000033e/vidioc-g-output.xml v280>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ca:[<0x1000000033e/vidioc-g-output.xml v344>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.650+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml auth v346 ap=1 s=21287 n(v0 rc2024-03-27T08:37:02.806914+0000 b21287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d0:[<0x1000000033e/vidioc-g-tuner.xml v292>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d0:[<0x1000000033e/vidioc-g-tuner.xml v346>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.650+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml auth v316 ap=1 s=5777 n(v0 rc2024-03-27T08:37:01.617659+0000 b5777 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035d:[<0x1000000033e/func-poll.xml v62>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035d:[<0x1000000033e/func-poll.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.651+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml auth v338 ap=1 s=4612 n(v0 rc2024-03-27T08:37:02.506256+0000 b4612 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b1:[<0x1000000033e/vidioc-enum-dv-timings.xml v230>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b1:[<0x1000000033e/vidioc-enum-dv-timings.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.652+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml auth v320 ap=1 s=2660 n(v0 rc2024-03-27T08:37:01.783736+0000 b2660 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036d:[<0x1000000033e/media-ioc-setup-link.xml v94>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036d:[<0x1000000033e/media-ioc-setup-link.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.841 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.653+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003da [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml auth v350 ap=1 s=4903 n(v0 rc2024-03-27T08:37:03.070929+0000 b4903 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003da:[<0x1000000033e/vidioc-reqbufs.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003da:[<0x1000000033e/vidioc-reqbufs.xml v350>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.653+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml auth v312 ap=1 s=1551 n(v0 rc2024-03-27T08:37:01.567813+0000 b1551 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000358:[<0x1000000033e/func-close.xml v52>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000358:[<0x1000000033e/func-close.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.654+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003e3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml auth v352 ap=1 s=5107 n(v0 rc2024-03-27T08:37:03.159667+0000 b5107 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003e3:[<0x1000000033e/vidioc-subdev-g-selection.xml v306>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003e3:[<0x1000000033e/vidioc-subdev-g-selection.xml v352>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.654+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000386 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml auth v326 ap=1 s=3485 n(v0 rc2024-03-27T08:37:02.030210+0000 b3485 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb07d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000386:[<0x1000000033e/pixfmt-srggb12.xml v144>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000386:[<0x1000000033e/pixfmt-srggb12.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.654+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000346 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml auth v308 ap=1 s=5018 n(v0 rc2024-03-27T08:37:01.385095+0000 b5018 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb088000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000346:[<0x1000000033e/dev-capture.xml v16>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000346:[<0x1000000033e/dev-capture.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.654+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ba [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml auth v340 ap=1 s=14246 n(v0 rc2024-03-27T08:37:02.588240+0000 b14246 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb088580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ba:[<0x1000000033e/vidioc-enumstd.xml v248>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ba:[<0x1000000033e/vidioc-enumstd.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.655+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000361 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml auth v318 ap=1 s=2887 n(v0 rc2024-03-27T08:37:01.654799+0000 b2887 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb089080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000361:[<0x1000000033e/gen-errors.xml v70>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000361:[<0x1000000033e/gen-errors.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.656+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf auth v334 ap=1 s=7405 n(v0 rc2024-03-27T08:37:02.414084+0000 b7405 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb089600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a8:[<0x1000000033e/vbi_hsync.pdf v212>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a8:[<0x1000000033e/vbi_hsync.pdf v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.656+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml auth v322 ap=1 s=1974 n(v0 rc2024-03-27T08:37:01.804520+0000 b1974 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb088b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036f:[<0x1000000033e/pixfmt-grey.xml v98>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036f:[<0x1000000033e/pixfmt-grey.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.656+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml auth v342 ap=1 s=5072 n(v0 rc2024-03-27T08:37:02.701532+0000 b5072 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb089b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c6:[<0x1000000033e/vidioc-g-frequency.xml v272>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c6:[<0x1000000033e/vidioc-g-frequency.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.657+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml auth v348 ap=1 s=2708 n(v0 rc2024-03-27T08:37:02.837817+0000 b2708 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb08a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d3:[<0x1000000033e/vidioc-prepare-buf.xml v298>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d3:[<0x1000000033e/vidioc-prepare-buf.xml v348>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.657+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000377 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml auth v324 ap=1 s=36508 n(v0 rc2024-03-27T08:37:01.884474+0000 b36508 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb08a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000377:[<0x1000000033e/pixfmt-packed-rgb.xml v114>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000377:[<0x1000000033e/pixfmt-packed-rgb.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.842 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.657+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml auth v314 ap=1 s=7103 n(v0 rc2024-03-27T08:37:01.587928+0000 b7103 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb08b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035a:[<0x1000000033e/func-mmap.xml v56>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035a:[<0x1000000033e/func-mmap.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.843 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.657+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml auth v336 ap=1 s=6226 n(v0 rc2024-03-27T08:37:02.497843+0000 b6226 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb08ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b0:[<0x1000000033e/vidioc-encoder-cmd.xml v228>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b0:[<0x1000000033e/vidioc-encoder-cmd.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.843 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.659+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf auth v332 ap=1 s=3683 n(v0 rc2024-03-27T08:37:02.404738+0000 b3683 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb08b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a7:[<0x1000000033e/vbi_625.pdf v210>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a7:[<0x1000000033e/vbi_625.pdf v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.843 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.660+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml auth v310 ap=1 s=4825 n(v0 rc2024-03-27T08:37:01.430912+0000 b4825 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb090000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034b:[<0x1000000033e/dev-output.xml v26>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034b:[<0x1000000033e/dev-output.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.673+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg auth v330 ap=1 s=9041 n(v0 rc2024-03-27T08:37:02.360472+0000 b9041 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb091080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a3:[<0x1000000033e/subdev-image-processing-scaling-multi-source.svg v202>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a3:[<0x1000000033e/subdev-image-processing-scaling-multi-source.svg v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.674+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003de [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml auth v342 ap=1 s=5049 n(v0 rc2024-03-27T08:37:03.109714+0000 b5049 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb091600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003de:[<0x1000000033e/vidioc-subdev-enum-frame-size.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003de:[<0x1000000033e/vidioc-subdev-enum-frame-size.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.675+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml auth v336 ap=1 s=6708 n(v0 rc2024-03-27T08:37:02.598213+0000 b6708 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb091b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bb:[<0x1000000033e/vidioc-expbuf.xml v250>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003bb:[<0x1000000033e/vidioc-expbuf.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.675+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia auth v330 ap=1 s=21461 n(v0 rc2024-03-27T08:37:02.298735+0000 b21461 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb090580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039e:[<0x1000000033e/subdev-image-processing-crop.dia v192>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039e:[<0x1000000033e/subdev-image-processing-crop.dia v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.675+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ae [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml auth v332 ap=1 s=11056 n(v0 rc2024-03-27T08:37:02.477101+0000 b11056 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb090b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003ae:[<0x1000000033e/vidioc-dqevent.xml v224>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003ae:[<0x1000000033e/vidioc-dqevent.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.676+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml auth v314 ap=1 s=1428 n(v0 rc2024-03-27T08:37:01.927629+0000 b1428 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb092100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037b:[<0x1000000033e/pixfmt-sdr-cs08.xml v122>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037b:[<0x1000000033e/pixfmt-sdr-cs08.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.676+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000381 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml auth v318 ap=1 s=2287 n(v0 rc2024-03-27T08:37:01.983647+0000 b2287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb092680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000381:[<0x1000000033e/pixfmt-sgrbg8.xml v134>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000381:[<0x1000000033e/pixfmt-sgrbg8.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.846 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.677+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml auth v340 ap=1 s=11127 n(v0 rc2024-03-27T08:37:02.649030+0000 b11127 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb092c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c0:[<0x1000000033e/vidioc-g-dv-timings.xml v260>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c0:[<0x1000000033e/vidioc-g-dv-timings.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.678+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml auth v334 ap=1 s=6568 n(v0 rc2024-03-27T08:37:02.579098+0000 b6568 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b9:[<0x1000000033e/vidioc-enumoutput.xml v246>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b9:[<0x1000000033e/vidioc-enumoutput.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.678+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003be [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml auth v338 ap=1 s=4396 n(v0 rc2024-03-27T08:37:02.630372+0000 b4396 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb093180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003be:[<0x1000000033e/vidioc-g-crop.xml v256>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003be:[<0x1000000033e/vidioc-g-crop.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.678+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml auth v316 ap=1 s=1615 n(v0 rc2024-03-27T08:37:01.956082+0000 b1615 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb093700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037e:[<0x1000000033e/pixfmt-sdr-cu16le.xml v128>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037e:[<0x1000000033e/pixfmt-sdr-cu16le.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.678+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml auth v312 ap=1 s=5925 n(v0 rc2024-03-27T08:37:01.834026+0000 b5925 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000372:[<0x1000000033e/pixfmt-nv12m.xml v104>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000372:[<0x1000000033e/pixfmt-nv12m.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.680+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia auth v328 ap=1 s=40591 n(v0 rc2024-03-27T08:37:02.348802+0000 b40591 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a2:[<0x1000000033e/subdev-image-processing-scaling-multi-source.dia v200>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a2:[<0x1000000033e/subdev-image-processing-scaling-multi-source.dia v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.680+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml auth v324 ap=1 s=13692 n(v0 rc2024-03-27T08:37:02.244107+0000 b13692 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039b:[<0x1000000033e/selection-api.xml v186>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039b:[<0x1000000033e/selection-api.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.681+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml auth v308 ap=1 s=5826 n(v0 rc2024-03-27T08:37:01.421458+0000 b5826 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034a:[<0x1000000033e/dev-osd.xml v24>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034a:[<0x1000000033e/dev-osd.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.682+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000389 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml auth v320 ap=1 s=4152 n(v0 rc2024-03-27T08:37:02.058909+0000 b4152 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000389:[<0x1000000033e/pixfmt-uyvy.xml v150>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000389:[<0x1000000033e/pixfmt-uyvy.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.683+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000391 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml auth v322 ap=1 s=4999 n(v0 rc2024-03-27T08:37:02.135465+0000 b4999 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000391:[<0x1000000033e/pixfmt-yuv411p.xml v166>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000391:[<0x1000000033e/pixfmt-yuv411p.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.683+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml auth v326 ap=1 s=5928 n(v0 rc2024-03-27T08:37:02.256396+0000 b5928 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039c:[<0x1000000033e/selections-common.xml v188>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039c:[<0x1000000033e/selections-common.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.683+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000340 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml auth v306 ap=1 s=13110 n(v0 rc2024-03-27T08:37:01.277287+0000 b13110 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000340:[<0x1000000033e/biblio.xml v4>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000340:[<0x1000000033e/biblio.xml v306>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.847 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.684+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml auth v310 ap=1 s=9829 n(v0 rc2024-03-27T08:37:01.765142+0000 b9829 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036b:[<0x1000000033e/media-ioc-enum-entities.xml v90>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036b:[<0x1000000033e/media-ioc-enum-entities.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.685+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000347 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml auth v308 ap=1 s=1548 n(v0 rc2024-03-27T08:37:01.393486+0000 b1548 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000347:[<0x1000000033e/dev-codec.xml v18>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000347:[<0x1000000033e/dev-codec.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.685+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000369 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml auth v318 ap=1 s=2816 n(v0 rc2024-03-27T08:37:01.743430+0000 b2816 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb09f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000369:[<0x1000000033e/media-func-open.xml v86>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000369:[<0x1000000033e/media-func-open.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.688+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg auth v328 ap=1 s=12533 n(v0 rc2024-03-27T08:37:02.332996+0000 b12533 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a1:[<0x1000000033e/subdev-image-processing-full.svg v198>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a1:[<0x1000000033e/subdev-image-processing-full.svg v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.688+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml auth v332 ap=1 s=6470 n(v0 rc2024-03-27T08:37:02.657444+0000 b6470 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c1:[<0x1000000033e/vidioc-g-edid.xml v262>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c1:[<0x1000000033e/vidioc-g-edid.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.689+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml auth v310 ap=1 s=1947 n(v0 rc2024-03-27T08:37:01.452160+0000 b1947 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000034d:[<0x1000000033e/dev-radio.xml v30>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000034d:[<0x1000000033e/dev-radio.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.689+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000359 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml auth v312 ap=1 s=2235 n(v0 rc2024-03-27T08:37:01.576134+0000 b2235 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000359:[<0x1000000033e/func-ioctl.xml v54>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000359:[<0x1000000033e/func-ioctl.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.689+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000366 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml auth v314 ap=1 s=3929 n(v0 rc2024-03-27T08:37:01.715535+0000 b3929 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0a9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000366:[<0x1000000033e/media-controller.xml v80>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000366:[<0x1000000033e/media-controller.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.690+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml auth v336 ap=1 s=25840 n(v0 rc2024-03-27T08:37:03.052230+0000 b25840 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0aa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d8:[<0x1000000033e/vidioc-queryctrl.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d8:[<0x1000000033e/vidioc-queryctrl.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.696+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml auth v330 ap=1 s=6175 n(v0 rc2024-03-27T08:37:02.425216+0000 b6175 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0aa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a9:[<0x1000000033e/vidioc-create-bufs.xml v214>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a9:[<0x1000000033e/vidioc-create-bufs.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.696+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000379 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml auth v320 ap=1 s=2961 n(v0 rc2024-03-27T08:37:01.908236+0000 b2961 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0aac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000379:[<0x1000000033e/pixfmt-sbggr16.xml v118>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000379:[<0x1000000033e/pixfmt-sbggr16.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.696+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml auth v334 ap=1 s=3144 n(v0 rc2024-03-27T08:37:02.793269+0000 b3144 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0ab180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003cf:[<0x1000000033e/vidioc-g-std.xml v290>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003cf:[<0x1000000033e/vidioc-g-std.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.848 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.696+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml auth v324 ap=1 s=2885 n(v0 rc2024-03-27T08:37:02.104204+0000 b2885 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038e:[<0x1000000033e/pixfmt-y16.xml v160>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038e:[<0x1000000033e/pixfmt-y16.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.696+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000367 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml auth v316 ap=1 s=1449 n(v0 rc2024-03-27T08:37:01.725015+0000 b1449 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0ab700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000367:[<0x1000000033e/media-func-close.xml v82>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000367:[<0x1000000033e/media-func-close.xml v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.706+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000345 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf auth v306 ap=1 s=5846 n(v0 rc2024-03-27T08:37:01.374268+0000 b5846 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000345:[<0x1000000033e/crop.pdf v14>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000345:[<0x1000000033e/crop.pdf v306>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.716+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000392 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml auth v326 ap=1 s=5287 n(v0 rc2024-03-27T08:37:02.144668+0000 b5287 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000392:[<0x1000000033e/pixfmt-yuv420.xml v168>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000392:[<0x1000000033e/pixfmt-yuv420.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.717+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml auth v322 ap=1 s=4152 n(v0 rc2024-03-27T08:37:02.067488+0000 b4152 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038a:[<0x1000000033e/pixfmt-vyuy.xml v152>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038a:[<0x1000000033e/pixfmt-vyuy.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.717+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000352 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml auth v312 ap=1 s=22320 n(v0 rc2024-03-27T08:37:01.507722+0000 b22320 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000352:[<0x1000000033e/dev-subdev.xml v40>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000352:[<0x1000000033e/dev-subdev.xml v312>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.718+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml auth v330 ap=1 s=5951 n(v0 rc2024-03-27T08:37:02.114420+0000 b5951 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000038f:[<0x1000000033e/pixfmt-y41p.xml v162>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000038f:[<0x1000000033e/pixfmt-y41p.xml v330>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.718+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003dd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml auth v352 ap=1 s=5165 n(v0 rc2024-03-27T08:37:03.099801+0000 b5165 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003dd:[<0x1000000033e/vidioc-subdev-enum-frame-interval.xml v304>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003dd:[<0x1000000033e/vidioc-subdev-enum-frame-interval.xml v352>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.718+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000399 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml auth v334 ap=1 s=2966 n(v0 rc2024-03-27T08:37:02.220240+0000 b2966 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000399:[<0x1000000033e/planar-apis.xml v182>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000399:[<0x1000000033e/planar-apis.xml v334>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.720+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000356 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf auth v316 ap=1 s=9185 n(v0 rc2024-03-27T08:37:01.550649+0000 b9185 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000356:[<0x1000000033e/fieldseq_bt.pdf v48>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000356:[<0x1000000033e/fieldseq_bt.pdf v316>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.720+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml auth v318 ap=1 s=3498 n(v0 rc2024-03-27T08:37:01.608788+0000 b3498 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035c:[<0x1000000033e/func-open.xml v60>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035c:[<0x1000000033e/func-open.xml v318>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.720+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000376 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml auth v326 ap=1 s=4837 n(v0 rc2024-03-27T08:37:01.871047+0000 b4837 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000376:[<0x1000000033e/pixfmt-nv24.xml v112>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000376:[<0x1000000033e/pixfmt-nv24.xml v326>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.720+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003aa [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml auth v340 ap=1 s=5414 n(v0 rc2024-03-27T08:37:02.435286+0000 b5414 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0be000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003aa:[<0x1000000033e/vidioc-cropcap.xml v216>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003aa:[<0x1000000033e/vidioc-cropcap.xml v340>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.849 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.721+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000375 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml auth v324 ap=1 s=6292 n(v0 rc2024-03-27T08:37:01.862119+0000 b6292 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0be580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000375:[<0x1000000033e/pixfmt-nv16m.xml v110>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000375:[<0x1000000033e/pixfmt-nv16m.xml v324>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.722+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000355 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml auth v314 ap=1 s=27082 n(v0 rc2024-03-27T08:37:01.541042+0000 b27082 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0beb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000355:[<0x1000000033e/fdl-appendix.xml v46>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000355:[<0x1000000033e/fdl-appendix.xml v314>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.722+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml auth v338 ap=1 s=5848 n(v0 rc2024-03-27T08:37:02.384457+0000 b5848 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0c0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003a5:[<0x1000000033e/v4l2grab.c.xml v206>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003a5:[<0x1000000033e/v4l2grab.c.xml v338>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.722+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore auth v306 ap=1 s=7 n(v0 rc2024-03-27T08:37:01.266816+0000 b7 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0bf080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000033f:[<0x1000000033e/.gitignore v2>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000033f:[<0x1000000033e/.gitignore v306>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.723+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml auth v320 ap=1 s=6719 n(v0 rc2024-03-27T08:37:01.627038+0000 b6719 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0bf600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000035e:[<0x1000000033e/func-read.xml v64>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000035e:[<0x1000000033e/func-read.xml v320>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.723+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml auth v346 ap=1 s=4433 n(v0 rc2024-03-27T08:37:02.621513+0000 b4433 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0bfb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003bd:[<0x1000000033e/vidioc-g-audioout.xml v254>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003bd:[<0x1000000033e/vidioc-g-audioout.xml v346>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.723+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000351 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml auth v310 ap=1 s=29979 n(v0 rc2024-03-27T08:37:01.494008+0000 b29979 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0c0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000351:[<0x1000000033e/dev-sliced-vbi.xml v38>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000351:[<0x1000000033e/dev-sliced-vbi.xml v310>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.723+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml auth v336 ap=1 s=19890 n(v0 rc2024-03-27T08:37:02.232177+0000 b19890 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0c0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000039a:[<0x1000000033e/remote_controllers.xml v184>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000039a:[<0x1000000033e/remote_controllers.xml v336>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.850 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.729+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml auth v342 ap=1 s=8494 n(v0 rc2024-03-27T08:37:02.533846+0000 b8494 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0c1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b4:[<0x1000000033e/vidioc-enum-framesizes.xml v236>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b4:[<0x1000000033e/vidioc-enum-framesizes.xml v342>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.731+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml auth v348 ap=1 s=9177 n(v0 rc2024-03-27T08:37:02.735062+0000 b9177 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0c1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003c9:[<0x1000000033e/vidioc-g-modulator.xml v278>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003c9:[<0x1000000033e/vidioc-g-modulator.xml v348>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.732+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000342 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml auth v308 ap=1 s=43757 n(v0 rc2024-03-27T08:37:01.300153+0000 b43757 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0ca000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000342:[<0x1000000033e/common.xml v8>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000342:[<0x1000000033e/common.xml v308>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.732+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000394 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml auth v332 ap=1 s=5275 n(v0 rc2024-03-27T08:37:02.163650+0000 b5275 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0ca580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000394:[<0x1000000033e/pixfmt-yuv422p.xml v172>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000394:[<0x1000000033e/pixfmt-yuv422p.xml v332>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.732+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml auth v328 ap=1 s=1324 n(v0 rc2024-03-27T08:37:01.965842+0000 b1324 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000037f:[<0x1000000033e/pixfmt-sdr-ru12le.xml v130>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000037f:[<0x1000000033e/pixfmt-sdr-ru12le.xml v328>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.732+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml auth v350 ap=1 s=1272 n(v0 rc2024-03-27T08:37:02.817910+0000 b1272 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003d1:[<0x1000000033e/vidioc-log-status.xml v294>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003d1:[<0x1000000033e/vidioc-log-status.xml v350>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.733+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml auth v344 ap=1 s=2225 n(v0 rc2024-03-27T08:37:02.560763+0000 b2225 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000003b7:[<0x1000000033e/vidioc-enumaudioout.xml v242>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000003b7:[<0x1000000033e/vidioc-enumaudioout.xml v344>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.758+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000335 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml auth v50 ap=1 s=4023 n(v0 rc2024-03-27T08:37:01.154916+0000 b4023 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000335:[<0x10000000329/net.xml v24>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000335:[<0x10000000329/net.xml v50>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.759+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml auth v322 ap=1 s=7265 n(v0 rc2024-03-27T08:37:01.775542+0000 b7265 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000036c:[<0x1000000033e/media-ioc-enum-links.xml v92>,<0x10000000324/v4l v386>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000036c:[<0x1000000033e/media-ioc-enum-links.xml v322>,<0x10000000324/v4l v777>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.763+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000331 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml auth v42 ap=1 s=10365 n(v0 rc2024-03-27T08:37:01.103466+0000 b10365 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000331:[<0x10000000329/examples.xml v16>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000331:[<0x10000000329/examples.xml v42>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.851 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.763+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000333 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml auth v46 ap=1 s=7441 n(v0 rc2024-03-27T08:37:01.128871+0000 b7441 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000333:[<0x10000000329/intro.xml v20>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000333:[<0x10000000329/intro.xml v46>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.852 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-03-27T08:37:33.852 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.765+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000332 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml auth v44 ap=1 s=46492 n(v0 rc2024-03-27T08:37:01.119266+0000 b46492 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0ccc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000332:[<0x10000000329/frontend.xml v18>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000332:[<0x10000000329/frontend.xml v44>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.765+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000330 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf auth v40 ap=1 s=1881 n(v0 rc2024-03-27T08:37:01.091798+0000 b1881 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0cd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000330:[<0x10000000329/dvbstb.pdf v14>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000330:[<0x10000000329/dvbstb.pdf v40>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.766+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000334 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml auth v48 ap=1 s=73540 n(v0 rc2024-03-27T08:37:01.145846+0000 b73540 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d6000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000334:[<0x10000000329/kdapi.xml v22>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000334:[<0x10000000329/kdapi.xml v48>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.766+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml auth v38 ap=1 s=65098 n(v0 rc2024-03-27T08:37:01.083033+0000 b65098 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d6b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032f:[<0x10000000329/dvbproperty.xml v12>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032f:[<0x10000000329/dvbproperty.xml v38>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.767+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml auth v32 ap=1 s=14670 n(v0 rc2024-03-27T08:37:01.045509+0000 b14670 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d6580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032c:[<0x10000000329/ca.xml v6>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032c:[<0x10000000329/ca.xml v32>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.767+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000336 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml auth v52 ap=1 s=56927 n(v0 rc2024-03-27T08:37:01.170729+0000 b56927 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d7080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000336:[<0x10000000329/video.xml v26>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000336:[<0x10000000329/video.xml v52>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.767+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml auth v34 ap=1 s=32394 n(v0 rc2024-03-27T08:37:01.059315+0000 b32394 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d7600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032d:[<0x10000000329/demux.xml v8>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032d:[<0x10000000329/demux.xml v34>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.767+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml auth v36 ap=1 s=3505 n(v0 rc2024-03-27T08:37:01.068729+0000 b3505 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d7b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032e:[<0x10000000329/dvbapi.xml v10>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032e:[<0x10000000329/dvbapi.xml v36>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.768+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml auth v30 ap=1 s=36483 n(v0 rc2024-03-27T08:37:01.032768+0000 b36483 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d8100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032b:[<0x10000000329/audio.xml v4>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032b:[<0x10000000329/audio.xml v30>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.853 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.768+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore auth v28 ap=1 s=7 n(v0 rc2024-03-27T08:37:01.019844+0000 b7 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x55a2eb0d8680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000032a:[<0x10000000329/.gitignore v2>,<0x10000000324/dvb v36>,<0x10000000310/media v142>,<0x10000000203/DocBook v602>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000032a:[<0x10000000329/.gitignore v28>,<0x10000000324/dvb v429>,<0x10000000310/media v191>,<0x10000000203/DocBook v1369>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:33.855 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-03-27T08:37:33.861 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-03-27T08:37:33.869 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-03-27T08:37:33.876 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-03-27T08:37:33.881 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-03-27T08:37:33.889 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-03-27T08:37:33.897 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-03-27T08:37:33.902 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-03-27T08:37:33.909 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-03-27T08:37:33.918 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-03-27T08:37:33.928 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-03-27T08:37:33.932 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-03-27T08:37:33.940 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-03-27T08:37:33.947 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-03-27T08:37:33.953 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-03-27T08:37:33.958 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-03-27T08:37:33.963 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-03-27T08:37:33.970 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-03-27T08:37:33.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-03-27T08:37:33.982 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-03-27T08:37:33.988 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-03-27T08:37:33.994 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-03-27T08:37:34.000 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-03-27T08:37:34.005 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-03-27T08:37:34.011 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-03-27T08:37:34.018 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-03-27T08:37:34.025 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-03-27T08:37:34.032 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-03-27T08:37:34.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-03-27T08:37:34.042 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-03-27T08:37:34.048 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-03-27T08:37:34.056 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-03-27T08:37:34.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-03-27T08:37:34.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-03-27T08:37:34.070 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-03-27T08:37:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:33 smithi173 ceph-mon[35397]: scrub queued for path: / 2024-03-27T08:37:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:33 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:33 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:37:34.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:33 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:37:34.075 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-03-27T08:37:34.079 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-03-27T08:37:34.084 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-03-27T08:37:34.091 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-03-27T08:37:34.097 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-03-27T08:37:34.104 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-03-27T08:37:34.111 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-03-27T08:37:34.119 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sparse.txt 2024-03-27T08:37:34.130 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/ 2024-03-27T08:37:34.135 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-03-27T08:37:34.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-03-27T08:37:34.147 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-03-27T08:37:34.154 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-03-27T08:37:34.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-03-27T08:37:34.168 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-03-27T08:37:34.177 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-03-27T08:37:34.184 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-03-27T08:37:34.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-03-27T08:37:34.202 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spidev 2024-03-27T08:37:34.211 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-03-27T08:37:34.217 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-03-27T08:37:34.225 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-03-27T08:37:34.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-03-27T08:37:34.240 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-03-27T08:37:34.248 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/svga.txt 2024-03-27T08:37:34.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/ 2024-03-27T08:37:34.261 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-03-27T08:37:34.268 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/README 2024-03-27T08:37:34.276 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-03-27T08:37:34.284 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-03-27T08:37:34.293 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-03-27T08:37:34.318 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-03-27T08:37:34.319 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.985+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000231 [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ auth{0=1,2=1} fragtree_t(*^3) v1034 ap=1 f(v0 m2024-03-27T08:37:00.632766+0000 214=214+0) n(v0 rc2024-03-27T08:37:00.639439+0000 b549349 215=214+1) (inest mix) caps={15285=pAsLsXs/-@1},l=15285 | lock=0 importingcaps=0 importing=0 dirfrag=8 caps=1 stickydirs=0 replicated=1 authpin=1 scrubqueue=0 0x55a2eadb0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000231:[<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x10000000231:[<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:37:00.632766+0000 214=214+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:37:00.636181+0000 b549349 215=214+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:37:00.632766+0000 214=214+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:37:00.639439+0000 b549349 215=214+1)","error_str":""},"return_code":0} 2024-03-27T08:37:34.319 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.986+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000255 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd auth v318 ap=1 s=223 n(v0 rc2024-03-27T08:36:58.915917+0000 b223 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb10fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000255:[<0x10000000231/sysfs-block-rssd v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000255:[<0x10000000231/sysfs-block-rssd v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.320 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.987+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000233 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget auth v312 ap=1 s=3445 n(v0 rc2024-03-27T08:36:58.647541+0000 b3445 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb10f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000233:[<0x10000000231/configfs-usb-gadget v312>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000233:[<0x10000000231/configfs-usb-gadget v312>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.320 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.987+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids auth v350 ap=1 s=658 n(v0 rc2024-03-27T08:37:00.447497+0000 b658 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb110100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f2:[<0x10000000231/sysfs-kernel-uids v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f2:[<0x10000000231/sysfs-kernel-uids v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.320 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.989+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020e [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ auth{2=1} v550 ap=1 f(v0 m2024-03-27T08:36:58.495310+0000 7=7+0) n(v0 rc2024-03-27T08:36:58.501017+0000 b3647 8=7+1) (inest lock) (ifile excl) caps={15285=pAsLsXsFsx/AsLsXsFsx@1},l=15285 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55a2eb0d9180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000020e:[<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x1000000020e:[<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:36:58.495310+0000 7=7+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:36:58.498442+0000 b3647 8=7+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:36:58.495310+0000 7=7+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:36:58.501017+0000 b3647 8=7+1)","error_str":""},"return_code":0} 2024-03-27T08:37:34.320 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.989+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000206 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README auth{2=1} v520 ap=1 s=3813 n(v0 rc2024-03-27T08:36:58.423017+0000 b3813 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55a2eb0d9700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000206:[<0x10000000205/README v520>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000206:[<0x10000000205/README v520>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.989+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000216 [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/ auth{0=1,2=1} v604 ap=1 f(v0 m2024-03-27T08:36:58.633179+0000 26=26+0) n(v0 rc2024-03-27T08:36:58.636696+0000 b67191 27=26+1) (inest mix) caps={15285=pAsLsXs/-@1},l=15285 | lock=0 importingcaps=0 importing=0 dirfrag=1 caps=1 stickydirs=0 replicated=1 authpin=1 scrubqueue=0 0x55a2eadb0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000216:[<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x10000000216:[<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:36:58.633179+0000 26=26+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:36:58.635646+0000 b67191 27=26+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:36:58.633179+0000 26=26+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:36:58.636696+0000 b67191 27=26+1)","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.990+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra auth v344 ap=1 s=2608 n(v0 rc2024-03-27T08:37:00.193440+0000 b2608 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb111180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c9:[<0x10000000231/sysfs-driver-hid-roccat-pyra v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c9:[<0x10000000231/sysfs-driver-hid-roccat-pyra v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.990+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002af [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 auth v336 ap=1 s=614 n(v0 rc2024-03-27T08:36:59.692651+0000 b614 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb111700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002af:[<0x10000000231/sysfs-devices-power_resources_D1 v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002af:[<0x10000000231/sysfs-devices-power_resources_D1 v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.990+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000207 [...2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/ auth{2=1} v534 ap=1 f(v0 m2024-03-27T08:36:58.458302+0000 6=6+0) n(v0 rc2024-03-27T08:36:58.463069+0000 b12851 7=6+1) (inest lock) (ifile excl) caps={15285=pAsLsXsFsx/AsLsXsFsx@1},l=15285 | importingcaps=0 dirfrag=1 caps=1 replicated=1 authpin=1 scrubqueue=0 0x55a2eb10f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000207:[<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(2)0x10000000207:[<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-03-27T08:36:58.458302+0000 6=6+0)","ondisk_value.rstat":"n(v0 rc2024-03-27T08:36:58.461574+0000 b12851 7=6+1)","memory_value.dirstat":"f(v0 m2024-03-27T08:36:58.458302+0000 6=6+0)","memory_value.rstat":"n(v0 rc2024-03-27T08:36:58.463069+0000 b12851 7=6+1)","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.991+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000265 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 auth v322 ap=1 s=602 n(v0 rc2024-03-27T08:36:59.055102+0000 b602 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb110680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000265:[<0x10000000231/sysfs-bus-i2c-devices-fsa9480 v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000265:[<0x10000000231/sysfs-bus-i2c-devices-fsa9480 v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.321 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.991+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats auth v316 ap=1 s=655 n(v0 rc2024-03-27T08:36:58.860243+0000 b655 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb110c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024f:[<0x10000000231/procfs-diskstats v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024f:[<0x10000000231/procfs-diskstats v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.322 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.992+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio auth v348 ap=1 s=1177 n(v0 rc2024-03-27T08:37:00.352491+0000 b1177 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e7:[<0x10000000231/sysfs-gpio v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e7:[<0x10000000231/sysfs-gpio v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.322 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.993+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use auth v340 ap=1 s=471 n(v0 rc2024-03-27T08:36:59.721900+0000 b471 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b5:[<0x10000000231/sysfs-devices-resource_in_use v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b5:[<0x10000000231/sysfs-devices-resource_in_use v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.322 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.994+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 auth v326 ap=1 s=498 n(v0 rc2024-03-27T08:36:59.144115+0000 b498 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026f:[<0x10000000231/sysfs-bus-iio-proximity-as3935 v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026f:[<0x10000000231/sysfs-bus-iio-proximity-as3935 v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.994+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo auth v342 ap=1 s=2892 n(v0 rc2024-03-27T08:36:59.803773+0000 b2892 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c2:[<0x10000000231/sysfs-driver-hid-roccat-arvo v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c2:[<0x10000000231/sysfs-driver-hid-roccat-arvo v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.995+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000269 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 auth v324 ap=1 s=315 n(v0 rc2024-03-27T08:36:59.095170+0000 b315 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000269:[<0x10000000231/sysfs-bus-iio-accel-bmc150 v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000269:[<0x10000000231/sysfs-bus-iio-accel-bmc150 v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.996+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy auth v314 ap=1 s=2836 n(v0 rc2024-03-27T08:36:58.850839+0000 b2836 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2d9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024e:[<0x10000000231/ima_policy v314>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024e:[<0x10000000231/ima_policy v314>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.997+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices auth v332 ap=1 s=1033 n(v0 rc2024-03-27T08:36:59.602754+0000 b1033 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2da100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a3:[<0x10000000231/sysfs-devices v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a3:[<0x10000000231/sysfs-devices v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.997+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest auth v328 ap=1 s=1765 n(v0 rc2024-03-27T08:36:59.271921+0000 b1765 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2da680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027d:[<0x10000000231/sysfs-bus-usb-lvstest v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027d:[<0x10000000231/sysfs-bus-usb-lvstest v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.998+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr auth v334 ap=1 s=1739 n(v0 rc2024-03-27T08:36:59.629800+0000 b1739 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2dac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a6:[<0x10000000231/sysfs-devices-lpss_ltr v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a6:[<0x10000000231/sysfs-devices-lpss_ltr v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.998+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state auth v338 ap=1 s=877 n(v0 rc2024-03-27T08:36:59.710407+0000 b877 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2db180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b3:[<0x10000000231/sysfs-devices-power_state v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b3:[<0x10000000231/sysfs-devices-power_state v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.323 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:33.999+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host auth v330 ap=1 s=1501 n(v0 rc2024-03-27T08:36:59.570748+0000 b1501 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2db700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029f:[<0x10000000231/sysfs-class-scsi_host v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029f:[<0x10000000231/sysfs-class-scsi_host v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.327 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.000+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css auth v320 ap=1 s=1396 n(v0 rc2024-03-27T08:36:58.993830+0000 b1396 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025e:[<0x10000000231/sysfs-bus-css v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025e:[<0x10000000231/sysfs-bus-css v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.327 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.001+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid auth v346 ap=1 s=1032 n(v0 rc2024-03-27T08:37:00.236563+0000 b1032 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d3:[<0x10000000231/sysfs-driver-sunxi-sid v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d3:[<0x10000000231/sysfs-driver-sunxi-sid v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.327 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.001+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop auth v350 ap=1 s=2049 n(v0 rc2024-03-27T08:37:00.490609+0000 b2049 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f7:[<0x10000000231/sysfs-platform-asus-laptop v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f7:[<0x10000000231/sysfs-platform-asus-laptop v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.002+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node auth v334 ap=1 s=686 n(v0 rc2024-03-27T08:36:59.621561+0000 b686 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a5:[<0x10000000231/sysfs-devices-firmware_node v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a5:[<0x10000000231/sysfs-devices-firmware_node v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.002+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ec [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups auth v346 ap=1 s=616 n(v0 rc2024-03-27T08:37:00.392400+0000 b616 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ec:[<0x10000000231/sysfs-kernel-iommu_groups v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ec:[<0x10000000231/sysfs-kernel-iommu_groups v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.002+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000275 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss auth v324 ap=1 s=2745 n(v0 rc2024-03-27T08:36:59.198587+0000 b2745 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000275:[<0x10000000231/sysfs-bus-pci-devices-cciss v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000275:[<0x10000000231/sysfs-bus-pci-devices-cciss v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.003+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000288 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu auth v328 ap=1 s=440 n(v0 rc2024-03-27T08:36:59.368706+0000 b440 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000288:[<0x10000000231/sysfs-class-iommu-amd-iommu v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000288:[<0x10000000231/sysfs-class-iommu-amd-iommu v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.019+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000257 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi auth v318 ap=1 s=1983 n(v0 rc2024-03-27T08:36:58.933768+0000 b1983 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000257:[<0x10000000231/sysfs-bus-acpi v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000257:[<0x10000000231/sysfs-bus-acpi v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.020+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl auth v340 ap=1 s=817 n(v0 rc2024-03-27T08:36:59.747385+0000 b817 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b9:[<0x10000000231/sysfs-devices-system-ibm-rtl v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b9:[<0x10000000231/sysfs-devices-system-ibm-rtl v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.020+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 auth v322 ap=1 s=1001 n(v0 rc2024-03-27T08:36:59.112104+0000 b1001 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026b:[<0x10000000231/sysfs-bus-iio-frequency-adf4350 v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026b:[<0x10000000231/sysfs-bus-iio-frequency-adf4350 v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.020+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ab [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 auth v336 ap=1 s=1277 n(v0 rc2024-03-27T08:36:59.672267+0000 b1277 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2e5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ab:[<0x10000000231/sysfs-devices-platform-docg3 v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ab:[<0x10000000231/sysfs-devices-platform-docg3 v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.021+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000276 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd auth v326 ap=1 s=1816 n(v0 rc2024-03-27T08:36:59.207281+0000 b1816 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ea000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000276:[<0x10000000231/sysfs-bus-pci-drivers-ehci_hcd v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000276:[<0x10000000231/sysfs-bus-pci-drivers-ehci_hcd v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.021+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot auth v338 ap=1 s=626 n(v0 rc2024-03-27T08:36:59.700864+0000 b626 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ea580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b1:[<0x10000000231/sysfs-devices-power_resources_D3hot v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b1:[<0x10000000231/sysfs-devices-power_resources_D3hot v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.328 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.021+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events auth v320 ap=1 s=3132 n(v0 rc2024-03-27T08:36:59.005001+0000 b3132 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2eab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025f:[<0x10000000231/sysfs-bus-event_source-devices-events v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025f:[<0x10000000231/sysfs-bus-event_source-devices-events v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.022+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000247 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec auth v316 ap=1 s=838 n(v0 rc2024-03-27T08:36:58.783501+0000 b838 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2eb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000247:[<0x10000000231/debugfs-ec v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000247:[<0x10000000231/debugfs-ec v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.022+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom auth v344 ap=1 s=3412 n(v0 rc2024-03-27T08:37:00.247882+0000 b3412 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2eb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d6:[<0x10000000231/sysfs-driver-wacom v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d6:[<0x10000000231/sysfs-driver-wacom v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.022+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator auth v332 ap=1 s=12212 n(v0 rc2024-03-27T08:36:59.552195+0000 b12212 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ec100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029d:[<0x10000000231/sysfs-class-regulator v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029d:[<0x10000000231/sysfs-class-regulator v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.022+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid auth v342 ap=1 s=585 n(v0 rc2024-03-27T08:36:59.762548+0000 b585 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ebb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bc:[<0x10000000231/sysfs-driver-hid v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002bc:[<0x10000000231/sysfs-driver-hid v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.023+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ff [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop auth v352 ap=1 s=2937 n(v0 rc2024-03-27T08:37:00.554539+0000 b2937 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ed180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ff:[<0x10000000231/sysfs-platform-msi-laptop v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ff:[<0x10000000231/sysfs-platform-msi-laptop v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.023+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000292 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv auth v330 ap=1 s=574 n(v0 rc2024-03-27T08:36:59.456196+0000 b574 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ec680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000292:[<0x10000000231/sysfs-class-net-batman-adv v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000292:[<0x10000000231/sysfs-class-net-batman-adv v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.023+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000301 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 auth v354 ap=1 s=1767 n(v0 rc2024-03-27T08:37:00.574134+0000 b1767 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ecc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000301:[<0x10000000231/sysfs-platform-ts5500 v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000301:[<0x10000000231/sysfs-platform-ts5500 v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.023+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 auth v356 ap=1 s=3089 n(v0 rc2024-03-27T08:37:00.482421+0000 b3089 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f6:[<0x10000000231/sysfs-ocfs2 v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f6:[<0x10000000231/sysfs-ocfs2 v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.024+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo auth v348 ap=1 s=597 n(v0 rc2024-03-27T08:37:00.456279+0000 b597 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2ed700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f3:[<0x10000000231/sysfs-kernel-vmcoreinfo v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f3:[<0x10000000231/sysfs-kernel-vmcoreinfo v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.024+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm auth v322 ap=1 s=1180 n(v0 rc2024-03-27T08:36:58.840671+0000 b1180 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024d:[<0x10000000231/evm v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024d:[<0x10000000231/evm v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.024+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop auth v358 ap=1 s=1551 n(v0 rc2024-03-27T08:37:00.530221+0000 b1551 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fc:[<0x10000000231/sysfs-platform-eeepc-laptop v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002fc:[<0x10000000231/sysfs-platform-eeepc-laptop v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.329 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.025+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys auth v342 ap=1 s=985 n(v0 rc2024-03-27T08:36:59.793145+0000 b985 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c1:[<0x10000000231/sysfs-driver-hid-prodikeys v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c1:[<0x10000000231/sysfs-driver-hid-prodikeys v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.025+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als auth v326 ap=1 s=2051 n(v0 rc2024-03-27T08:36:59.129157+0000 b2051 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026d:[<0x10000000231/sysfs-bus-iio-light-lm3533-als v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026d:[<0x10000000231/sysfs-bus-iio-light-lm3533-als v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.025+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac auth v336 ap=1 s=6247 n(v0 rc2024-03-27T08:36:59.612796+0000 b6247 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a4:[<0x10000000231/sysfs-devices-edac v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a4:[<0x10000000231/sysfs-devices-edac v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.025+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse auth v348 ap=1 s=588 n(v0 rc2024-03-27T08:37:00.240023+0000 b588 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d4:[<0x10000000231/sysfs-driver-tegra-fuse v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d4:[<0x10000000231/sysfs-driver-tegra-fuse v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.025+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt auth v334 ap=1 s=6215 n(v0 rc2024-03-27T08:36:59.428679+0000 b6215 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028f:[<0x10000000231/sysfs-class-mic.txt v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028f:[<0x10000000231/sysfs-class-mic.txt v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.026+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000289 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu auth v332 ap=1 s=1037 n(v0 rc2024-03-27T08:36:59.376896+0000 b1037 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000289:[<0x10000000231/sysfs-class-iommu-intel-iommu v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000289:[<0x10000000231/sysfs-class-iommu-intel-iommu v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.026+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000245 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc auth v320 ap=1 s=8923 n(v0 rc2024-03-27T08:36:58.768204+0000 b8923 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000245:[<0x10000000231/configfs-usb-gadget-uvc v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000245:[<0x10000000231/configfs-usb-gadget-uvc v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.027+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000250 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore auth v324 ap=1 s=1707 n(v0 rc2024-03-27T08:36:58.869218+0000 b1707 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2f5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000250:[<0x10000000231/pstore v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000250:[<0x10000000231/pstore v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.027+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cf [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start auth v346 ap=1 s=844 n(v0 rc2024-03-27T08:37:00.219737+0000 b844 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cf:[<0x10000000231/sysfs-driver-intel-rapid-start v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002cf:[<0x10000000231/sysfs-driver-intel-rapid-start v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.330 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.028+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv auth v352 ap=1 s=889 n(v0 rc2024-03-27T08:37:00.309968+0000 b889 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e2:[<0x10000000231/sysfs-firmware-sgi_uv v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e2:[<0x10000000231/sysfs-firmware-sgi_uv v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.331 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.029+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe auth v338 ap=1 s=2934 n(v0 rc2024-03-27T08:36:59.757413+0000 b2934 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bb:[<0x10000000231/sysfs-driver-genwqe v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002bb:[<0x10000000231/sysfs-driver-genwqe v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.029+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000283 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi auth v330 ap=1 s=1656 n(v0 rc2024-03-27T08:36:59.323802+0000 b1656 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000283:[<0x10000000231/sysfs-class-bdi v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000283:[<0x10000000231/sysfs-class-bdi v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.030+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus auth v344 ap=1 s=2657 n(v0 rc2024-03-27T08:36:59.836999+0000 b2657 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c7:[<0x10000000231/sysfs-driver-hid-roccat-kovaplus v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c7:[<0x10000000231/sysfs-driver-hid-roccat-kovaplus v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.030+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo auth v340 ap=1 s=2835 n(v0 rc2024-03-27T08:36:59.768462+0000 b2835 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fbb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bd:[<0x10000000231/sysfs-driver-hid-lenovo v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002bd:[<0x10000000231/sysfs-driver-hid-lenovo v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.030+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000270 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs auth v328 ap=1 s=534 n(v0 rc2024-03-27T08:36:59.151334+0000 b534 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fc100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000270:[<0x10000000231/sysfs-bus-iio-trigger-sysfs v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000270:[<0x10000000231/sysfs-bus-iio-trigger-sysfs v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.031+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw auth v350 ap=1 s=1230 n(v0 rc2024-03-27T08:37:00.298947+0000 b1230 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e0:[<0x10000000231/sysfs-firmware-ofw v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e0:[<0x10000000231/sysfs-firmware-ofw v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.032+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002eb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps auth v354 ap=1 s=208 n(v0 rc2024-03-27T08:37:00.384967+0000 b208 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002eb:[<0x10000000231/sysfs-kernel-fscaps v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002eb:[<0x10000000231/sysfs-kernel-fscaps v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.032+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000305 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp auth v360 ap=1 s=4286 n(v0 rc2024-03-27T08:37:00.620368+0000 b4286 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000305:[<0x10000000231/sysfs-ptp v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000305:[<0x10000000231/sysfs-ptp v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.032+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000277 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform auth v348 ap=1 s=1138 n(v0 rc2024-03-27T08:36:59.215772+0000 b1138 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb2fd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000277:[<0x10000000231/sysfs-bus-platform v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000277:[<0x10000000231/sysfs-bus-platform v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.033+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc auth v370 ap=1 s=2073 n(v0 rc2024-03-27T08:36:59.727983+0000 b2073 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb302000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b6:[<0x10000000231/sysfs-devices-soc v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b6:[<0x10000000231/sysfs-devices-soc v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.332 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.033+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab auth v390 ap=1 s=17556 n(v0 rc2024-03-27T08:37:00.438494+0000 b17556 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb302580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f1:[<0x10000000231/sysfs-kernel-slab v390>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f1:[<0x10000000231/sysfs-kernel-slab v390>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.033+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000259 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma auth v338 ap=1 s=945 n(v0 rc2024-03-27T08:36:58.953603+0000 b945 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb303080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000259:[<0x10000000231/sysfs-bus-bcma v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000259:[<0x10000000231/sysfs-bus-bcma v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.034+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone auth v374 ap=1 s=5060 n(v0 rc2024-03-27T08:36:59.816812+0000 b5060 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb302b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c4:[<0x10000000231/sysfs-driver-hid-roccat-kone v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c4:[<0x10000000231/sysfs-driver-hid-roccat-kone v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.034+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state auth v368 ap=1 s=1026 n(v0 rc2024-03-27T08:36:59.715793+0000 b1026 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb303600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b4:[<0x10000000231/sysfs-devices-real_power_state v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b4:[<0x10000000231/sysfs-devices-real_power_state v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.034+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ea [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params auth v386 ap=1 s=1264 n(v0 rc2024-03-27T08:37:00.378508+0000 b1264 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb304680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ea:[<0x10000000231/sysfs-kernel-boot_params v386>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ea:[<0x10000000231/sysfs-kernel-boot_params v386>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.035+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory auth v362 ap=1 s=3712 n(v0 rc2024-03-27T08:36:59.637640+0000 b3712 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb304100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a7:[<0x10000000231/sysfs-devices-memory v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a7:[<0x10000000231/sysfs-devices-memory v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.035+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront auth v380 ap=1 s=533 n(v0 rc2024-03-27T08:37:00.256474+0000 b533 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb304c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d8:[<0x10000000231/sysfs-driver-xen-blkfront v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d8:[<0x10000000231/sysfs-driver-xen-blkfront v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.036+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 auth v394 ap=1 s=799 n(v0 rc2024-03-27T08:37:00.507625+0000 b799 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb303b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f9:[<0x10000000231/sysfs-platform-at91 v394>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f9:[<0x10000000231/sysfs-platform-at91 v394>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.036+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap auth v358 ap=1 s=5019 n(v0 rc2024-03-27T08:36:59.524760+0000 b5019 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb305180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029a:[<0x10000000231/sysfs-class-powercap v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029a:[<0x10000000231/sysfs-class-powercap v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.036+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration auth v360 ap=1 s=717 n(v0 rc2024-03-27T08:36:59.561276+0000 b717 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb305700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029e:[<0x10000000231/sysfs-class-rtc-rtc0-device-rtc_calibration v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029e:[<0x10000000231/sysfs-class-rtc-rtc0-device-rtc_calibration v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.333 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.037+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi auth v382 ap=1 s=6630 n(v0 rc2024-03-27T08:37:00.260670+0000 b6630 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d9:[<0x10000000231/sysfs-firmware-acpi v382>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d9:[<0x10000000231/sysfs-firmware-acpi v382>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.334 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.038+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000279 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg auth v350 ap=1 s=2975 n(v0 rc2024-03-27T08:36:59.234791+0000 b2975 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000279:[<0x10000000231/sysfs-bus-rpmsg v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000279:[<0x10000000231/sysfs-bus-rpmsg v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.334 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.038+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000297 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics auth v356 ap=1 s=6696 n(v0 rc2024-03-27T08:36:59.499091+0000 b6696 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000297:[<0x10000000231/sysfs-class-net-statistics v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000297:[<0x10000000231/sysfs-class-net-statistics v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.334 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.038+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000252 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block auth v334 ap=1 s=8870 n(v0 rc2024-03-27T08:36:58.887473+0000 b8870 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000252:[<0x10000000231/sysfs-block v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000252:[<0x10000000231/sysfs-block v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.334 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.038+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu auth v372 ap=1 s=9787 n(v0 rc2024-03-27T08:36:59.741997+0000 b9787 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b8:[<0x10000000231/sysfs-devices-system-cpu v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b8:[<0x10000000231/sysfs-devices-system-cpu v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.334 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000244 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 auth v326 ap=1 s=340 n(v0 rc2024-03-27T08:36:58.759819+0000 b340 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000244:[<0x10000000231/configfs-usb-gadget-uac2 v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000244:[<0x10000000231/configfs-usb-gadget-uac2 v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop auth v378 ap=1 s=1788 n(v0 rc2024-03-27T08:37:00.232404+0000 b1788 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d2:[<0x10000000231/sysfs-driver-samsung-laptop v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d2:[<0x10000000231/sysfs-driver-samsung-laptop v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm auth v388 ap=1 s=1738 n(v0 rc2024-03-27T08:37:00.427778+0000 b1738 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f0:[<0x10000000231/sysfs-kernel-mm-ksm v388>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f0:[<0x10000000231/sysfs-kernel-mm-ksm v388>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 auth v366 ap=1 s=614 n(v0 rc2024-03-27T08:36:59.696886+0000 b614 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b0:[<0x10000000231/sysfs-devices-power_resources_D2 v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b0:[<0x10000000231/sysfs-devices-power_resources_D2 v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002db [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi auth v384 ap=1 s=621 n(v0 rc2024-03-27T08:37:00.269710+0000 b621 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002db:[<0x10000000231/sysfs-firmware-efi v384>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002db:[<0x10000000231/sysfs-firmware-efi v384>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.039+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd auth v354 ap=1 s=681 n(v0 rc2024-03-27T08:36:59.385356+0000 b681 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb30d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028a:[<0x10000000231/sysfs-class-lcd v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028a:[<0x10000000231/sysfs-class-lcd v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.040+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000256 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram auth v336 ap=1 s=5060 n(v0 rc2024-03-27T08:36:58.924651+0000 b5060 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb314000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000256:[<0x10000000231/sysfs-block-zram v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000256:[<0x10000000231/sysfs-block-zram v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.040+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000261 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 auth v340 ap=1 s=1928 n(v0 rc2024-03-27T08:36:59.021001+0000 b1928 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb315600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000261:[<0x10000000231/sysfs-bus-event_source-devices-hv_24x7 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000261:[<0x10000000231/sysfs-bus-event_source-devices-hv_24x7 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.040+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd auth v332 ap=1 s=448 n(v0 rc2024-03-27T08:36:58.821944+0000 b448 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb315080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024b:[<0x10000000231/debugfs-pktcdvd v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024b:[<0x10000000231/debugfs-pktcdvd v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.040+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000267 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 auth v344 ap=1 s=472 n(v0 rc2024-03-27T08:36:59.072419+0000 b472 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb315b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000267:[<0x10000000231/sysfs-bus-i2c-devices-lm3533 v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000267:[<0x10000000231/sysfs-bus-i2c-devices-lm3533 v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.337 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.041+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop auth v396 ap=1 s=531 n(v0 rc2024-03-27T08:37:00.538293+0000 b531 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb314580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fd:[<0x10000000231/sysfs-platform-ideapad-laptop v396>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002fd:[<0x10000000231/sysfs-platform-ideapad-laptop v396>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.041+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000235 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm auth v324 ap=1 s=422 n(v0 rc2024-03-27T08:36:58.655565+0000 b422 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb314b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000235:[<0x10000000231/configfs-usb-gadget-ecm v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000235:[<0x10000000231/configfs-usb-gadget-ecm v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.041+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline auth v392 ap=1 s=1681 n(v0 rc2024-03-27T08:37:00.465822+0000 b1681 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb316100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f4:[<0x10000000231/sysfs-memory-page-offline v392>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f4:[<0x10000000231/sysfs-memory-page-offline v392>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.041+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000262 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci auth v342 ap=1 s=1720 n(v0 rc2024-03-27T08:36:59.028429+0000 b1720 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb316680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000262:[<0x10000000231/sysfs-bus-event_source-devices-hv_gpci v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000262:[<0x10000000231/sysfs-bus-event_source-devices-hv_gpci v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.042+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto auth v330 ap=1 s=1188 n(v0 rc2024-03-27T08:36:58.813407+0000 b1188 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024a:[<0x10000000231/debugfs-pfo-nx-crypto v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024a:[<0x10000000231/debugfs-pfo-nx-crypto v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.042+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus auth v376 ap=1 s=5181 n(v0 rc2024-03-27T08:36:59.823714+0000 b5181 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb316c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c5:[<0x10000000231/sysfs-driver-hid-roccat-koneplus v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c5:[<0x10000000231/sysfs-driver-hid-roccat-koneplus v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.043+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002aa [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget auth v364 ap=1 s=667 n(v0 rc2024-03-27T08:36:59.666663+0000 b667 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb317180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002aa:[<0x10000000231/sysfs-devices-platform-_UDC_-gadget v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002aa:[<0x10000000231/sysfs-devices-platform-_UDC_-gadget v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.043+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 auth v346 ap=1 s=300 n(v0 rc2024-03-27T08:36:59.120279+0000 b300 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb317700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026c:[<0x10000000231/sysfs-bus-iio-gyro-bmg160 v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026c:[<0x10000000231/sysfs-bus-iio-gyro-bmg160 v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.043+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc auth v362 ap=1 s=985 n(v0 rc2024-03-27T08:36:59.649339+0000 b985 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a8:[<0x10000000231/sysfs-devices-mmc v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a8:[<0x10000000231/sysfs-devices-mmc v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.043+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000246 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe auth v328 ap=1 s=3784 n(v0 rc2024-03-27T08:36:58.776328+0000 b3784 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000246:[<0x10000000231/debugfs-driver-genwqe v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000246:[<0x10000000231/debugfs-driver-genwqe v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.044+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000287 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu auth v352 ap=1 s=508 n(v0 rc2024-03-27T08:36:59.359757+0000 b508 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000287:[<0x10000000231/sysfs-class-iommu v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000287:[<0x10000000231/sysfs-class-iommu v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.338 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.044+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online auth v364 ap=1 s=1008 n(v0 rc2024-03-27T08:36:59.657551+0000 b1008 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a9:[<0x10000000231/sysfs-devices-online v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a9:[<0x10000000231/sysfs-devices-online v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.044+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000291 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net auth v356 ap=1 s=7235 n(v0 rc2024-03-27T08:36:59.446996+0000 b7235 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000291:[<0x10000000231/sysfs-class-net v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000291:[<0x10000000231/sysfs-class-net v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000281 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 auth v350 ap=1 s=2380 n(v0 rc2024-03-27T08:36:59.306704+0000 b2380 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000281:[<0x10000000231/sysfs-class-backlight-driver-adp8870 v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000281:[<0x10000000231/sysfs-class-backlight-driver-adp8870 v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency auth v348 ap=1 s=358 n(v0 rc2024-03-27T08:36:59.289267+0000 b358 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027f:[<0x10000000231/sysfs-cfq-target-latency v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027f:[<0x10000000231/sysfs-cfq-target-latency v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ee [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm auth v394 ap=1 s=202 n(v0 rc2024-03-27T08:37:00.412404+0000 b202 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ee:[<0x10000000231/sysfs-kernel-mm v394>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ee:[<0x10000000231/sysfs-kernel-mm v394>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bf [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch auth v374 ap=1 s=531 n(v0 rc2024-03-27T08:36:59.780090+0000 b531 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002bf:[<0x10000000231/sysfs-driver-hid-multitouch v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002bf:[<0x10000000231/sysfs-driver-hid-multitouch v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000273 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei auth v346 ap=1 s=247 n(v0 rc2024-03-27T08:36:59.178846+0000 b247 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb31f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000273:[<0x10000000231/sysfs-bus-mei v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000273:[<0x10000000231/sysfs-bus-mei v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.045+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000251 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata auth v338 ap=1 s=2485 n(v0 rc2024-03-27T08:36:58.878735+0000 b2485 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb324580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000251:[<0x10000000231/sysfs-ata v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000251:[<0x10000000231/sysfs-ata v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.046+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fe [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim auth v398 ap=1 s=1974 n(v0 rc2024-03-27T08:37:00.546924+0000 b1974 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb324000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fe:[<0x10000000231/sysfs-platform-kim v398>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002fe:[<0x10000000231/sysfs-platform-kim v398>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.046+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000234 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm auth v330 ap=1 s=270 n(v0 rc2024-03-27T08:36:58.651299+0000 b270 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb324b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000234:[<0x10000000231/configfs-usb-gadget-acm v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000234:[<0x10000000231/configfs-usb-gadget-acm v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.046+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ca [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos auth v380 ap=1 s=9380 n(v0 rc2024-03-27T08:37:00.198625+0000 b9380 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb325080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ca:[<0x10000000231/sysfs-driver-hid-roccat-ryos v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ca:[<0x10000000231/sysfs-driver-hid-roccat-ryos v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.046+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 auth v340 ap=1 s=1079 n(v0 rc2024-03-27T08:36:58.962213+0000 b1079 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb325600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025a:[<0x10000000231/sysfs-bus-coresight-devices-etb10 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025a:[<0x10000000231/sysfs-bus-coresight-devices-etb10 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.339 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.046+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku auth v376 ap=1 s=8101 n(v0 rc2024-03-27T08:36:59.810592+0000 b8101 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb325b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c3:[<0x10000000231/sysfs-driver-hid-roccat-isku v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c3:[<0x10000000231/sysfs-driver-hid-roccat-isku v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.047+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun auth v370 ap=1 s=600 n(v0 rc2024-03-27T08:36:59.736052+0000 b600 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb326100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b7:[<0x10000000231/sysfs-devices-sun v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b7:[<0x10000000231/sysfs-devices-sun v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.047+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002df [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap auth v386 ap=1 s=2329 n(v0 rc2024-03-27T08:37:00.292232+0000 b2329 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb326680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002df:[<0x10000000231/sysfs-firmware-memmap v386>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002df:[<0x10000000231/sysfs-firmware-memmap v386>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.047+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e3 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 auth v388 ap=1 s=3783 n(v0 rc2024-03-27T08:37:00.318299+0000 b3783 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb327700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e3:[<0x10000000231/sysfs-fs-ext4 v388>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e3:[<0x10000000231/sysfs-fs-ext4 v388>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.047+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ba [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu auth v372 ap=1 s=670 n(v0 rc2024-03-27T08:36:59.753017+0000 b670 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ba:[<0x10000000231/sysfs-devices-system-xen_cpu v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ba:[<0x10000000231/sysfs-devices-system-xen_cpu v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.048+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e4 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs auth v390 ap=1 s=2413 n(v0 rc2024-03-27T08:37:00.326576+0000 b2413 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb326c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e4:[<0x10000000231/sysfs-fs-f2fs v390>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e4:[<0x10000000231/sysfs-fs-f2fs v390>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.048+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ad [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power auth v368 ap=1 s=11803 n(v0 rc2024-03-27T08:36:59.682237+0000 b11803 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb327180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ad:[<0x10000000231/sysfs-devices-power v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ad:[<0x10000000231/sysfs-devices-power v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.048+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000272 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media auth v344 ap=1 s=268 n(v0 rc2024-03-27T08:36:59.170218+0000 b268 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000272:[<0x10000000231/sysfs-bus-media v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000272:[<0x10000000231/sysfs-bus-media v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.048+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000248 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad auth v334 ap=1 s=465 n(v0 rc2024-03-27T08:36:58.792665+0000 b465 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000248:[<0x10000000231/debugfs-ideapad v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000248:[<0x10000000231/debugfs-ideapad v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.048+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 auth v382 ap=1 s=922 n(v0 rc2024-03-27T08:37:00.208264+0000 b922 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cc:[<0x10000000231/sysfs-driver-hid-srws1 v382>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002cc:[<0x10000000231/sysfs-driver-hid-srws1 v382>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.049+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000300 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb auth v400 ap=1 s=445 n(v0 rc2024-03-27T08:37:00.562672+0000 b445 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000300:[<0x10000000231/sysfs-platform-tahvo-usb v400>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000300:[<0x10000000231/sysfs-platform-tahvo-usb v400>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.340 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.049+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg auth v396 ap=1 s=1975 n(v0 rc2024-03-27T08:37:00.522525+0000 b1975 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb32f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fb:[<0x10000000231/sysfs-platform-chipidea-usb-otg v396>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002fb:[<0x10000000231/sysfs-platform-chipidea-usb-otg v396>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.049+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000290 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd auth v354 ap=1 s=7568 n(v0 rc2024-03-27T08:36:59.436783+0000 b7568 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb330680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000290:[<0x10000000231/sysfs-class-mtd v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000290:[<0x10000000231/sysfs-class-mtd v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.049+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000298 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd auth v358 ap=1 s=2800 n(v0 rc2024-03-27T08:36:59.507672+0000 b2800 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb330c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000298:[<0x10000000231/sysfs-class-pktcdvd v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000298:[<0x10000000231/sysfs-class-pktcdvd v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.049+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ac [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb auth v366 ap=1 s=1541 n(v0 rc2024-03-27T08:36:59.677116+0000 b1541 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb331180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ac:[<0x10000000231/sysfs-devices-platform-sh_mobile_lcdc_fb v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ac:[<0x10000000231/sysfs-devices-platform-sh_mobile_lcdc_fb v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.050+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d7 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback auth v384 ap=1 s=736 n(v0 rc2024-03-27T08:37:00.252023+0000 b736 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb330100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d7:[<0x10000000231/sysfs-driver-xen-blkback v384>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d7:[<0x10000000231/sysfs-driver-xen-blkback v384>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.050+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev auth v360 ap=1 s=693 n(v0 rc2024-03-27T08:36:59.594717+0000 b693 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb336000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a2:[<0x10000000231/sysfs-dev v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a2:[<0x10000000231/sysfs-dev v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.050+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000249 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc auth v336 ap=1 s=572 n(v0 rc2024-03-27T08:36:58.802150+0000 b572 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb331700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000249:[<0x10000000231/debugfs-olpc v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000249:[<0x10000000231/debugfs-olpc v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.050+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 auth v352 ap=1 s=1541 n(v0 rc2024-03-27T08:36:59.402316+0000 b1541 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb336580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028c:[<0x10000000231/sysfs-class-led-driver-lm3533 v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028c:[<0x10000000231/sysfs-class-led-driver-lm3533 v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.050+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000239 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback auth v332 ap=1 s=189 n(v0 rc2024-03-27T08:36:58.677491+0000 b189 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb336b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000239:[<0x10000000231/configfs-usb-gadget-loopback v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000239:[<0x10000000231/configfs-usb-gadget-loopback v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.051+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure auth v378 ap=1 s=5616 n(v0 rc2024-03-27T08:36:59.829833+0000 b5616 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb337080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c6:[<0x10000000231/sysfs-driver-hid-roccat-konepure v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c6:[<0x10000000231/sysfs-driver-hid-roccat-konepure v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.051+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000260 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format auth v342 ap=1 s=704 n(v0 rc2024-03-27T08:36:59.014092+0000 b704 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb337600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000260:[<0x10000000231/sysfs-bus-event_source-devices-format v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000260:[<0x10000000231/sysfs-bus-event_source-devices-format v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.341 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.051+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000306 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty auth v402 ap=1 s=4771 n(v0 rc2024-03-27T08:37:00.628401+0000 b4771 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb337b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000306:[<0x10000000231/sysfs-tty v402>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000306:[<0x10000000231/sysfs-tty v402>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.051+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 auth v392 ap=1 s=1164 n(v0 rc2024-03-27T08:37:00.362007+0000 b1164 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb338100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e8:[<0x10000000231/sysfs-i2c-bmp085 v392>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e8:[<0x10000000231/sysfs-i2c-bmp085 v392>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.051+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000299 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power auth v360 ap=1 s=2792 n(v0 rc2024-03-27T08:36:59.516621+0000 b2792 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb338c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000299:[<0x10000000231/sysfs-class-power v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000299:[<0x10000000231/sysfs-class-power v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.052+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000307 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf auth v404 ap=1 s=3945 n(v0 rc2024-03-27T08:37:00.636181+0000 b3945 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb338680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000307:[<0x10000000231/sysfs-wusb_cbaf v404>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000307:[<0x10000000231/sysfs-wusb_cbaf v404>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.052+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port auth v348 ap=1 s=2931 n(v0 rc2024-03-27T08:36:59.280844+0000 b2931 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb339180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027e:[<0x10000000231/sysfs-c2port v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027e:[<0x10000000231/sysfs-c2port v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.052+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000293 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm auth v358 ap=1 s=4753 n(v0 rc2024-03-27T08:36:59.463460+0000 b4753 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb339700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000293:[<0x10000000231/sysfs-class-net-cdc_ncm v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000293:[<0x10000000231/sysfs-class-net-cdc_ncm v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.052+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cb [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu auth v368 ap=1 s=4047 n(v0 rc2024-03-27T08:37:00.203982+0000 b4047 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cb:[<0x10000000231/sysfs-driver-hid-roccat-savu v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002cb:[<0x10000000231/sysfs-driver-hid-roccat-savu v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.052+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc auth v364 ap=1 s=2469 n(v0 rc2024-03-27T08:36:59.586773+0000 b2469 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a1:[<0x10000000231/sysfs-class-uwb_rc-wusbhc v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a1:[<0x10000000231/sysfs-class-uwb_rc-wusbhc v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.053+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000284 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl auth v350 ap=1 s=7824 n(v0 rc2024-03-27T08:36:59.332527+0000 b7824 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000284:[<0x10000000231/sysfs-class-cxl v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000284:[<0x10000000231/sysfs-class-cxl v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.053+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000285 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq auth v352 ap=1 s=3764 n(v0 rc2024-03-27T08:36:59.342062+0000 b3764 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000285:[<0x10000000231/sysfs-class-devfreq v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000285:[<0x10000000231/sysfs-class-devfreq v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.053+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ef [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages auth v378 ap=1 s=521 n(v0 rc2024-03-27T08:37:00.419634+0000 b521 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ef:[<0x10000000231/sysfs-kernel-mm-hugepages v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ef:[<0x10000000231/sysfs-kernel-mm-hugepages v378>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.342 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.053+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote auth v370 ap=1 s=3627 n(v0 rc2024-03-27T08:37:00.212103+0000 b3627 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb33f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002cd:[<0x10000000231/sysfs-driver-hid-wiimote v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002cd:[<0x10000000231/sysfs-driver-hid-wiimote v370>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.053+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000254 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm auth v330 ap=1 s=817 n(v0 rc2024-03-27T08:36:58.906546+0000 b817 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb340100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000254:[<0x10000000231/sysfs-block-dm v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000254:[<0x10000000231/sysfs-block-dm v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.054+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000266 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 auth v340 ap=1 s=640 n(v0 rc2024-03-27T08:36:59.063716+0000 b640 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb340680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000266:[<0x10000000231/sysfs-bus-i2c-devices-hm6352 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000266:[<0x10000000231/sysfs-bus-i2c-devices-hm6352 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.054+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fa [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb auth v380 ap=1 s=306 n(v0 rc2024-03-27T08:37:00.515221+0000 b306 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb341180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002fa:[<0x10000000231/sysfs-platform-brcmstb-gisb-arb v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002fa:[<0x10000000231/sysfs-platform-brcmstb-gisb-arb v380>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.054+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel auth v334 ap=1 s=463 n(v0 rc2024-03-27T08:36:58.979241+0000 b463 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb340c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025c:[<0x10000000231/sysfs-bus-coresight-devices-funnel v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025c:[<0x10000000231/sysfs-bus-coresight-devices-funnel v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.054+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc auth v362 ap=1 s=4351 n(v0 rc2024-03-27T08:36:59.542740+0000 b4351 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb348580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029c:[<0x10000000231/sysfs-class-rc v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029c:[<0x10000000231/sysfs-class-rc v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.055+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi auth v374 ap=1 s=2615 n(v0 rc2024-03-27T08:37:00.228923+0000 b2615 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb348b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d1:[<0x10000000231/sysfs-driver-ppi v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d1:[<0x10000000231/sysfs-driver-ppi v374>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.343 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.055+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 auth v344 ap=1 s=1180 n(v0 rc2024-03-27T08:36:59.102428+0000 b1180 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb348000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026a:[<0x10000000231/sysfs-bus-iio-frequency-ad9523 v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026a:[<0x10000000231/sysfs-bus-iio-frequency-ad9523 v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.055+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc auth v336 ap=1 s=403 n(v0 rc2024-03-27T08:36:58.986375+0000 b403 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb349080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025d:[<0x10000000231/sysfs-bus-coresight-devices-tmc v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025d:[<0x10000000231/sysfs-bus-coresight-devices-tmc v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei auth v356 ap=1 s=903 n(v0 rc2024-03-27T08:36:59.419020+0000 b903 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb341700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028e:[<0x10000000231/sysfs-class-mei v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028e:[<0x10000000231/sysfs-class-mei v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000241 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink auth v324 ap=1 s=340 n(v0 rc2024-03-27T08:36:58.737018+0000 b340 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb349600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000241:[<0x10000000231/configfs-usb-gadget-sourcesink v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000241:[<0x10000000231/configfs-usb-gadget-sourcesink v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r auth v354 ap=1 s=474 n(v0 rc2024-03-27T08:36:59.410378+0000 b474 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb349b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028d:[<0x10000000231/sysfs-class-leds-gt683r v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028d:[<0x10000000231/sysfs-class-leds-gt683r v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000238 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid auth v320 ap=1 s=338 n(v0 rc2024-03-27T08:36:58.670201+0000 b338 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb34ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000238:[<0x10000000231/configfs-usb-gadget-hid v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000238:[<0x10000000231/configfs-usb-gadget-hid v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000243 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 auth v328 ap=1 s=376 n(v0 rc2024-03-27T08:36:58.752698+0000 b376 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb34a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000243:[<0x10000000231/configfs-usb-gadget-uac1 v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000243:[<0x10000000231/configfs-usb-gadget-uac1 v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.056+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 auth v376 ap=1 s=8014 n(v0 rc2024-03-27T08:37:00.335063+0000 b8014 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb34a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e5:[<0x10000000231/sysfs-fs-nilfs2 v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e5:[<0x10000000231/sysfs-fs-nilfs2 v376>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.057+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000236 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem auth v318 ap=1 s=420 n(v0 rc2024-03-27T08:36:58.659797+0000 b420 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb34b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000236:[<0x10000000231/configfs-usb-gadget-eem v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000236:[<0x10000000231/configfs-usb-gadget-eem v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.347 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.057+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000268 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio auth v342 ap=1 s=59617 n(v0 rc2024-03-27T08:36:59.086765+0000 b59617 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb350580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000268:[<0x10000000231/sysfs-bus-iio v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000268:[<0x10000000231/sysfs-bus-iio v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.057+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd auth v366 ap=1 s=1848 n(v0 rc2024-03-27T08:36:59.786266+0000 b1848 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb350b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c0:[<0x10000000231/sysfs-driver-hid-picolcd v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c0:[<0x10000000231/sysfs-driver-hid-picolcd v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.057+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback auth v372 ap=1 s=672 n(v0 rc2024-03-27T08:37:00.224773+0000 b672 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb350000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d0:[<0x10000000231/sysfs-driver-pciback v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d0:[<0x10000000231/sysfs-driver-pciback v372>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 auth v346 ap=1 s=745 n(v0 rc2024-03-27T08:36:59.137313+0000 b745 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb34b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000026e:[<0x10000000231/sysfs-bus-iio-mpu6050 v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000026e:[<0x10000000231/sysfs-bus-iio-mpu6050 v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000264 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi auth v338 ap=1 s=683 n(v0 rc2024-03-27T08:36:59.046796+0000 b683 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb351600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000264:[<0x10000000231/sysfs-bus-hsi v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000264:[<0x10000000231/sysfs-bus-hsi v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm auth v322 ap=1 s=421 n(v0 rc2024-03-27T08:36:58.696507+0000 b421 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb351b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023c:[<0x10000000231/configfs-usb-gadget-ncm v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023c:[<0x10000000231/configfs-usb-gadget-ncm v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000258 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba auth v332 ap=1 s=1136 n(v0 rc2024-03-27T08:36:58.943590+0000 b1136 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb351080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000258:[<0x10000000231/sysfs-bus-amba v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000258:[<0x10000000231/sysfs-bus-amba v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000242 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset auth v326 ap=1 s=421 n(v0 rc2024-03-27T08:36:58.744878+0000 b421 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb352100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000242:[<0x10000000231/configfs-usb-gadget-subset v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000242:[<0x10000000231/configfs-usb-gadget-subset v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.058+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000278 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd auth v330 ap=1 s=2563 n(v0 rc2024-03-27T08:36:59.225538+0000 b2563 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf71080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000278:[<0x10000000231/sysfs-bus-rbd v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000278:[<0x10000000231/sysfs-bus-rbd v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.059+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000286 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon auth v342 ap=1 s=3406 n(v0 rc2024-03-27T08:36:59.351549+0000 b3406 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf71600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000286:[<0x10000000231/sysfs-class-extcon v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000286:[<0x10000000231/sysfs-class-extcon v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.348 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.059+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua auth v356 ap=1 s=372 n(v0 rc2024-03-27T08:36:59.842672+0000 b372 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf72680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002c8:[<0x10000000231/sysfs-driver-hid-roccat-lua v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002c8:[<0x10000000231/sysfs-driver-hid-roccat-lua v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.060+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e9 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft auth v364 ap=1 s=1026 n(v0 rc2024-03-27T08:37:00.370106+0000 b1026 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf71b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e9:[<0x10000000231/sysfs-ibft v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e9:[<0x10000000231/sysfs-ibft v364>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.060+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002be [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff auth v354 ap=1 s=306 n(v0 rc2024-03-27T08:36:59.773798+0000 b306 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf72c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002be:[<0x10000000231/sysfs-driver-hid-logitech-lg4ff v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002be:[<0x10000000231/sysfs-driver-hid-logitech-lg4ff v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.060+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e6 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs auth v362 ap=1 s=1201 n(v0 rc2024-03-27T08:37:00.343211+0000 b1201 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf73180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e6:[<0x10000000231/sysfs-fs-xfs v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e6:[<0x10000000231/sysfs-fs-xfs v362>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.060+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm auth v350 ap=1 s=2282 n(v0 rc2024-03-27T08:36:59.533465+0000 b2282 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf72100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000029b:[<0x10000000231/sysfs-class-pwm v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000029b:[<0x10000000231/sysfs-class-pwm v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.060+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis auth v322 ap=1 s=422 n(v0 rc2024-03-27T08:36:58.721466+0000 b422 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023f:[<0x10000000231/configfs-usb-gadget-rndis v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023f:[<0x10000000231/configfs-usb-gadget-rndis v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.061+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000295 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh auth v346 ap=1 s=4514 n(v0 rc2024-03-27T08:36:59.482079+0000 b4514 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf73700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000295:[<0x10000000231/sysfs-class-net-mesh v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000295:[<0x10000000231/sysfs-class-net-mesh v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.061+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002dd [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi auth v360 ap=1 s=2062 n(v0 rc2024-03-27T08:37:00.281054+0000 b2062 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002dd:[<0x10000000231/sysfs-firmware-gsmi v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002dd:[<0x10000000231/sysfs-firmware-gsmi v360>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.061+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led auth v344 ap=1 s=1329 n(v0 rc2024-03-27T08:36:59.394218+0000 b1329 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000028b:[<0x10000000231/sysfs-class-led v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000028b:[<0x10000000231/sysfs-class-led v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.061+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000237 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs auth v316 ap=1 s=298 n(v0 rc2024-03-27T08:36:58.664946+0000 b298 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000237:[<0x10000000231/configfs-usb-gadget-ffs v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000237:[<0x10000000231/configfs-usb-gadget-ffs v316>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.061+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000280 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class auth v338 ap=1 s=532 n(v0 rc2024-03-27T08:36:59.298276+0000 b532 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000280:[<0x10000000231/sysfs-class v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000280:[<0x10000000231/sysfs-class v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.349 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.062+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg auth v324 ap=1 s=4208 n(v0 rc2024-03-27T08:36:58.831371+0000 b4208 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000024c:[<0x10000000231/dev-kmsg v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000024c:[<0x10000000231/dev-kmsg v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.062+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc auth v332 ap=1 s=1018 n(v0 rc2024-03-27T08:36:59.242554+0000 b1018 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027a:[<0x10000000231/sysfs-bus-umc v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027a:[<0x10000000231/sysfs-bus-umc v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.062+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg auth v336 ap=1 s=1539 n(v0 rc2024-03-27T08:36:59.263220+0000 b1539 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027c:[<0x10000000231/sysfs-bus-usb-devices-usbsevseg v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027c:[<0x10000000231/sysfs-bus-usb-devices-usbsevseg v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.062+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ed [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch auth v366 ap=1 s=1346 n(v0 rc2024-03-27T08:37:00.402154+0000 b1346 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ed:[<0x10000000231/sysfs-kernel-livepatch v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ed:[<0x10000000231/sysfs-kernel-livepatch v366>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.063+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb auth v334 ap=1 s=7078 n(v0 rc2024-03-27T08:36:59.252337+0000 b7078 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf9f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000027b:[<0x10000000231/sysfs-bus-usb v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000027b:[<0x10000000231/sysfs-bus-usb v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.063+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000253 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache auth v326 ap=1 s=5873 n(v0 rc2024-03-27T08:36:58.898621+0000 b5873 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000253:[<0x10000000231/sysfs-block-bcache v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000253:[<0x10000000231/sysfs-block-bcache v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.063+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi auth v358 ap=1 s=4235 n(v0 rc2024-03-27T08:37:00.244141+0000 b4235 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002d5:[<0x10000000231/sysfs-driver-toshiba_acpi v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002d5:[<0x10000000231/sysfs-driver-toshiba_acpi v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.063+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ae [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 auth v352 ap=1 s=580 n(v0 rc2024-03-27T08:36:59.687509+0000 b580 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ae:[<0x10000000231/sysfs-devices-power_resources_D0 v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ae:[<0x10000000231/sysfs-devices-power_resources_D0 v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.063+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet auth v320 ap=1 s=251 n(v0 rc2024-03-27T08:36:58.712445+0000 b251 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023e:[<0x10000000231/configfs-usb-gadget-phonet v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023e:[<0x10000000231/configfs-usb-gadget-phonet v320>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.064+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000296 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues auth v348 ap=1 s=2741 n(v0 rc2024-03-27T08:36:59.490380+0000 b2741 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000296:[<0x10000000231/sysfs-class-net-queues v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000296:[<0x10000000231/sysfs-class-net-queues v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.064+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000274 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci auth v328 ap=1 s=12538 n(v0 rc2024-03-27T08:36:59.189271+0000 b12538 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000274:[<0x10000000231/sysfs-bus-pci v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000274:[<0x10000000231/sysfs-bus-pci v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.350 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.064+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000304 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling auth v368 ap=1 s=337 n(v0 rc2024-03-27T08:37:00.611551+0000 b337 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000304:[<0x10000000231/sysfs-profiling v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000304:[<0x10000000231/sysfs-profiling v368>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.064+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000282 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 auth v340 ap=1 s=1286 n(v0 rc2024-03-27T08:36:59.315657+0000 b1286 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000282:[<0x10000000231/sysfs-class-backlight-driver-lm3533 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000282:[<0x10000000231/sysfs-class-backlight-driver-lm3533 v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.064+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f8 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi auth v354 ap=1 s=1142 n(v0 rc2024-03-27T08:37:00.499488+0000 b1142 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf56c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f8:[<0x10000000231/sysfs-platform-asus-wmi v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f8:[<0x10000000231/sysfs-platform-asus-wmi v354>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.065+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex auth v318 ap=1 s=273 n(v0 rc2024-03-27T08:36:58.704156+0000 b273 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eafa6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023d:[<0x10000000231/configfs-usb-gadget-obex v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023d:[<0x10000000231/configfs-usb-gadget-obex v318>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.065+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a0 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc auth v338 ap=1 s=5652 n(v0 rc2024-03-27T08:36:59.578719+0000 b5652 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf56100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002a0:[<0x10000000231/sysfs-class-uwb_rc v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002a0:[<0x10000000231/sysfs-class-uwb_rc v338>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.065+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe auth v332 ap=1 s=4609 n(v0 rc2024-03-27T08:36:59.038304+0000 b4609 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf56680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000263:[<0x10000000231/sysfs-bus-fcoe v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000263:[<0x10000000231/sysfs-bus-fcoe v332>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.065+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi auth v326 ap=1 s=365 n(v0 rc2024-03-27T08:36:58.689891+0000 b365 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf57180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023b:[<0x10000000231/configfs-usb-gadget-midi v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023b:[<0x10000000231/configfs-usb-gadget-midi v326>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000232 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget auth v322 ap=1 s=1258 n(v0 rc2024-03-27T08:36:58.643227+0000 b1258 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf57700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000232:[<0x10000000231/configfs-spear-pcie-gadget v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000232:[<0x10000000231/configfs-spear-pcie-gadget v322>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000271 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio auth v334 ap=1 s=1075 n(v0 rc2024-03-27T08:36:59.160400+0000 b1075 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf66580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000271:[<0x10000000231/sysfs-bus-mdio v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000271:[<0x10000000231/sysfs-bus-mdio v334>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002da [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi auth v344 ap=1 s=4071 n(v0 rc2024-03-27T08:37:00.265197+0000 b4071 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf67080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002da:[<0x10000000231/sysfs-firmware-dmi v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002da:[<0x10000000231/sysfs-firmware-dmi v344>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002dc [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map auth v346 ap=1 s=1268 n(v0 rc2024-03-27T08:37:00.274452+0000 b1268 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf66b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002dc:[<0x10000000231/sysfs-firmware-efi-runtime-map v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002dc:[<0x10000000231/sysfs-firmware-efi-runtime-map v346>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000240 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial auth v328 ap=1 s=273 n(v0 rc2024-03-27T08:36:58.729235+0000 b273 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf66000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000240:[<0x10000000231/configfs-usb-gadget-serial v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000240:[<0x10000000231/configfs-usb-gadget-serial v328>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.351 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.066+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ce [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek auth v342 ap=1 s=437 n(v0 rc2024-03-27T08:37:00.216273+0000 b437 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf67600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002ce:[<0x10000000231/sysfs-driver-input-axp-pek v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002ce:[<0x10000000231/sysfs-driver-input-axp-pek v342>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.067+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002de [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log auth v348 ap=1 s=223 n(v0 rc2024-03-27T08:37:00.286584+0000 b223 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf68680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002de:[<0x10000000231/sysfs-firmware-log v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002de:[<0x10000000231/sysfs-firmware-log v348>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.067+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x auth v330 ap=1 s=10279 n(v0 rc2024-03-27T08:36:58.971570+0000 b10279 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf67b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000025b:[<0x10000000231/sysfs-bus-coresight-devices-etm3x v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000025b:[<0x10000000231/sysfs-bus-coresight-devices-etm3x v330>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.067+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000294 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan auth v336 ap=1 s=1454 n(v0 rc2024-03-27T08:36:59.472815+0000 b1454 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf68100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000294:[<0x10000000231/sysfs-class-net-grcan v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000294:[<0x10000000231/sysfs-class-net-grcan v336>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.067+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f5 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module auth v352 ap=1 s=1711 n(v0 rc2024-03-27T08:37:00.473701+0000 b1711 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf70000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002f5:[<0x10000000231/sysfs-module v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002f5:[<0x10000000231/sysfs-module v352>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.068+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e1 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi auth v350 ap=1 s=466 n(v0 rc2024-03-27T08:37:00.303516+0000 b466 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf69180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002e1:[<0x10000000231/sysfs-firmware-sfi v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002e1:[<0x10000000231/sysfs-firmware-sfi v350>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.068+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000302 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power auth v356 ap=1 s=11382 n(v0 rc2024-03-27T08:37:00.587100+0000 b11382 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf70580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000302:[<0x10000000231/sysfs-power v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000302:[<0x10000000231/sysfs-power v356>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.068+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage auth v324 ap=1 s=1063 n(v0 rc2024-03-27T08:36:58.684423+0000 b1063 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf68c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000023a:[<0x10000000231/configfs-usb-gadget-mass-storage v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000023a:[<0x10000000231/configfs-usb-gadget-mass-storage v324>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.068+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b2 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup auth v340 ap=1 s=589 n(v0 rc2024-03-27T08:36:59.705899+0000 b589 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf69700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x100000002b2:[<0x10000000231/sysfs-devices-power_resources_wakeup v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x100000002b2:[<0x10000000231/sysfs-devices-power_resources_wakeup v340>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.069+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000303 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps auth v358 ap=1 s=2192 n(v0 rc2024-03-27T08:37:00.600464+0000 b2192 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf70b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000303:[<0x10000000231/sysfs-pps v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000303:[<0x10000000231/sysfs-pps v358>,<0x10000000205/testing v1034>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.352 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.069+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra auth v24 ap=1 s=3767 n(v0 rc2024-03-27T08:36:58.461574+0000 b3767 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020d:[<0x10000000207/sysfs-driver-hid-roccat-pyra v24>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000020d:[<0x10000000207/sysfs-driver-hid-roccat-pyra v24>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.069+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill auth v18 ap=1 s=1063 n(v0 rc2024-03-27T08:36:58.445167+0000 b1063 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020a:[<0x10000000207/sysfs-class-rfkill v18>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000020a:[<0x10000000207/sysfs-class-rfkill v18>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.069+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000208 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads auth v14 ap=1 s=248 n(v0 rc2024-03-27T08:36:58.432967+0000 b248 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000208:[<0x10000000207/proc-sys-vm-nr_pdflush_threads v14>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000208:[<0x10000000207/proc-sys-vm-nr_pdflush_threads v14>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.069+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus auth v22 ap=1 s=3657 n(v0 rc2024-03-27T08:36:58.455932+0000 b3657 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020c:[<0x10000000207/sysfs-driver-hid-roccat-kovaplus v22>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000020c:[<0x10000000207/sysfs-driver-hid-roccat-kovaplus v22>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.070+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000222 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc auth v76 ap=1 s=2448 n(v0 rc2024-03-27T08:36:58.574222+0000 b2448 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000222:[<0x10000000216/sysfs-class-udc v76>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000222:[<0x10000000216/sysfs-class-udc v76>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.070+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000209 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb auth v16 ap=1 s=1296 n(v0 rc2024-03-27T08:36:58.438766+0000 b1296 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000209:[<0x10000000207/sysfs-bus-usb v16>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000209:[<0x10000000207/sysfs-bus-usb v16>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.070+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus auth v20 ap=1 s=2820 n(v0 rc2024-03-27T08:36:58.449554+0000 b2820 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020b:[<0x10000000207/sysfs-driver-hid-roccat-koneplus v20>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000020b:[<0x10000000207/sysfs-driver-hid-roccat-koneplus v20>,<0x10000000205/obsolete v534>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.070+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight auth v68 ap=1 s=1914 n(v0 rc2024-03-27T08:36:58.551265+0000 b1914 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021e:[<0x10000000216/sysfs-class-backlight v68>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021e:[<0x10000000216/sysfs-class-backlight v68>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.070+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile auth v60 ap=1 s=675 n(v0 rc2024-03-27T08:36:58.528985+0000 b675 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021a:[<0x10000000216/sysfs-acpi-pmprofile v60>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021a:[<0x10000000216/sysfs-acpi-pmprofile v60>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.071+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000220 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm auth v72 ap=1 s=6913 n(v0 rc2024-03-27T08:36:58.564086+0000 b6913 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000220:[<0x10000000216/sysfs-class-tpm v72>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000220:[<0x10000000216/sysfs-class-tpm v72>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.071+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend auth v66 ap=1 s=2532 n(v0 rc2024-03-27T08:36:58.544893+0000 b2532 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021d:[<0x10000000216/sysfs-bus-xen-backend v66>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021d:[<0x10000000216/sysfs-bus-xen-backend v66>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.071+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 auth v90 ap=1 s=648 n(v0 rc2024-03-27T08:36:58.607313+0000 b648 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000229:[<0x10000000216/sysfs-driver-w1_ds28e04 v90>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000229:[<0x10000000216/sysfs-driver-w1_ds28e04 v90>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.353 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.071+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000227 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx auth v86 ap=1 s=377 n(v0 rc2024-03-27T08:36:58.598111+0000 b377 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000227:[<0x10000000216/sysfs-driver-qla2xxx v86>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000227:[<0x10000000216/sysfs-driver-qla2xxx v86>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.072+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog auth v96 ap=1 s=2207 n(v0 rc2024-03-27T08:36:58.619478+0000 b2207 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb3180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022c:[<0x10000000216/sysfs-firmware-opal-elog v96>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022c:[<0x10000000216/sysfs-firmware-opal-elog v96>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.072+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory auth v82 ap=1 s=2656 n(v0 rc2024-03-27T08:36:58.587983+0000 b2656 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf48000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000225:[<0x10000000216/sysfs-devices-system-xen_memory v82>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000225:[<0x10000000216/sysfs-devices-system-xen_memory v82>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.072+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire auth v62 ap=1 s=4285 n(v0 rc2024-03-27T08:36:58.534237+0000 b4285 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eadb3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021b:[<0x10000000216/sysfs-bus-firewire v62>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021b:[<0x10000000216/sysfs-bus-firewire v62>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000217 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev auth v54 ap=1 s=4140 n(v0 rc2024-03-27T08:36:58.511257+0000 b4140 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000217:[<0x10000000216/firewire-cdev v54>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000217:[<0x10000000216/firewire-cdev v54>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification auth v102 ap=1 s=190 n(v0 rc2024-03-27T08:36:58.631920+0000 b190 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022f:[<0x10000000216/thermal-notification v102>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022f:[<0x10000000216/thermal-notification v102>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000230 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso auth v104 ap=1 s=1329 n(v0 rc2024-03-27T08:36:58.635646+0000 b1329 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000230:[<0x10000000216/vdso v104>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000230:[<0x10000000216/vdso v104>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000224 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu auth v80 ap=1 s=979 n(v0 rc2024-03-27T08:36:58.583634+0000 b979 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000224:[<0x10000000216/sysfs-devices-system-cpu v80>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000224:[<0x10000000216/sysfs-devices-system-cpu v80>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill auth v70 ap=1 s=1979 n(v0 rc2024-03-27T08:36:58.557827+0000 b1979 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021f:[<0x10000000216/sysfs-class-rfkill v70>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021f:[<0x10000000216/sysfs-class-rfkill v70>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.073+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000226 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp auth v84 ap=1 s=7796 n(v0 rc2024-03-27T08:36:58.593536+0000 b7796 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000226:[<0x10000000216/sysfs-driver-ib_srp v84>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000226:[<0x10000000216/sysfs-driver-ib_srp v84>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.074+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000228 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc auth v88 ap=1 s=2407 n(v0 rc2024-03-27T08:36:58.602753+0000 b2407 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000228:[<0x10000000216/sysfs-driver-usb-usbtmc v88>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000228:[<0x10000000216/sysfs-driver-usb-usbtmc v88>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.074+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000221 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi auth v74 ap=1 s=6956 n(v0 rc2024-03-27T08:36:58.569966+0000 b6956 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf4b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000221:[<0x10000000216/sysfs-class-ubi v74>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000221:[<0x10000000216/sysfs-class-ubi v74>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.354 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.074+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022a [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars auth v92 ap=1 s=2441 n(v0 rc2024-03-27T08:36:58.610878+0000 b2441 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022a:[<0x10000000216/sysfs-firmware-efi-vars v92>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022a:[<0x10000000216/sysfs-firmware-efi-vars v92>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.074+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000223 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node auth v78 ap=1 s=3010 n(v0 rc2024-03-27T08:36:58.578699+0000 b3010 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000223:[<0x10000000216/sysfs-devices-node v78>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000223:[<0x10000000216/sysfs-devices-node v78>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.074+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021c [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb auth v64 ap=1 s=5051 n(v0 rc2024-03-27T08:36:58.540048+0000 b5051 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf54000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000021c:[<0x10000000216/sysfs-bus-usb v64>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000021c:[<0x10000000216/sysfs-bus-usb v64>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.075+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022e [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp auth v100 ap=1 s=2538 n(v0 rc2024-03-27T08:36:58.628581+0000 b2538 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf54b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022e:[<0x10000000216/sysfs-transport-srp v100>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022e:[<0x10000000216/sysfs-transport-srp v100>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.075+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000219 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls auth v58 ap=1 s=442 n(v0 rc2024-03-27T08:36:58.523895+0000 b442 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf54580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000219:[<0x10000000216/syscalls v58>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000219:[<0x10000000216/syscalls v58>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.075+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000218 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb auth v56 ap=1 s=457 n(v0 rc2024-03-27T08:36:58.517807+0000 b457 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf55080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000218:[<0x10000000216/o2cb v56>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000218:[<0x10000000216/o2cb v56>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.075+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022d [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module auth v98 ap=1 s=1331 n(v0 rc2024-03-27T08:36:58.624319+0000 b1331 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf55600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022d:[<0x10000000216/sysfs-module v98>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022d:[<0x10000000216/sysfs-module v98>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.075+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022b [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump auth v94 ap=1 s=1490 n(v0 rc2024-03-27T08:36:58.615281+0000 b1490 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eaf55b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000022b:[<0x10000000216/sysfs-firmware-opal-dump v94>,<0x10000000205/stable v604>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000022b:[<0x10000000216/sysfs-firmware-opal-dump v94>,<0x10000000205/stable v604>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.076+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000214 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394 auth v26 ap=1 s=663 n(v0 rc2024-03-27T08:36:58.492809+0000 b663 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb352680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000214:[<0x1000000020e/raw1394 v26>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000214:[<0x1000000020e/raw1394 v26>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.076+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000210 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394 auth v18 ap=1 s=664 n(v0 rc2024-03-27T08:36:58.476084+0000 b664 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb352c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000210:[<0x1000000020e/dv1394 v18>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000210:[<0x1000000020e/dv1394 v18>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.355 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.076+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000020f [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs auth v16 ap=1 s=471 n(v0 rc2024-03-27T08:36:58.471029+0000 b471 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb353180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x1000000020f:[<0x1000000020e/devfs v16>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x1000000020f:[<0x1000000020e/devfs v16>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.356 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.076+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000211 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue auth v20 ap=1 s=310 n(v0 rc2024-03-27T08:36:58.481297+0000 b310 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb353700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000211:[<0x1000000020e/ip_queue v20>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000211:[<0x1000000020e/ip_queue v20>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.356 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.076+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000212 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma auth v22 ap=1 s=339 n(v0 rc2024-03-27T08:36:58.485233+0000 b339 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000212:[<0x1000000020e/net_dma v22>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000212:[<0x1000000020e/net_dma v22>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.356 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.077+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000215 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394 auth v28 ap=1 s=751 n(v0 rc2024-03-27T08:36:58.498442+0000 b751 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000215:[<0x1000000020e/video1394 v28>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000215:[<0x1000000020e/video1394 v28>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.356 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:37:34.077+0000 7f3713c00700 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000213 [2,head] /volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb auth v24 ap=1 s=449 n(v0 rc2024-03-27T08:36:58.488876+0000 b449 1=1+0) caps={15285=pAsLsXsFsc/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x55a2eb35ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(3)0x10000000213:[<0x1000000020e/o2cb v24>,<0x10000000205/removed v550>,<0x10000000203/ABI v556>,<0x10000000202/Documentation v172>,<0x10000000201/linux-4.0.5 v16>,<0x10000000006/untar_tar v34>,<0x10000000005/tmp v35>,<0x10000000003/client.0 v31>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v46>,<0x10000000001/sv_0 v69>,<0x10000000000/qa v57>,<0x1/volumes v55>]//[]","memoryvalue":"(3)0x10000000213:[<0x1000000020e/o2cb v24>,<0x10000000205/removed v550>,<0x10000000203/ABI v681>,<0x10000000202/Documentation v564>,<0x10000000201/linux-4.0.5 v48>,<0x10000000006/untar_tar v66>,<0x10000000005/tmp v67>,<0x10000000003/client.0 v49>,<0x10000000002/2307b18f-bec2-4dc2-a83d-85672cd4f253 v50>,<0x10000000001/sv_0 v89>,<0x10000000000/qa v25>,<0x1/volumes v23>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-03-27T08:37:34.384 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-03-27T08:37:34.391 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-03-27T08:37:34.402 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-03-27T08:37:34.412 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-03-27T08:37:34.421 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/target/ 2024-03-27T08:37:34.426 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-03-27T08:37:34.437 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-03-27T08:37:34.445 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-03-27T08:37:34.454 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/ 2024-03-27T08:37:34.462 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-03-27T08:37:34.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-03-27T08:37:34.478 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-03-27T08:37:34.485 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-03-27T08:37:34.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-03-27T08:37:34.501 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-03-27T08:37:34.511 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-03-27T08:37:34.518 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-03-27T08:37:34.529 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/ 2024-03-27T08:37:34.535 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-03-27T08:37:34.542 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-03-27T08:37:34.550 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-03-27T08:37:34.557 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-03-27T08:37:34.565 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-03-27T08:37:34.573 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-03-27T08:37:34.580 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-03-27T08:37:34.588 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-03-27T08:37:34.596 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-03-27T08:37:34.608 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-03-27T08:37:34.618 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-03-27T08:37:34.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/tpm/ 2024-03-27T08:37:34.630 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-03-27T08:37:34.638 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/ 2024-03-27T08:37:34.647 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-03-27T08:37:34.655 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-03-27T08:37:34.664 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-03-27T08:37:34.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-03-27T08:37:34.677 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-03-27T08:37:34.685 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-03-27T08:37:34.696 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-03-27T08:37:34.710 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-03-27T08:37:34.717 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-03-27T08:37:34.722 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-03-27T08:37:34.727 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-03-27T08:37:34.732 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-03-27T08:37:34.738 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-03-27T08:37:34.744 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-03-27T08:37:34.751 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-03-27T08:37:34.759 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-03-27T08:37:34.765 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-03-27T08:37:34.773 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-03-27T08:37:34.783 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/unicode.txt 2024-03-27T08:37:34.790 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/unshare.txt 2024-03-27T08:37:34.797 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/ 2024-03-27T08:37:34.801 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-03-27T08:37:34.810 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-03-27T08:37:34.818 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-03-27T08:37:34.827 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-03-27T08:37:34.837 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-03-27T08:37:34.844 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-03-27T08:37:34.851 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-03-27T08:37:34.859 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-03-27T08:37:34.866 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-03-27T08:37:34.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-03-27T08:37:34.884 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-03-27T08:37:34.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-03-27T08:37:34.901 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-03-27T08:37:34.908 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-03-27T08:37:34.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-03-27T08:37:34.930 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-03-27T08:37:34.937 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-03-27T08:37:34.949 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-03-27T08:37:34.958 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-03-27T08:37:34.966 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-03-27T08:37:34.974 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-03-27T08:37:34.983 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-03-27T08:37:34.989 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-03-27T08:37:34.996 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-03-27T08:37:35.004 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-03-27T08:37:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: pgmap v508: 97 pgs: 97 active+clean; 98 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 779 KiB/s wr, 138 op/s 2024-03-27T08:37:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:37:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.007 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.011 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.011 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.011 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.011 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.012 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.013 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.014 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.015 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.016 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.017 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.018 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.019 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.019 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.019 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.019 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.020 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.021 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.022 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-03-27T08:37:35.024 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.024 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:35.024 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.025 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.026 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.027 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.028 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.029 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.030 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.031 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.032 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.033 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: active paths [/] 2024-03-27T08:37:35.034 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000255 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.035 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.036 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.037 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.037 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.037 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000257 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000247 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.039 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000292 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000301 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.040 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.041 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.042 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.043 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.044 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.045 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.046 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.047 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.048 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000299 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000293 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.049 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000254 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000241 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.050 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.051 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000029b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.052 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-03-27T08:37:35.053 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.053 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000295 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.053 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.053 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000028b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.053 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000237 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000253 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000296 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.054 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.055 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.056 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.057 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.058 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.059 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:34 smithi164 ceph-mon[31788]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.059 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-03-27T08:37:35.060 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-03-27T08:37:35.061 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-03-27T08:37:35.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: pgmap v508: 97 pgs: 97 active+clean; 98 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 779 KiB/s wr, 138 op/s 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.073 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.074 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.075 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.076 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.077 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.078 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.079 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.080 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.081 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.083 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.084 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.085 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-03-27T08:37:35.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.092 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.093 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.094 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: active paths [/] 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000255 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.095 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.096 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000257 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.097 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000247 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000292 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000301 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.098 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.099 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.100 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.101 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.102 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.103 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.104 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000299 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000293 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.105 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000254 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.106 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000241 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.107 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000029b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000295 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000028b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000237 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.108 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000253 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000296 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.109 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.110 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.111 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.112 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.113 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.114 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.114 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.114 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:34 smithi167 ceph-mon[34903]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: pgmap v508: 97 pgs: 97 active+clean; 98 MiB data, 719 MiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 779 KiB/s wr, 138 op/s 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.116 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.117 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.118 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.119 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.120 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.121 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.122 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.123 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.124 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.125 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.126 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.127 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.128 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.129 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.130 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.131 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.132 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.133 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.134 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: active paths [/] 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000231 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000255 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000233 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000206 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000216 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.135 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002af (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000207 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000265 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000269 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.136 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ec (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000275 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000288 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000257 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ab (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000276 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.137 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000247 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002bc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ff (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000292 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000301 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.138 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.139 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.140 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.141 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002db (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.142 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.143 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002df (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.144 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.145 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000299 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000293 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002cb (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000284 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000285 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ef (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002cd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000254 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000266 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002fa (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.146 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000241 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000238 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000243 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000236 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000268 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000026e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.147 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000264 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000258 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000242 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000278 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000286 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002c8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e9 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002be (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e6 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000029b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000295 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002dd (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.148 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000028b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000237 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000280 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000024c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ed (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000027b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000253 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002d5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ae (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000296 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000274 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.149 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000304 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000282 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.150 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002da (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002de (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.151 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000208 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000209 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.152 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.153 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.154 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000214 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000210 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x1000000020f (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000211 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000212 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000215 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: Scrub error on inode 0x10000000213 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb) see mds.h log and `damage ls` output for details 2024-03-27T08:37:35.155 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:34 smithi173 ceph-mon[35397]: scrub summary: idle+waiting paths [/] 2024-03-27T08:37:35.155 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-03-27T08:37:35.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-03-27T08:37:35.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-03-27T08:37:35.156 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/ 2024-03-27T08:37:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-03-27T08:37:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-03-27T08:37:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-03-27T08:37:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-03-27T08:37:35.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-03-27T08:37:35.160 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vfio.txt 2024-03-27T08:37:35.170 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-03-27T08:37:35.177 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video-output.txt 2024-03-27T08:37:35.186 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/ 2024-03-27T08:37:35.192 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-03-27T08:37:35.199 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-03-27T08:37:35.206 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-03-27T08:37:35.215 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-03-27T08:37:35.226 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-03-27T08:37:35.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-03-27T08:37:35.244 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-03-27T08:37:35.256 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-03-27T08:37:35.263 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-03-27T08:37:35.273 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-03-27T08:37:35.280 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-03-27T08:37:35.289 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-03-27T08:37:35.297 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-03-27T08:37:35.304 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-03-27T08:37:35.312 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-03-27T08:37:35.327 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-03-27T08:37:35.379 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-03-27T08:37:35.387 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-03-27T08:37:35.395 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-03-27T08:37:35.404 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-03-27T08:37:35.414 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-03-27T08:37:35.422 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-03-27T08:37:35.433 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-03-27T08:37:35.439 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-03-27T08:37:35.450 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-03-27T08:37:35.461 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-03-27T08:37:35.470 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-03-27T08:37:35.481 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-03-27T08:37:35.489 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-03-27T08:37:35.498 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-03-27T08:37:35.506 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-03-27T08:37:35.516 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-03-27T08:37:35.526 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-03-27T08:37:35.535 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-03-27T08:37:35.544 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-03-27T08:37:35.551 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-03-27T08:37:35.561 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-03-27T08:37:35.569 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-03-27T08:37:35.577 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-03-27T08:37:35.586 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-03-27T08:37:35.596 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-03-27T08:37:35.604 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-03-27T08:37:35.610 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-03-27T08:37:35.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-03-27T08:37:35.625 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-03-27T08:37:35.635 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-03-27T08:37:35.642 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-03-27T08:37:35.652 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-03-27T08:37:35.666 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-03-27T08:37:35.673 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-03-27T08:37:35.685 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-03-27T08:37:35.691 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-03-27T08:37:35.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-03-27T08:37:35.787 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-03-27T08:37:35.798 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-03-27T08:37:35.807 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-03-27T08:37:35.831 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-03-27T08:37:35.843 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-03-27T08:37:35.853 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-03-27T08:37:35.867 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-03-27T08:37:35.883 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-03-27T08:37:35.892 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-03-27T08:37:35.905 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-03-27T08:37:35.916 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-03-27T08:37:35.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-03-27T08:37:35.936 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-03-27T08:37:35.943 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-03-27T08:37:35.956 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-03-27T08:37:35.965 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-03-27T08:37:35.971 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-03-27T08:37:35.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-03-27T08:37:35.985 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-03-27T08:37:35.990 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-03-27T08:37:35.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-03-27T08:37:36.001 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-03-27T08:37:36.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:35 smithi164 ceph-mon[31788]: pgmap v509: 97 pgs: 97 active+clean; 104 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-03-27T08:37:36.007 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-03-27T08:37:36.013 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-03-27T08:37:36.020 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-03-27T08:37:36.024 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/ 2024-03-27T08:37:36.049 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-03-27T08:37:36.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-03-27T08:37:36.058 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-03-27T08:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.070+0000 7f5232000640 1 -- 172.21.15.164:0/936556023 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f7d07425a0 con 0x55f7d0851c20 2024-03-27T08:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.070+0000 7f5232000640 10 client.35723 handle_command_reply: tid=0 2024-03-27T08:37:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.070+0000 7f5251df6740 1 client.35723 shutdown 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.070+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 msgr2=0x55f7d07e4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.070+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52380bdb60 tx=0x7f5238004f90 comp rx=0 tx=0).stop 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 shutdown_connections 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f7d0851c20 0x55f7d0854040 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f7d07db4e0 0x55f7d084fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f7d07d6370 0x55f7d07e46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 --2- 172.21.15.164:0/936556023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f7d07d5980 0x55f7d07e4180 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 >> 172.21.15.164:0/936556023 conn(0x55f7d07d0ef0 msgr2=0x55f7d07d12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5232000640 0 client.35723 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:36.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f3f19600640 1 -- 172.21.15.164:0/3543138503 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55b579136bf0 con 0x55b5791d9de0 2024-03-27T08:37:36.066 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f3f19600640 10 client.16053 handle_command_reply: tid=0 2024-03-27T08:37:36.067 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f3f39792740 1 client.16053 shutdown 2024-03-27T08:37:36.067 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-03-27T08:37:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 shutdown_connections 2024-03-27T08:37:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 1 -- 172.21.15.164:0/936556023 wait complete. 2024-03-27T08:37:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f5251df6740 20 client.35723 trim_cache size 0 max 16384 2024-03-27T08:37:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 msgr2=0x55b5791d54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.071+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0f65a0 tx=0x7f3f1c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 shutdown_connections 2024-03-27T08:37:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b5791d9de0 0x55b5791dc200 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.068 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791d54b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f19600640 0 client.16053 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 --2- 172.21.15.164:0/3543138503 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.069 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 >> 172.21.15.164:0/3543138503 conn(0x55b5791bea20 msgr2=0x55b5791bdc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:37:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:37:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:37:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:37:36.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 shutdown_connections 2024-03-27T08:37:36.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 1 -- 172.21.15.164:0/3543138503 wait complete. 2024-03-27T08:37:36.070 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.072+0000 7f3f39792740 20 client.16053 trim_cache size 0 max 16384 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 msgr2=0x7f522c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 0x7f522c0a5bf0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f524000d5e0 tx=0x7f524000d040 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 msgr2=0x7f5248195b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f523802c880 tx=0x7f5238004e20 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 shutdown_connections 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f522c0a3730 0x7f522c0a5bf0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5248103730 0x7f524819d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5248102d70 0x7f52481960d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 --2- 172.21.15.164:0/847587384 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5248101b80 0x7f5248195b90 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 >> 172.21.15.164:0/847587384 conn(0x7f52480fd110 msgr2=0x7f5248106010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 shutdown_connections 2024-03-27T08:37:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:36.073+0000 7f524f000640 1 -- 172.21.15.164:0/847587384 wait complete. 2024-03-27T08:37:36.072 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:35 smithi167 ceph-mon[34903]: pgmap v509: 97 pgs: 97 active+clean; 104 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-03-27T08:37:36.072 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-03-27T08:37:36.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:35 smithi173 ceph-mon[35397]: pgmap v509: 97 pgs: 97 active+clean; 104 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 471 KiB/s rd, 1.2 MiB/s wr, 153 op/s 2024-03-27T08:37:36.077 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-03-27T08:37:36.080 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-03-27T08:37:36.085 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.097+0000 7f3f39792740 1 Processor -- start 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 -- start start 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791d30c0 0x55b5791bd390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301b1f70 con 0x55b5791c3ea0 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301af840 con 0x55b5791d30c0 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f39792740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301ad690 con 0x55b5791c34b0 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f2f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f34a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791d30c0 0x55b5791bd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.090 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f2f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53240/0 (socket says 172.21.15.164:53240) 2024-03-27T08:37:36.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.098+0000 7f3f2f400640 1 -- 172.21.15.164:0/254522800 learned_addr learned my addr 172.21.15.164:0/254522800 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:36.091 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 -- 172.21.15.164:0/254522800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 msgr2=0x55b5791cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 -- 172.21.15.164:0/254522800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791d30c0 msgr2=0x55b5791bd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791d30c0 0x55b5791bd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 -- 172.21.15.164:0/254522800 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b5791d6930 con 0x55b5791c3ea0 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f2f400640 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0f65f0 tx=0x7f3f1c004560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c956d802a3a7173c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f1be00640 1 -- 172.21.15.164:0/254522800 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0c4950 con 0x55b5791c3ea0 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.099+0000 7f3f1be00640 1 -- 172.21.15.164:0/254522800 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f1c07a1d0 con 0x55b5791c3ea0 2024-03-27T08:37:36.092 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.100+0000 7f3f1be00640 1 -- 172.21.15.164:0/254522800 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0c4ff0 con 0x55b5791c3ea0 2024-03-27T08:37:36.093 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.100+0000 7f3f39792740 1 -- 172.21.15.164:0/254522800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 msgr2=0x55b5791ce090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.100+0000 7f3f39792740 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0f65f0 tx=0x7f3f1c004560 comp rx=0 tx=0).stop 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 -- 172.21.15.164:0/254522800 shutdown_connections 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791d30c0 0x55b5791bd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791c3ea0 0x55b5791ce090 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 --2- 172.21.15.164:0/254522800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 -- 172.21.15.164:0/254522800 >> 172.21.15.164:0/254522800 conn(0x55b5791bea20 msgr2=0x55b5791c5580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 -- 172.21.15.164:0/254522800 shutdown_connections 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 -- 172.21.15.164:0/254522800 wait complete. 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.101+0000 7f3f39792740 1 -- start start 2024-03-27T08:37:36.096 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 Processor -- start 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791eceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791eb4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301add00 con 0x55b5791d30c0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301af170 con 0x55b5791c3ea0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3f301ae3d0 con 0x55b5791c34b0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f39792740 10 client.0 _ll_register_callbacks cb 0x7f3f1c0c1200 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f34a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f2f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791eb4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f34a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:53252/0 (socket says 172.21.15.164:53252) 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f34a00640 1 -- 172.21.15.164:0/3841357253 learned_addr learned my addr 172.21.15.164:0/3841357253 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:36.097 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.102+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791eceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 -- 172.21.15.164:0/3841357253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 msgr2=0x55b5791eceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791eceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 -- 172.21.15.164:0/3841357253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 msgr2=0x55b5791eba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 -- 172.21.15.164:0/3841357253 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b5791ebf40 con 0x55b5791c3ea0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f34a00640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f2f400640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791eb4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0c18e0 tx=0x7f3f1c009620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e11f0503f29bdcd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f19600640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f1c0c4950 con 0x55b5791c3ea0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3f1c0cd7d0 con 0x55b5791c3ea0 2024-03-27T08:37:36.098 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.103+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3f1c07a1d0 con 0x55b5791c3ea0 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f3f1c0c93a0 con 0x55b5791c3ea0 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 10 client.35741 fetch_fsmap learned FSMap version 27 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55b5791ebf40 con 0x55b5791c3ea0 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f1c07a1d0 con 0x55b5791c3ea0 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8350+0+0 (secure 0 0 0) 0x7f3f1c0e5110 con 0x55b5791c3ea0 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 10 client.35741 fetch_fsmap finished waiting for FSMap version 27 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 10 client.35741 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:36.099 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 20 client.35741 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:36.099 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b579240db0 0x55b5792431d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 4 client.35741 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.104+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b5791cd940 con 0x55b579240db0 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.105+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b579240db0 0x55b5792431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.105+0000 7f3f2fe00640 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b579240db0 0x55b5792431d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87c0a3a6d16fd86b server_cookie=5fee1e77946d9fb0 in_seq=0 out_seq=0 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.105+0000 7f3f19600640 10 client.35741 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f19600640 1 -- 172.21.15.164:0/3841357253 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b5791cd940 con 0x55b579240db0 2024-03-27T08:37:36.101 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f19600640 10 client.35741 handle_command_reply: tid=0 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 client.35741 shutdown 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 msgr2=0x55b5791eb4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791eb4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0c18e0 tx=0x7f3f1c009620 comp rx=0 tx=0).stop 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 shutdown_connections 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55b579240db0 0x55b5792431d0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55b5791d30c0 0x55b5791eba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b5791c3ea0 0x55b5791eb4c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 --2- 172.21.15.164:0/3841357253 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55b5791c34b0 0x55b5791eceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f19600640 0 client.35741 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 >> 172.21.15.164:0/3841357253 conn(0x55b5791bea20 msgr2=0x55b5791cdaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.102 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 shutdown_connections 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 1 -- 172.21.15.164:0/3841357253 wait complete. 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.106+0000 7f3f39792740 20 client.35741 trim_cache size 0 max 16384 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "IDLE (waiting for more scrubs)", 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": { 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "39b84006-77a4-4d52-b8d8-278a9fae3e45": { 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/", 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "tag": "39b84006-77a4-4d52-b8d8-278a9fae3e45", 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: "options": "recursive,force" 2024-03-27T08:37:36.103 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:37:36.104 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:37:36.104 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:37:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 msgr2=0x7f3f140a5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 0x7f3f140a5a60 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f3f28008da0 tx=0x7f3f2800d710 comp rx=0 tx=0).stop 2024-03-27T08:37:36.104 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 msgr2=0x7f3f3019ea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 0x7f3f3019ea70 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c036040 tx=0x7f3f1c004e20 comp rx=0 tx=0).stop 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 shutdown_connections 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3f140a35a0 0x7f3f140a5a60 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3f300780f0 0x7f3f301a5ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f30077750 0x7f3f3019ea70 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 --2- 172.21.15.164:0/2477476514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3f30076510 0x7f3f3019e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.107+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 >> 172.21.15.164:0/2477476514 conn(0x7f3f300ff300 msgr2=0x7f3f30100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.108+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 shutdown_connections 2024-03-27T08:37:36.105 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:37:36.108+0000 7f3f36a00640 1 -- 172.21.15.164:0/2477476514 wait complete. 2024-03-27T08:37:36.106 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-03-27T08:37:36.106 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-03-27T08:37:36.108 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-03-27T08:37:36.112 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-03-27T08:37:36.117 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-03-27T08:37:36.119 INFO:tasks.cephfs.filesystem:scrub status for tag:39b84006-77a4-4d52-b8d8-278a9fae3e45 - {'path': '/', 'tag': '39b84006-77a4-4d52-b8d8-278a9fae3e45', 'options': 'recursive,force'} 2024-03-27T08:37:36.122 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-03-27T08:37:36.129 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-03-27T08:37:36.134 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-03-27T08:37:36.139 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-03-27T08:37:36.145 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-03-27T08:37:36.151 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-03-27T08:37:36.157 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-03-27T08:37:36.165 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-03-27T08:37:36.174 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-03-27T08:37:36.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-03-27T08:37:36.200 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/ 2024-03-27T08:37:36.210 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-03-27T08:37:36.217 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-03-27T08:37:36.224 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-03-27T08:37:36.234 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/balance 2024-03-27T08:37:36.239 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-03-27T08:37:36.250 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-03-27T08:37:36.258 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-03-27T08:37:36.267 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-03-27T08:37:36.277 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-03-27T08:37:36.285 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-03-27T08:37:36.295 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/numa 2024-03-27T08:37:36.303 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-03-27T08:37:36.313 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-03-27T08:37:36.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-03-27T08:37:36.479 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-03-27T08:37:36.487 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-03-27T08:37:36.493 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-03-27T08:37:36.501 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-03-27T08:37:36.510 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-03-27T08:37:36.519 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-03-27T08:37:36.527 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-03-27T08:37:36.538 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-03-27T08:37:36.550 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-03-27T08:37:36.556 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-03-27T08:37:36.567 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-03-27T08:37:36.576 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/ 2024-03-27T08:37:36.581 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-03-27T08:37:36.590 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-03-27T08:37:36.597 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-03-27T08:37:36.606 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-03-27T08:37:36.615 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-03-27T08:37:36.623 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-03-27T08:37:36.632 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-03-27T08:37:36.643 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-03-27T08:37:36.653 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-03-27T08:37:36.662 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-03-27T08:37:36.670 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-03-27T08:37:36.678 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-03-27T08:37:36.688 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-03-27T08:37:36.697 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-03-27T08:37:36.707 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-03-27T08:37:36.719 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-03-27T08:37:36.729 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/ 2024-03-27T08:37:36.736 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-03-27T08:37:36.749 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-03-27T08:37:36.758 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-03-27T08:37:36.767 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-03-27T08:37:36.777 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-03-27T08:37:36.782 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-03-27T08:37:36.790 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-03-27T08:37:36.798 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-03-27T08:37:36.805 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-03-27T08:37:36.813 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-03-27T08:37:36.823 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-03-27T08:37:36.831 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-03-27T08:37:36.840 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-03-27T08:37:36.847 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/wimax/ 2024-03-27T08:37:36.854 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-03-27T08:37:36.864 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-03-27T08:37:36.873 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-03-27T08:37:36.885 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/ 2024-03-27T08:37:36.893 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-03-27T08:37:36.902 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-03-27T08:37:36.915 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-03-27T08:37:36.924 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-03-27T08:37:36.931 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-03-27T08:37:36.941 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-03-27T08:37:36.949 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-03-27T08:37:36.955 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-03-27T08:37:36.963 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-03-27T08:37:36.976 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-03-27T08:37:36.986 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-03-27T08:37:36.995 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-03-27T08:37:37.003 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-03-27T08:37:37.012 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-03-27T08:37:37.020 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-03-27T08:37:37.030 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-03-27T08:37:37.038 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-03-27T08:37:37.050 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-03-27T08:37:37.055 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-03-27T08:37:37.065 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-03-27T08:37:37.072 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-03-27T08:37:37.079 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-03-27T08:37:37.087 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-03-27T08:37:37.098 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-03-27T08:37:37.110 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/xtensa/ 2024-03-27T08:37:37.115 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-03-27T08:37:37.124 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-03-27T08:37:37.132 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/xz.txt 2024-03-27T08:37:37.140 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-03-27T08:37:37.147 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-03-27T08:37:37.159 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-03-27T08:37:37.171 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-03-27T08:37:37.178 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-03-27T08:37:37.185 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-03-27T08:37:37.193 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-03-27T08:37:37.202 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-03-27T08:37:37.207 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-03-27T08:37:37.217 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-03-27T08:37:37.227 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-03-27T08:37:37.236 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-03-27T08:37:37.245 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-03-27T08:37:37.254 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-03-27T08:37:37.262 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-03-27T08:37:37.272 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-03-27T08:37:37.280 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-03-27T08:37:37.286 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-03-27T08:37:37.297 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-03-27T08:37:37.313 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-03-27T08:37:37.323 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-03-27T08:37:37.332 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-03-27T08:37:37.340 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-03-27T08:37:37.433 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-03-27T08:37:37.442 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-03-27T08:37:37.449 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-03-27T08:37:37.455 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-03-27T08:37:37.465 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-03-27T08:37:37.477 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-03-27T08:37:37.488 INFO:tasks.workunit.client.0.smithi164.stdout:linux-4.0.5/Documentation/zorro.txt 2024-03-27T08:37:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:37:38.481+0000 7fdaf9800700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T08:37:38.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:38 smithi164 ceph-mon[31788]: pgmap v510: 97 pgs: 97 active+clean; 106 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-03-27T08:37:38.769 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:38 smithi167 ceph-mon[34903]: pgmap v510: 97 pgs: 97 active+clean; 106 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-03-27T08:37:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:38 smithi173 ceph-mon[35397]: pgmap v510: 97 pgs: 97 active+clean; 106 MiB data, 738 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 1.3 MiB/s wr, 200 op/s 2024-03-27T08:37:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:39 smithi164 ceph-mon[31788]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T08:37:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:39 smithi164 ceph-mon[31788]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:37:39.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:39 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:39.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:39 smithi167 ceph-mon[34903]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T08:37:39.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:39 smithi167 ceph-mon[34903]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:37:39.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:39 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:39.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:39 smithi173 ceph-mon[35397]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-03-27T08:37:39.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:39 smithi173 ceph-mon[35397]: mds.? [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] up:active 2024-03-27T08:37:39.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:39 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:40.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:40 smithi164 ceph-mon[31788]: pgmap v511: 97 pgs: 97 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.5 MiB/s wr, 340 op/s 2024-03-27T08:37:40.757 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:40 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:40.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:40 smithi167 ceph-mon[34903]: pgmap v511: 97 pgs: 97 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.5 MiB/s wr, 340 op/s 2024-03-27T08:37:40.821 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:40 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:40 smithi173 ceph-mon[35397]: pgmap v511: 97 pgs: 97 active+clean; 109 MiB data, 756 MiB used, 1.0 TiB / 1.0 TiB avail; 632 KiB/s rd, 1.5 MiB/s wr, 340 op/s 2024-03-27T08:37:40.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:40 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:37:42.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:42 smithi164 ceph-mon[31788]: pgmap v512: 97 pgs: 97 active+clean; 109 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 365 op/s 2024-03-27T08:37:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:42 smithi167 ceph-mon[34903]: pgmap v512: 97 pgs: 97 active+clean; 109 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 365 op/s 2024-03-27T08:37:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:42 smithi173 ceph-mon[35397]: pgmap v512: 97 pgs: 97 active+clean; 109 MiB data, 764 MiB used, 1.0 TiB / 1.0 TiB avail; 485 KiB/s rd, 1.3 MiB/s wr, 365 op/s 2024-03-27T08:37:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:44 smithi167 ceph-mon[34903]: pgmap v513: 97 pgs: 97 active+clean; 111 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-03-27T08:37:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:44 smithi173 ceph-mon[35397]: pgmap v513: 97 pgs: 97 active+clean; 111 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-03-27T08:37:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:44 smithi164 ceph-mon[31788]: pgmap v513: 97 pgs: 97 active+clean; 111 MiB data, 768 MiB used, 1.0 TiB / 1.0 TiB avail; 601 KiB/s rd, 1.3 MiB/s wr, 355 op/s 2024-03-27T08:37:45.134 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar cf doc.tar linux-4.0.5 2024-03-27T08:37:46.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:46 smithi167 ceph-mon[34903]: pgmap v514: 97 pgs: 97 active+clean; 111 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.2 MiB/s wr, 336 op/s 2024-03-27T08:37:46.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:46 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:37:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:46 smithi173 ceph-mon[35397]: pgmap v514: 97 pgs: 97 active+clean; 111 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.2 MiB/s wr, 336 op/s 2024-03-27T08:37:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:46 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:37:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:46 smithi164 ceph-mon[31788]: pgmap v514: 97 pgs: 97 active+clean; 111 MiB data, 769 MiB used, 1.0 TiB / 1.0 TiB avail; 645 KiB/s rd, 1.2 MiB/s wr, 336 op/s 2024-03-27T08:37:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:46 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:37:47.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:47 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:37:47.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:47 smithi167 ceph-mon[34903]: scrub summary: idle 2024-03-27T08:37:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:47 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:37:47.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:47 smithi173 ceph-mon[35397]: scrub summary: idle 2024-03-27T08:37:48.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:47 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:37:48.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:47 smithi164 ceph-mon[31788]: scrub summary: idle 2024-03-27T08:37:48.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:48 smithi167 ceph-mon[34903]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 741 KiB/s wr, 294 op/s 2024-03-27T08:37:48.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:48 smithi173 ceph-mon[35397]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 741 KiB/s wr, 294 op/s 2024-03-27T08:37:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:48 smithi164 ceph-mon[31788]: pgmap v515: 97 pgs: 97 active+clean; 111 MiB data, 770 MiB used, 1.0 TiB / 1.0 TiB avail; 403 KiB/s rd, 741 KiB/s wr, 294 op/s 2024-03-27T08:37:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 -- 172.21.15.164:0/402933102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68102420 msgr2=0x7feb68104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.224 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 --2- 172.21.15.164:0/402933102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68102420 0x7feb68104810 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7feb58009900 tx=0x7feb5802bc30 comp rx=0 tx=0).stop 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 -- 172.21.15.164:0/402933102 shutdown_connections 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 --2- 172.21.15.164:0/402933102 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 0x7feb68109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 --2- 172.21.15.164:0/402933102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68104d50 0x7feb68107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 --2- 172.21.15.164:0/402933102 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68102420 0x7feb68104810 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.231+0000 7feb6d200640 1 -- 172.21.15.164:0/402933102 >> 172.21.15.164:0/402933102 conn(0x7feb680fbe30 msgr2=0x7feb680fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.232+0000 7feb6d200640 1 -- 172.21.15.164:0/402933102 shutdown_connections 2024-03-27T08:37:49.225 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.232+0000 7feb6d200640 1 -- 172.21.15.164:0/402933102 wait complete. 2024-03-27T08:37:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 Processor -- start 2024-03-27T08:37:49.227 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 -- start start 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68102420 0x7feb68101d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 0x7feb68100910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb6810d620 con 0x7feb68104d50 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb6810d4a0 con 0x7feb68102420 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.233+0000 7feb6d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb6810d7a0 con 0x7feb68107680 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50938/0 (socket says 172.21.15.164:50938) 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 -- 172.21.15.164:0/1249250464 learned_addr learned my addr 172.21.15.164:0/1249250464 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb67400640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68102420 0x7feb68101d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb67e00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 0x7feb68100910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 -- 172.21.15.164:0/1249250464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 msgr2=0x7feb68100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 0x7feb68100910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.228 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 -- 172.21.15.164:0/1249250464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68102420 msgr2=0x7feb68101d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68102420 0x7feb68101d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 -- 172.21.15.164:0/1249250464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb681011a0 con 0x7feb68104d50 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.234+0000 7feb66a00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb5400e9c0 tx=0x7feb5400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.235+0000 7feb5fe00640 1 -- 172.21.15.164:0/1249250464 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5400cd80 con 0x7feb68104d50 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.235+0000 7feb5fe00640 1 -- 172.21.15.164:0/1249250464 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feb540054f0 con 0x7feb68104d50 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.235+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb681a1df0 con 0x7feb68104d50 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.235+0000 7feb5fe00640 1 -- 172.21.15.164:0/1249250464 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54010690 con 0x7feb68104d50 2024-03-27T08:37:49.229 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.235+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb681a2250 con 0x7feb68104d50 2024-03-27T08:37:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 Processor -- start 2024-03-27T08:37:49.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 -- start start 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc8f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfce050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55fcecf2dd10 con 0x55fcecfc9550 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fceced6260 con 0x55fcecfc8b60 2024-03-27T08:37:49.232 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.239+0000 7feb7142a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fcecf29cc0 con 0x55fcecfce6c0 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfce050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:48720/0 (socket says 172.21.15.164:48720) 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67e00640 1 -- 172.21.15.164:0/1794217086 learned_addr learned my addr 172.21.15.164:0/1794217086 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb5fe00640 1 -- 172.21.15.164:0/1249250464 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7feb54004e10 con 0x7feb68104d50 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 -- 172.21.15.164:0/1794217086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 msgr2=0x55fcecfd0b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd0b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 -- 172.21.15.164:0/1794217086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 msgr2=0x55fcecfc8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc8f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.240+0000 7feb67400640 1 -- 172.21.15.164:0/1794217086 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcececdaa0 con 0x55fcecfc9550 2024-03-27T08:37:49.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.241+0000 7feb67400640 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfce050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feb58009230 tx=0x7feb58009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e318789d2e2a44 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.241+0000 7feb5cc00640 1 -- 172.21.15.164:0/1794217086 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb5802c9e0 con 0x55fcecfc9550 2024-03-27T08:37:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.241+0000 7feb5cc00640 1 -- 172.21.15.164:0/1794217086 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feb5802cb80 con 0x55fcecfc9550 2024-03-27T08:37:49.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.241+0000 7feb5cc00640 1 -- 172.21.15.164:0/1794217086 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58005620 con 0x55fcecfc9550 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb5fe00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 0x7feb4c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb5fe00640 1 -- 172.21.15.164:0/1249250464 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7feb540d0130 con 0x7feb68104d50 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 -- 172.21.15.164:0/1794217086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 msgr2=0x55fcecfce050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfce050 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7feb58009230 tx=0x7feb58009610 comp rx=0 tx=0).stop 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb67e00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 0x7feb4c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 -- 172.21.15.164:0/1794217086 shutdown_connections 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfce050 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 --2- 172.21.15.164:0/1794217086 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 -- 172.21.15.164:0/1794217086 >> 172.21.15.164:0/1794217086 conn(0x55fcecfc40d0 msgr2=0x55fcecfc44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 -- 172.21.15.164:0/1794217086 shutdown_connections 2024-03-27T08:37:49.236 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.242+0000 7feb7142a740 1 -- 172.21.15.164:0/1794217086 wait complete. 2024-03-27T08:37:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.243+0000 7feb67e00640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 0x7feb4c0a5ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fcecfc9db0 tx=0x7feb600097e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.243+0000 7feb7142a740 1 -- start start 2024-03-27T08:37:49.237 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.243+0000 7feb7142a740 1 Processor -- start 2024-03-27T08:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc9550 0x55fcecfd3400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfda3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55fcecfd1610 con 0x55fcecfc8b60 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fcecee9630 con 0x55fcecfc9550 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55fcecfd1790 con 0x55fcecfce6c0 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb7142a740 10 client.0 _ll_register_callbacks cb 0x55fceceeec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50954/0 (socket says 172.21.15.164:50954) 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 -- 172.21.15.164:0/2336564593 learned_addr learned my addr 172.21.15.164:0/2336564593 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb66a00640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc9550 0x55fcecfd3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 -- 172.21.15.164:0/2336564593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 msgr2=0x55fcecfda3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfda3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 -- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc9550 msgr2=0x55fcecfd3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc9550 0x55fcecfd3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.244+0000 7feb67400640 1 -- 172.21.15.164:0/2336564593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcecef55f0 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb67400640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feb58000c00 tx=0x7feb5802c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87c3e0687aa9f84 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb51600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb58003a00 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7feb58003ba0 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5802cb80 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb58003da0 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb7142a740 10 client.16071 fetch_fsmap learned FSMap version 29 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.245+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fcecc42210 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feb5802cb80 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7feb58041480 con 0x55fcecfc8b60 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 10 client.16071 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 10 client.16071 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 20 client.16071 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:49.241 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fcecfde9d0 0x55fcecfe0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 4 client.16071 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:37:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.246+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcecf3b250 con 0x55fcecfde9d0 2024-03-27T08:37:49.242 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.247+0000 7feb66a00640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fcecfde9d0 0x55fcecfe0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.248+0000 7feb66a00640 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fcecfde9d0 0x55fcecfe0e70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28cfb80b17398157 server_cookie=df040c3909706a5f in_seq=0 out_seq=0 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.248+0000 7feb51600640 10 client.16071 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb51600640 1 -- 172.21.15.164:0/2336564593 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55fcecf3b250 con 0x55fcecfde9d0 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb51600640 10 client.16071 handle_command_reply: tid=0 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 client.16071 shutdown 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 msgr2=0x55fcecfd2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7feb58000c00 tx=0x7feb5802c9e0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.243 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 shutdown_connections 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fcecfde9d0 0x55fcecfe0e70 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfda3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc9550 0x55fcecfd3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 --2- 172.21.15.164:0/2336564593 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc8b60 0x55fcecfd2ec0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 >> 172.21.15.164:0/2336564593 conn(0x55fcecfc40d0 msgr2=0x55fcecfc3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.249+0000 7feb51600640 0 client.16071 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.250+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 shutdown_connections 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.250+0000 7feb7142a740 1 -- 172.21.15.164:0/2336564593 wait complete. 2024-03-27T08:37:49.244 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.250+0000 7feb7142a740 20 client.16071 trim_cache size 0 max 16384 2024-03-27T08:37:49.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 Processor -- start 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 -- start start 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb681ad870 con 0x55fcecfc9550 2024-03-27T08:37:49.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb681ab0e0 con 0x55fcecfc8b60 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.272+0000 7feb7142a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb681a8f30 con 0x55fcecfce6c0 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50966/0 (socket says 172.21.15.164:50966) 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 -- 172.21.15.164:0/1266241726 learned_addr learned my addr 172.21.15.164:0/1266241726 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb67400640 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb67e00640 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 -- 172.21.15.164:0/1266241726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 msgr2=0x55fcecfd24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd24e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 -- 172.21.15.164:0/1266241726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 msgr2=0x55fcecfc7a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc7a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 -- 172.21.15.164:0/1266241726 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcecd0e620 con 0x55fcecfc9550 2024-03-27T08:37:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.273+0000 7feb66a00640 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7feb54098a10 tx=0x7feb54087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12019e5e888276f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.274+0000 7feb53e00640 1 -- 172.21.15.164:0/1266241726 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b9020 con 0x55fcecfc9550 2024-03-27T08:37:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.274+0000 7feb53e00640 1 -- 172.21.15.164:0/1266241726 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feb5409c5b0 con 0x55fcecfc9550 2024-03-27T08:37:49.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.274+0000 7feb53e00640 1 -- 172.21.15.164:0/1266241726 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb540b0e60 con 0x55fcecfc9550 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.274+0000 7feb7142a740 1 -- 172.21.15.164:0/1266241726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 msgr2=0x55fcecfda390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.274+0000 7feb7142a740 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7feb54098a10 tx=0x7feb54087040 comp rx=0 tx=0).stop 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 -- 172.21.15.164:0/1266241726 shutdown_connections 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfda390 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 --2- 172.21.15.164:0/1266241726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfc7a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 -- 172.21.15.164:0/1266241726 >> 172.21.15.164:0/1266241726 conn(0x55fcecfc40d0 msgr2=0x55fcecfc7330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 -- 172.21.15.164:0/1266241726 shutdown_connections 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 -- 172.21.15.164:0/1266241726 wait complete. 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 -- start start 2024-03-27T08:37:49.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.275+0000 7feb7142a740 1 Processor -- start 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfd7500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7feb681a95a0 con 0x55fcecfc9550 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7feb681aaa10 con 0x55fcecfc8b60 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7feb681a9c70 con 0x55fcecfce6c0 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb7142a740 10 client.0 _ll_register_callbacks cb 0x7feb60009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb66a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50982/0 (socket says 172.21.15.164:50982) 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb66a00640 1 -- 172.21.15.164:0/1659039506 learned_addr learned my addr 172.21.15.164:0/1659039506 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb67400640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfd7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.276+0000 7feb67e00640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 -- 172.21.15.164:0/1659039506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 msgr2=0x55fcecfd8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 -- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 msgr2=0x55fcecfd7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfd7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 -- 172.21.15.164:0/1659039506 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcecfd9040 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb67400640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfd7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb66a00640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c6a0 tx=0x7feb5409a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=904bf1b292a494a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb51600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb54065020 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7feb540cdcf0 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feb5409c5b0 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7feb540b9070 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.277+0000 7feb7142a740 10 client.16077 fetch_fsmap learned FSMap version 29 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fcecfda350 con 0x55fcecfc9550 2024-03-27T08:37:49.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7feb5409c5b0 con 0x55fcecfc9550 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7feb540a4d90 con 0x55fcecfc9550 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 10 client.16077 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 10 client.16077 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 20 client.16077 populate_metadata read hostname 'smithi164' 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fced045200 0x55fced047620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 4 client.16077 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.278+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fcecf355a0 con 0x55fced045200 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.279+0000 7feb67400640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fced045200 0x55fced047620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.279+0000 7feb67400640 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fced045200 0x55fced047620 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ed7ae83e8a7b819 server_cookie=9bd8ed170e09b90d in_seq=0 out_seq=0 2024-03-27T08:37:49.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.279+0000 7feb51600640 10 client.16077 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.393+0000 7feb51600640 1 -- 172.21.15.164:0/1659039506 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fcecf355a0 con 0x55fced045200 2024-03-27T08:37:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.393+0000 7feb51600640 10 client.16077 handle_command_reply: tid=0 2024-03-27T08:37:49.387 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 client.16077 shutdown 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 msgr2=0x55fcecfd7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7feb5400c6a0 tx=0x7feb5409a650 comp rx=0 tx=0).stop 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 shutdown_connections 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55fced045200 0x55fced047620 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55fcecfce6c0 0x55fcecfd8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55fcecfc9550 0x55fcecfd7a40 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 --2- 172.21.15.164:0/1659039506 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcecfc8b60 0x55fcecfd7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb51600640 0 client.16077 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:37:49.388 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 >> 172.21.15.164:0/1659039506 conn(0x55fcecfc40d0 msgr2=0x55fcecfc7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 shutdown_connections 2024-03-27T08:37:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 1 -- 172.21.15.164:0/1659039506 wait complete. 2024-03-27T08:37:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.394+0000 7feb7142a740 20 client.16077 trim_cache size 0 max 16384 2024-03-27T08:37:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:37:49.389 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:37:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:37:49.390 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 msgr2=0x7feb4c0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 0x7feb4c0a5ac0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x55fcecfc9db0 tx=0x7feb600097e0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 msgr2=0x7feb681003d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7feb5400e9c0 tx=0x7feb5400ee80 comp rx=0 tx=0).stop 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 shutdown_connections 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7feb4c0a3600 0x7feb4c0a5ac0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7feb68107680 0x7feb68100910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.391 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7feb68104d50 0x7feb681003d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 --2- 172.21.15.164:0/1249250464 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7feb68102420 0x7feb68101d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:37:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 >> 172.21.15.164:0/1249250464 conn(0x7feb680fbe30 msgr2=0x7feb68102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:37:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 shutdown_connections 2024-03-27T08:37:49.392 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:37:49.395+0000 7feb6d200640 1 -- 172.21.15.164:0/1249250464 wait complete. 2024-03-27T08:37:50.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:50 smithi167 ceph-mon[34903]: pgmap v516: 97 pgs: 97 active+clean; 112 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 598 KiB/s wr, 222 op/s 2024-03-27T08:37:50.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:50 smithi173 ceph-mon[35397]: pgmap v516: 97 pgs: 97 active+clean; 112 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 598 KiB/s wr, 222 op/s 2024-03-27T08:37:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:50 smithi164 ceph-mon[31788]: pgmap v516: 97 pgs: 97 active+clean; 112 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 598 KiB/s wr, 222 op/s 2024-03-27T08:37:52.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:52 smithi167 ceph-mon[34903]: pgmap v517: 97 pgs: 97 active+clean; 112 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 272 KiB/s wr, 85 op/s 2024-03-27T08:37:52.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:52 smithi173 ceph-mon[35397]: pgmap v517: 97 pgs: 97 active+clean; 112 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 272 KiB/s wr, 85 op/s 2024-03-27T08:37:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:52 smithi164 ceph-mon[31788]: pgmap v517: 97 pgs: 97 active+clean; 112 MiB data, 767 MiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 272 KiB/s wr, 85 op/s 2024-03-27T08:37:54.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:54 smithi167 ceph-mon[34903]: pgmap v518: 97 pgs: 97 active+clean; 112 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 213 KiB/s wr, 55 op/s 2024-03-27T08:37:54.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:54 smithi173 ceph-mon[35397]: pgmap v518: 97 pgs: 97 active+clean; 112 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 213 KiB/s wr, 55 op/s 2024-03-27T08:37:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:54 smithi164 ceph-mon[31788]: pgmap v518: 97 pgs: 97 active+clean; 112 MiB data, 763 MiB used, 1.0 TiB / 1.0 TiB avail; 191 KiB/s rd, 213 KiB/s wr, 55 op/s 2024-03-27T08:37:56.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:56 smithi167 ceph-mon[34903]: pgmap v519: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 117 KiB/s wr, 68 op/s 2024-03-27T08:37:56.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:56 smithi173 ceph-mon[35397]: pgmap v519: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 117 KiB/s wr, 68 op/s 2024-03-27T08:37:57.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:56 smithi164 ceph-mon[31788]: pgmap v519: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 117 KiB/s wr, 68 op/s 2024-03-27T08:37:58.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:37:58 smithi167 ceph-mon[34903]: pgmap v520: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 KiB/s wr, 65 op/s 2024-03-27T08:37:58.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:37:58 smithi173 ceph-mon[35397]: pgmap v520: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 KiB/s wr, 65 op/s 2024-03-27T08:37:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:37:58 smithi164 ceph-mon[31788]: pgmap v520: 97 pgs: 97 active+clean; 108 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 72 KiB/s wr, 65 op/s 2024-03-27T08:38:00.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:00 smithi167 ceph-mon[34903]: pgmap v521: 97 pgs: 97 active+clean; 113 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 527 KiB/s wr, 68 op/s 2024-03-27T08:38:00.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:00 smithi173 ceph-mon[35397]: pgmap v521: 97 pgs: 97 active+clean; 113 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 527 KiB/s wr, 68 op/s 2024-03-27T08:38:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:00 smithi164 ceph-mon[31788]: pgmap v521: 97 pgs: 97 active+clean; 113 MiB data, 771 MiB used, 1.0 TiB / 1.0 TiB avail; 166 KiB/s rd, 527 KiB/s wr, 68 op/s 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.552+0000 7fc813e00640 1 -- 172.21.15.164:0/1093224512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 msgr2=0x7fc814107140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.552+0000 7fc813e00640 1 --2- 172.21.15.164:0/1093224512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc814107140 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc800009900 tx=0x7fc80002bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 -- 172.21.15.164:0/1093224512 shutdown_connections 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 --2- 172.21.15.164:0/1093224512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 0x7fc814109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 --2- 172.21.15.164:0/1093224512 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc814107140 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 --2- 172.21.15.164:0/1093224512 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 0x7fc814104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 -- 172.21.15.164:0/1093224512 >> 172.21.15.164:0/1093224512 conn(0x7fc8140fbe30 msgr2=0x7fc8140fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 -- 172.21.15.164:0/1093224512 shutdown_connections 2024-03-27T08:38:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.553+0000 7fc813e00640 1 -- 172.21.15.164:0/1093224512 wait complete. 2024-03-27T08:38:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 Processor -- start 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 -- start start 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 0x7fc814199f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 0x7fc8141a14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410d650 con 0x7fc814104d50 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410d4d0 con 0x7fc814107680 2024-03-27T08:38:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc813e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc81410d7d0 con 0x7fc814102420 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc812000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc812000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43512/0 (socket says 172.21.15.164:43512) 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.554+0000 7fc812000640 1 -- 172.21.15.164:0/3958330677 learned_addr learned my addr 172.21.15.164:0/3958330677 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc813400640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 0x7fc8141a14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812a00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 0x7fc814199f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 -- 172.21.15.164:0/3958330677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 msgr2=0x7fc814199f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 0x7fc814199f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 -- 172.21.15.164:0/3958330677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 msgr2=0x7fc8141a14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 0x7fc8141a14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 -- 172.21.15.164:0/3958330677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8141a1b20 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.555+0000 7fc812000640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc800000c00 tx=0x7fc800004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.556+0000 7fc80b400640 1 -- 172.21.15.164:0/3958330677 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800043020 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.556+0000 7fc80b400640 1 -- 172.21.15.164:0/3958330677 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc8000054d0 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.556+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8141a1db0 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.556+0000 7fc80b400640 1 -- 172.21.15.164:0/3958330677 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc800003d40 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.556+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8141a2280 con 0x7fc814104d50 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 Processor -- start 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 -- start start 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 0x55714c1f6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55714c155d10 con 0x55714c1f0b60 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55714c0fe260 con 0x55714c1f1550 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.560+0000 7fc81c56c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55714c151cc0 con 0x55714c1f66c0 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43514/0 (socket says 172.21.15.164:43514) 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 -- 172.21.15.164:0/3642972297 learned_addr learned my addr 172.21.15.164:0/3642972297 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc80b400640 1 -- 172.21.15.164:0/3958330677 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc800046020 con 0x7fc814104d50 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc812a00640 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 0x55714c1f6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 -- 172.21.15.164:0/3642972297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 msgr2=0x55714c1f8b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1f8b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 -- 172.21.15.164:0/3642972297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 msgr2=0x55714c1f6050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 0x55714c1f6050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc813400640 1 -- 172.21.15.164:0/3642972297 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55714c0f5aa0 con 0x55714c1f0b60 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.561+0000 7fc812a00640 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 0x55714c1f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.562+0000 7fc813400640 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b6b0 tx=0x7fc80400bb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629980918d2b4bf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.562+0000 7fc7ffe00640 1 -- 172.21.15.164:0/3642972297 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc804003bd0 con 0x55714c1f0b60 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.562+0000 7fc7ffe00640 1 -- 172.21.15.164:0/3642972297 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc804015070 con 0x55714c1f0b60 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.562+0000 7fc7ffe00640 1 -- 172.21.15.164:0/3642972297 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8040116a0 con 0x55714c1f0b60 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc80b400640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 0x7fc7f80a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 -- 172.21.15.164:0/3642972297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 msgr2=0x55714c1f0f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b6b0 tx=0x7fc80400bb70 comp rx=0 tx=0).stop 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc80b400640 1 -- 172.21.15.164:0/3958330677 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc8000f1fb0 con 0x7fc814104d50 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 -- 172.21.15.164:0/3642972297 shutdown_connections 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1f8b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f1550 0x55714c1f6050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.559 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3642972297 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1f0f80 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 -- 172.21.15.164:0/3642972297 >> 172.21.15.164:0/3642972297 conn(0x55714c1ec0d0 msgr2=0x55714c1ec4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 -- 172.21.15.164:0/3642972297 shutdown_connections 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc812a00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 0x7fc7f80a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.563+0000 7fc81c56c740 1 -- 172.21.15.164:0/3642972297 wait complete. 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 -- start start 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 Processor -- start 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc812a00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 0x7fc7f80a5b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0092f0 tx=0x7fc80c009280 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1fb450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 0x55714c202490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55714c1f9670 con 0x55714c1f0b60 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55714c111630 con 0x55714c1f66c0 2024-03-27T08:38:02.560 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55714c1f97f0 con 0x55714c1f1550 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.564+0000 7fc81c56c740 10 client.0 _ll_register_callbacks cb 0x55714c116c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43518/0 (socket says 172.21.15.164:43518) 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 -- 172.21.15.164:0/815220330 learned_addr learned my addr 172.21.15.164:0/815220330 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc813400640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 0x55714c202490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812000640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1fb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 -- 172.21.15.164:0/815220330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 msgr2=0x55714c1fb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1fb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 -- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 msgr2=0x55714c202490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 0x55714c202490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc812a00640 1 -- 172.21.15.164:0/815220330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55714c11d5f0 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.565+0000 7fc813400640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 0x55714c202490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc812a00640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0127d0 tx=0x7fc80c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d3fcb469978845e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc7fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c00ead0 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc80c00ec70 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc804015070 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc80c01f420 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc81c56c740 10 client.16089 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.566+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55714be6a210 con 0x55714c1f0b60 2024-03-27T08:38:02.564 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc804015070 con 0x55714c1f0b60 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc80c00f040 con 0x55714c1f0b60 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 10 client.16089 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 10 client.16089 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 20 client.16089 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c206d90 0x55714c2091e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 4 client.16089 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.567+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55714c163250 con 0x55714c206d90 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.568+0000 7fc812000640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c206d90 0x55714c2091e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.568+0000 7fc7fcc00640 10 client.16089 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.568+0000 7fc812000640 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c206d90 0x55714c2091e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c895b71597fa4af4 server_cookie=7de29dde5a4c4730 in_seq=0 out_seq=0 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.569+0000 7fc7fcc00640 1 -- 172.21.15.164:0/815220330 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55714c163250 con 0x55714c206d90 2024-03-27T08:38:02.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.569+0000 7fc7fcc00640 10 client.16089 handle_command_reply: tid=0 2024-03-27T08:38:02.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.569+0000 7fc81c56c740 1 client.16089 shutdown 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 msgr2=0x55714c1faf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0127d0 tx=0x7fc80c004a40 comp rx=0 tx=0).stop 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 shutdown_connections 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c206d90 0x55714c2091e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f66c0 0x55714c202490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1fb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 --2- 172.21.15.164:0/815220330 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f0b60 0x55714c1faf10 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 >> 172.21.15.164:0/815220330 conn(0x55714c1ec0d0 msgr2=0x55714c1eb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc7fcc00640 0 client.16089 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 shutdown_connections 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 1 -- 172.21.15.164:0/815220330 wait complete. 2024-03-27T08:38:02.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.570+0000 7fc81c56c740 20 client.16089 trim_cache size 0 max 16384 2024-03-27T08:38:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 Processor -- start 2024-03-27T08:38:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 -- start start 2024-03-27T08:38:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1fb060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ad9b0 con 0x55714c1f1550 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141ab220 con 0x55714c1f0b60 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.591+0000 7fc81c56c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141a9070 con 0x55714c1f66c0 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43532/0 (socket says 172.21.15.164:43532) 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 -- 172.21.15.164:0/3288048302 learned_addr learned my addr 172.21.15.164:0/3288048302 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812a00640 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc813400640 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 -- 172.21.15.164:0/3288048302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 msgr2=0x55714c1fb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1fb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 -- 172.21.15.164:0/3288048302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 msgr2=0x55714c1fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 -- 172.21.15.164:0/3288048302 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55714bf36620 con 0x55714c1f1550 2024-03-27T08:38:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.592+0000 7fc812000640 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc800005ab0 tx=0x7fc8000ba040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f6e1b9a4df668d4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.593+0000 7fc7ff400640 1 -- 172.21.15.164:0/3288048302 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000a7070 con 0x55714c1f1550 2024-03-27T08:38:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.593+0000 7fc7ff400640 1 -- 172.21.15.164:0/3288048302 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc800004c70 con 0x55714c1f1550 2024-03-27T08:38:02.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.593+0000 7fc7ff400640 1 -- 172.21.15.164:0/3288048302 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8000bc730 con 0x55714c1f1550 2024-03-27T08:38:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- 172.21.15.164:0/3288048302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 msgr2=0x55714c202450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fc800005ab0 tx=0x7fc8000ba040 comp rx=0 tx=0).stop 2024-03-27T08:38:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- 172.21.15.164:0/3288048302 shutdown_connections 2024-03-27T08:38:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f66c0 0x55714c1fb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f1550 0x55714c202450 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 --2- 172.21.15.164:0/3288048302 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- 172.21.15.164:0/3288048302 >> 172.21.15.164:0/3288048302 conn(0x55714c1ec0d0 msgr2=0x55714c1f2910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- 172.21.15.164:0/3288048302 shutdown_connections 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- 172.21.15.164:0/3288048302 wait complete. 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.594+0000 7fc81c56c740 1 -- start start 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 Processor -- start 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1ff610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1ffb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141a96e0 con 0x55714c1f66c0 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141aab50 con 0x55714c1f0b60 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc8141a9db0 con 0x55714c1f1550 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc81c56c740 10 client.0 _ll_register_callbacks cb 0x7fc80c009e90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43536/0 (socket says 172.21.15.164:43536) 2024-03-27T08:38:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.595+0000 7fc813400640 1 -- 172.21.15.164:0/2296709482 learned_addr learned my addr 172.21.15.164:0/2296709482 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc812a00640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1ff610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc812000640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1ffb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 -- 172.21.15.164:0/2296709482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 msgr2=0x55714c1ffb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1ffb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 -- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 msgr2=0x55714c1ff610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1ff610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 -- 172.21.15.164:0/2296709482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55714c201100 con 0x55714c1f66c0 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc812000640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc813400640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b6b0 tx=0x7fc80400bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87957738ad6c003 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.596+0000 7fc7fcc00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80402b060 con 0x55714c1f66c0 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc804005250 con 0x55714c1f66c0 2024-03-27T08:38:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc800004c70 con 0x55714c1f66c0 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc804003e60 con 0x55714c1f66c0 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc81c56c740 10 client.16095 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55714c202410 con 0x55714c1f66c0 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc800004c70 con 0x55714c1f66c0 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.597+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc80401a630 con 0x55714c1f66c0 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 10 client.16095 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:02.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 10 client.16095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 20 client.16095 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c26d230 0x55714c26f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 4 client.16095 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:38:02.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55714c15d5a0 con 0x55714c26d230 2024-03-27T08:38:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.598+0000 7fc812a00640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c26d230 0x55714c26f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:02.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.599+0000 7fc812a00640 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c26d230 0x55714c26f620 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ed60f6753c3c1e2 server_cookie=ab124c57505d52d0 in_seq=0 out_seq=0 2024-03-27T08:38:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.599+0000 7fc7fcc00640 10 client.16095 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.630+0000 7fc7fcc00640 1 -- 172.21.15.164:0/2296709482 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55714c15d5a0 con 0x55714c26d230 2024-03-27T08:38:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.630+0000 7fc7fcc00640 10 client.16095 handle_command_reply: tid=0 2024-03-27T08:38:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.630+0000 7fc81c56c740 1 client.16095 shutdown 2024-03-27T08:38:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 msgr2=0x55714c200b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7fc80400b6b0 tx=0x7fc80400bfd0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 shutdown_connections 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55714c26d230 0x55714c26f620 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55714c1f66c0 0x55714c200b10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55714c1f1550 0x55714c1ffb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 --2- 172.21.15.164:0/2296709482 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55714c1f0b60 0x55714c1ff610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 >> 172.21.15.164:0/2296709482 conn(0x55714c1ec0d0 msgr2=0x55714c1fab20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc7fcc00640 0 client.16095 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 shutdown_connections 2024-03-27T08:38:02.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 1 -- 172.21.15.164:0/2296709482 wait complete. 2024-03-27T08:38:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.631+0000 7fc81c56c740 20 client.16095 trim_cache size 0 max 16384 2024-03-27T08:38:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:38:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:38:02.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:38:02.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 msgr2=0x7fc7f80a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 0x7fc7f80a5b40 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fc80c0092f0 tx=0x7fc80c009280 comp rx=0 tx=0).stop 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 msgr2=0x7fc81419a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc800000c00 tx=0x7fc800004f10 comp rx=0 tx=0).stop 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 shutdown_connections 2024-03-27T08:38:02.629 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7f80a3680 0x7fc7f80a5b40 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc814107680 0x7fc8141a14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc814104d50 0x7fc81419a440 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 --2- 172.21.15.164:0/3958330677 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc814102420 0x7fc814199f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.632+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 >> 172.21.15.164:0/3958330677 conn(0x7fc8140fbe30 msgr2=0x7fc814101b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.633+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 shutdown_connections 2024-03-27T08:38:02.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:02.633+0000 7fc813e00640 1 -- 172.21.15.164:0/3958330677 wait complete. 2024-03-27T08:38:02.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:02 smithi173 ceph-mon[35397]: pgmap v522: 97 pgs: 97 active+clean; 117 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 847 KiB/s wr, 65 op/s 2024-03-27T08:38:03.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:02 smithi164 ceph-mon[31788]: pgmap v522: 97 pgs: 97 active+clean; 117 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 847 KiB/s wr, 65 op/s 2024-03-27T08:38:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:02 smithi167 ceph-mon[34903]: pgmap v522: 97 pgs: 97 active+clean; 117 MiB data, 776 MiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 847 KiB/s wr, 65 op/s 2024-03-27T08:38:05.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:04 smithi164 ceph-mon[31788]: pgmap v523: 97 pgs: 97 active+clean; 122 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.2 MiB/s wr, 49 op/s 2024-03-27T08:38:05.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:04 smithi167 ceph-mon[34903]: pgmap v523: 97 pgs: 97 active+clean; 122 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.2 MiB/s wr, 49 op/s 2024-03-27T08:38:05.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:04 smithi173 ceph-mon[35397]: pgmap v523: 97 pgs: 97 active+clean; 122 MiB data, 789 MiB used, 1.0 TiB / 1.0 TiB avail; 167 KiB/s rd, 1.2 MiB/s wr, 49 op/s 2024-03-27T08:38:06.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2024-03-27T08:38:06.120 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell mds.1:0 scrub status 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 -- 172.21.15.164:0/479367448 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 msgr2=0x7f7c24104070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 --2- 172.21.15.164:0/479367448 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24104070 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f7c14009900 tx=0x7f7c1402bc40 comp rx=0 tx=0).stop 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 -- 172.21.15.164:0/479367448 shutdown_connections 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 --2- 172.21.15.164:0/479367448 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 0x7f7c2410c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 --2- 172.21.15.164:0/479367448 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c241052c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 --2- 172.21.15.164:0/479367448 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24104070 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 -- 172.21.15.164:0/479367448 >> 172.21.15.164:0/479367448 conn(0x7f7c240ff1c0 msgr2=0x7f7c24101600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 -- 172.21.15.164:0/479367448 shutdown_connections 2024-03-27T08:38:06.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.376+0000 7f7c23200640 1 -- 172.21.15.164:0/479367448 wait complete. 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.377+0000 7f7c23200640 1 Processor -- start 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.377+0000 7f7c23200640 1 -- start start 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c2419a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 0x7f7c241a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410f900 con 0x7f7c24103c50 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410f780 con 0x7f7c24105800 2024-03-27T08:38:06.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c23200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7c2410fa80 con 0x7f7c24104e40 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56930/0 (socket says 172.21.15.164:56930) 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 -- 172.21.15.164:0/371475261 learned_addr learned my addr 172.21.15.164:0/371475261 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c22800640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 0x7f7c241a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21400640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c2419a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 -- 172.21.15.164:0/371475261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 msgr2=0x7f7c2419a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c2419a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 -- 172.21.15.164:0/371475261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 msgr2=0x7f7c241a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.378+0000 7f7c21e00640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 0x7f7c241a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c21e00640 1 -- 172.21.15.164:0/371475261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c241a1b70 con 0x7f7c24103c50 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c21400640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c2419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c21e00640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000c00 tx=0x7f7c14004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c1aa00640 1 -- 172.21.15.164:0/371475261 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14043020 con 0x7f7c24103c50 2024-03-27T08:38:06.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c1aa00640 1 -- 172.21.15.164:0/371475261 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7c14005460 con 0x7f7c24103c50 2024-03-27T08:38:06.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c241a1e00 con 0x7f7c24103c50 2024-03-27T08:38:06.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.379+0000 7f7c1aa00640 1 -- 172.21.15.164:0/371475261 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14003c20 con 0x7f7c24103c50 2024-03-27T08:38:06.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.380+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c241a22c0 con 0x7f7c24103c50 2024-03-27T08:38:06.374 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar xf doc.tar 2024-03-27T08:38:06.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.383+0000 7f7c1aa00640 1 -- 172.21.15.164:0/371475261 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f7c14046020 con 0x7f7c24103c50 2024-03-27T08:38:06.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.383+0000 7f7c2bbeb740 1 Processor -- start 2024-03-27T08:38:06.375 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 -- start start 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb0d870 0x55978bb12370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 0x55978bb14e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55978ba6a6b0 con 0x55978bb0ce80 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55978ba12750 con 0x55978bb129e0 2024-03-27T08:38:06.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.384+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55978ba66660 con 0x55978bb0d870 2024-03-27T08:38:06.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56932/0 (socket says 172.21.15.164:56932) 2024-03-27T08:38:06.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 -- 172.21.15.164:0/2607538425 learned_addr learned my addr 172.21.15.164:0/2607538425 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c1aa00640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 0x7f7c080a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 -- 172.21.15.164:0/2607538425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb0d870 msgr2=0x55978bb12370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb0d870 0x55978bb12370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c22800640 1 -- 172.21.15.164:0/2607538425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 msgr2=0x55978bb14e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.385+0000 7f7c21400640 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 0x55978bb14e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c1aa00640 1 -- 172.21.15.164:0/371475261 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7c140f1e30 con 0x7f7c24103c50 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c22800640 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 0x55978bb14e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c22800640 1 -- 172.21.15.164:0/2607538425 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978b8487d0 con 0x55978bb0ce80 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c21400640 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 0x55978bb14e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c22800640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 0x7f7c080a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.386+0000 7f7c22800640 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011590 tx=0x7f7c1c011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a791e8a01a39d753 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.387+0000 7f7c0f400640 1 -- 172.21.15.164:0/2607538425 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c017050 con 0x55978bb0ce80 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.387+0000 7f7c0f400640 1 -- 172.21.15.164:0/2607538425 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7c1c00fe40 con 0x55978bb0ce80 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.387+0000 7f7c0f400640 1 -- 172.21.15.164:0/2607538425 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c00e3b0 con 0x55978bb0ce80 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/2607538425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 msgr2=0x55978bb0d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c22800640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 0x7f7c080a5b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c022000 tx=0x7f7c1c023000 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c011590 tx=0x7f7c1c011a50 comp rx=0 tx=0).stop 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/2607538425 shutdown_connections 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb129e0 0x55978bb14e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb0d870 0x55978bb12370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.380 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/2607538425 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb0d2a0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/2607538425 >> 172.21.15.164:0/2607538425 conn(0x55978bb083f0 msgr2=0x55978bb087f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/2607538425 shutdown_connections 2024-03-27T08:38:06.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.388+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/2607538425 wait complete. 2024-03-27T08:38:06.381 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.389+0000 7f7c2bbeb740 1 -- start start 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.389+0000 7f7c2bbeb740 1 Processor -- start 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0ce80 0x55978bb17480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55978bb15990 con 0x55978bb0d870 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55978ba25a80 con 0x55978bb0ce80 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55978bb15b10 con 0x55978bb129e0 2024-03-27T08:38:06.382 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c2bbeb740 10 client.0 _ll_register_callbacks cb 0x55978ba25470 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c21400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.390+0000 7f7c21400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56934/0 (socket says 172.21.15.164:56934) 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 -- 172.21.15.164:0/385645062 learned_addr learned my addr 172.21.15.164:0/385645062 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c22800640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21e00640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0ce80 0x55978bb17480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 -- 172.21.15.164:0/385645062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 msgr2=0x55978bb1ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 -- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0ce80 msgr2=0x55978bb17480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0ce80 0x55978bb17480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.383 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.391+0000 7f7c21400640 1 -- 172.21.15.164:0/385645062 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978b77e3f0 con 0x55978bb0d870 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.392+0000 7f7c21400640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000e6c0 tx=0x7f7c1000eb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=158f96a9b59ae2e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.392+0000 7f7c03e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.392+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1001c060 con 0x55978bb0d870 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.392+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7c10009a20 con 0x55978bb0d870 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.392+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55978ba77bf0 con 0x55978bb0d870 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7c10009c20 con 0x55978bb0d870 2024-03-27T08:38:06.385 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55978b73e0f0 con 0x55978bb0d870 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55978ba77bf0 con 0x55978bb0d870 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7c100203e0 con 0x55978bb0d870 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 10 client.16107 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 20 client.16107 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb232d0 0x55978bb25730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 4 client.16107 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:06.386 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.393+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55978ba71f40 con 0x55978bb232d0 2024-03-27T08:38:06.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.394+0000 7f7c21e00640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb232d0 0x55978bb25730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.395+0000 7f7c21e00640 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb232d0 0x55978bb25730 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b269b3bda98ab179 server_cookie=42011939a43d505 in_seq=0 out_seq=0 2024-03-27T08:38:06.387 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.395+0000 7f7c03e00640 10 client.16107 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:06.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.396+0000 7f7c03e00640 1 -- 172.21.15.164:0/385645062 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x7f7c140a39c0 con 0x55978bb232d0 2024-03-27T08:38:06.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.396+0000 7f7c03e00640 10 client.16107 handle_command_reply: tid=0 2024-03-27T08:38:06.388 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.396+0000 7f7c2bbeb740 1 client.16107 shutdown 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 msgr2=0x55978bb179c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000e6c0 tx=0x7f7c1000eb80 comp rx=0 tx=0).stop 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 shutdown_connections 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb232d0 0x55978bb25730 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0d870 0x55978bb179c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c03e00640 0 client.16107 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/385645062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0ce80 0x55978bb17480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 >> 172.21.15.164:0/385645062 conn(0x55978bb083f0 msgr2=0x55978bafee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 shutdown_connections 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/385645062 wait complete. 2024-03-27T08:38:06.389 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.397+0000 7f7c2bbeb740 20 client.16107 trim_cache size 0 max 16384 2024-03-27T08:38:06.411 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.420+0000 7f7c2bbeb740 1 Processor -- start 2024-03-27T08:38:06.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.420+0000 7f7c2bbeb740 1 -- start start 2024-03-27T08:38:06.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.420+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb15ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.412 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.420+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.420+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb16420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a9500 con 0x55978bb0ce80 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a6d70 con 0x55978bb0d870 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a4bc0 con 0x55978bb129e0 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb15ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56368/0 (socket says 172.21.15.164:56368) 2024-03-27T08:38:06.413 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21400640 1 -- 172.21.15.164:0/3847864715 learned_addr learned my addr 172.21.15.164:0/3847864715 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 -- 172.21.15.164:0/3847864715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 msgr2=0x55978bb16420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb16420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 -- 172.21.15.164:0/3847864715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 msgr2=0x55978bb1e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.421+0000 7f7c21e00640 1 -- 172.21.15.164:0/3847864715 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55978bafb640 con 0x55978bb0ce80 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.422+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb15ee0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55978bb0e2e0 tx=0x7f7c140c1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d40e362c91eda48 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.422+0000 7f7c0ea00640 1 -- 172.21.15.164:0/3847864715 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14005610 con 0x55978bb0ce80 2024-03-27T08:38:06.414 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.422+0000 7f7c0ea00640 1 -- 172.21.15.164:0/3847864715 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55978ba71f40 con 0x55978bb0ce80 2024-03-27T08:38:06.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.422+0000 7f7c0ea00640 1 -- 172.21.15.164:0/3847864715 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c140bc3b0 con 0x55978bb0ce80 2024-03-27T08:38:06.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.423+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3847864715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 msgr2=0x55978bb15ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.423+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb15ee0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x55978bb0e2e0 tx=0x7f7c140c1040 comp rx=0 tx=0).stop 2024-03-27T08:38:06.415 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3847864715 shutdown_connections 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb16420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3847864715 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb15ee0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3847864715 >> 172.21.15.164:0/3847864715 conn(0x55978bb083f0 msgr2=0x55978bb17480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3847864715 shutdown_connections 2024-03-27T08:38:06.416 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.424+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3847864715 wait complete. 2024-03-27T08:38:06.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 -- start start 2024-03-27T08:38:06.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 Processor -- start 2024-03-27T08:38:06.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.418 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a5230 con 0x55978bb0ce80 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a66a0 con 0x55978bb0d870 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f7c241a5900 con 0x55978bb129e0 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.425+0000 7f7c2bbeb740 10 client.0 _ll_register_callbacks cb 0x7f7c1000cea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56956/0 (socket says 172.21.15.164:56956) 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 -- 172.21.15.164:0/3593192913 learned_addr learned my addr 172.21.15.164:0/3593192913 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21400640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c22800640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 -- 172.21.15.164:0/3593192913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 msgr2=0x55978bb1d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 -- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 msgr2=0x55978bb1c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 -- 172.21.15.164:0/3593192913 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55978bb1dfe0 con 0x55978bb0ce80 2024-03-27T08:38:06.419 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c22800640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21400640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c21e00640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ef990 tx=0x7f7c1402bc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49fb4672f7e8702 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c03e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.426+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c14004c70 con 0x55978bb0ce80 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55978ba71f40 con 0x55978bb0ce80 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7c140efe00 con 0x55978bb0ce80 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f7c140bea10 con 0x55978bb0ce80 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 10 client.16113 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:06.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55978bb89a00 con 0x55978bb0ce80 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55978ba71f40 con 0x55978bb0ce80 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f7c140ba980 con 0x55978bb0ce80 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 10 client.16113 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 10 client.16113 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 20 client.16113 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb8a480 0x55978bb8c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 4 client.16113 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.427+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55978b9ef400 con 0x55978bb8a480 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.428+0000 7f7c21400640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb8a480 0x55978bb8c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.428+0000 7f7c21400640 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb8a480 0x55978bb8c8a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5abaabe53fed8481 server_cookie=5ee84f0b4f9b23c6 in_seq=0 out_seq=0 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.428+0000 7f7c03e00640 10 client.16113 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c03e00640 1 -- 172.21.15.164:0/3593192913 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55978b9ef400 con 0x55978bb8a480 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c03e00640 10 client.16113 handle_command_reply: tid=0 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 client.16113 shutdown 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 msgr2=0x55978bb1c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f7c140ef990 tx=0x7f7c1402bc40 comp rx=0 tx=0).stop 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 shutdown_connections 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55978bb8a480 0x55978bb8c8a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55978bb129e0 0x55978bb1d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55978bb0d870 0x55978bb1c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c03e00640 0 client.16113 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 --2- 172.21.15.164:0/3593192913 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55978bb0ce80 0x55978bb1c4a0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 >> 172.21.15.164:0/3593192913 conn(0x55978bb083f0 msgr2=0x55978bb17460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 shutdown_connections 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 1 -- 172.21.15.164:0/3593192913 wait complete. 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.429+0000 7f7c2bbeb740 20 client.16113 trim_cache size 0 max 16384 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stdout: "status": "no active scrubs running", 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stdout: "scrubs": {} 2024-03-27T08:38:06.424 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 msgr2=0x7f7c080a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 0x7f7c080a5b50 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c022000 tx=0x7f7c1c023000 comp rx=0 tx=0).stop 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 msgr2=0x7f7c24199f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f7c14000c00 tx=0x7f7c14004e20 comp rx=0 tx=0).stop 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 shutdown_connections 2024-03-27T08:38:06.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f7c080a3690 0x7f7c080a5b50 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7c24105800 0x7f7c241a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7c24104e40 0x7f7c2419a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 --2- 172.21.15.164:0/371475261 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7c24103c50 0x7f7c24199f50 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.430+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 >> 172.21.15.164:0/371475261 conn(0x7f7c240ff1c0 msgr2=0x7f7c24108070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.431+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 shutdown_connections 2024-03-27T08:38:06.426 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.431+0000 7f7c23200640 1 -- 172.21.15.164:0/371475261 wait complete. 2024-03-27T08:38:06.439 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-03-27T08:38:06.440 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-27T08:38:06.649 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.657+0000 7f9188e00640 1 -- 172.21.15.164:0/17547005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 msgr2=0x7f9184101d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.657+0000 7f9188e00640 1 --2- 172.21.15.164:0/17547005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184101d80 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f9174009900 tx=0x7f917402bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.657+0000 7f9188e00640 1 -- 172.21.15.164:0/17547005 shutdown_connections 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 --2- 172.21.15.164:0/17547005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 0x7f9184109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 --2- 172.21.15.164:0/17547005 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 0x7f9184102fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 --2- 172.21.15.164:0/17547005 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184101d80 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 -- 172.21.15.164:0/17547005 >> 172.21.15.164:0/17547005 conn(0x7f91840fceb0 msgr2=0x7f91840ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 -- 172.21.15.164:0/17547005 shutdown_connections 2024-03-27T08:38:06.650 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.658+0000 7f9188e00640 1 -- 172.21.15.164:0/17547005 wait complete. 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 Processor -- start 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 -- start start 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 0x7f918419a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 0x7f91841a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f918410d610 con 0x7f9184101960 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f918410d490 con 0x7f9184103510 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9188e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f918410d790 con 0x7f9184102b50 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.659+0000 7f9183400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.652 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56970/0 (socket says 172.21.15.164:56970) 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 -- 172.21.15.164:0/1263914928 learned_addr learned my addr 172.21.15.164:0/1263914928 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 0x7f91841a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9182a00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 0x7f918419a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 -- 172.21.15.164:0/1263914928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 msgr2=0x7f918419a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 0x7f918419a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 -- 172.21.15.164:0/1263914928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 msgr2=0x7f91841a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 0x7f91841a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 -- 172.21.15.164:0/1263914928 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91841a1a60 con 0x7f9184101960 2024-03-27T08:38:06.653 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.660+0000 7f9183400640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9174000c00 tx=0x7f9174004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.661+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174043020 con 0x7f9184101960 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.661+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9174005460 con 0x7f9184101960 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.661+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9174003d00 con 0x7f9184101960 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.661+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91841a1cf0 con 0x7f9184101960 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.661+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91841a2190 con 0x7f9184101960 2024-03-27T08:38:06.654 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.662+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91841a2420 con 0x7f9184101960 2024-03-27T08:38:06.656 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.665+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f9174046020 con 0x7f9184101960 2024-03-27T08:38:06.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.666+0000 7f917be00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 0x7f91680a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:06.657 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.666+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f91740f1f30 con 0x7f9184101960 2024-03-27T08:38:06.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.666+0000 7f9182a00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 0x7f91680a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:06.658 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.667+0000 7f9182a00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 0x7f91680a5b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fd0 tx=0x7f9170005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:06.664 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.672+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f917404d020 con 0x7f9184101960 2024-03-27T08:38:06.929 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.937+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f91841a27b0 con 0x7f9184101960 2024-03-27T08:38:06.931 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.939+0000 7f917be00640 1 -- 172.21.15.164:0/1263914928 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11895 (secure 0 0 0) 0x7f91740042d0 con 0x7f9184101960 2024-03-27T08:38:06.931 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:38:06.931 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14538,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6835/96681599","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6834","nonce":96681599},{"type":"v1","addr":"172.21.15.164:6835","nonce":96681599}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6837/3048161214","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6836","nonce":3048161214},{"type":"v1","addr":"172.21.15.164:6837","nonce":3048161214}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14640,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6839/2287850216","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6838","nonce":2287850216},{"type":"v1","addr":"172.21.15.164:6839","nonce":2287850216}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14658,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.164:6841/429709986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6840","nonce":429709986},{"type":"v1","addr":"172.21.15.164:6841","nonce":429709986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6833/3929947876","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6832","nonce":3929947876},{"type":"v1","addr":"172.21.15.173:6833","nonce":3929947876}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24433,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.173:6835/4213841901","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6834","nonce":4213841901},{"type":"v1","addr":"172.21.15.173:6835","nonce":4213841901}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7}],"filesystems":[{"mdsmap":{"epoch":29,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-03-27T08:32:46.030344+0000","modified":"2024-03-27T08:37:38.504071+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":34502,"mds_1":34463,"mds_2":34430},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24448":{"gid":24448,"name":"c","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6837/3514225451","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6836","nonce":3514225451},{"type":"v1","addr":"172.21.15.173:6837","nonce":3514225451}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.173:6839/2691398042","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6838","nonce":2691398042},{"type":"v1","addr":"172.21.15.173:6839","nonce":2691398042}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34403":{"gid":34403,"name":"k","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6833/2990296948","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":2990296948},{"type":"v1","addr":"172.21.15.167:6833","nonce":2990296948}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34430":{"gid":34430,"name":"e","rank":2,"incarnation":21,"state":"up:active","state_seq":11,"addr":"172.21.15.167:6835/2127625535","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":2127625535},{"type":"v1","addr":"172.21.15.167:6835","nonce":2127625535}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34463":{"gid":34463,"name":"h","rank":1,"incarnation":19,"state":"up:active","state_seq":80,"addr":"172.21.15.167:6837/3651037274","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3651037274},{"type":"v1","addr":"172.21.15.167:6837","nonce":3651037274}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34502":{"gid":34502,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":3,"addr":"172.21.15.167:6839/2821873023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2821873023},{"type":"v1","addr":"172.21.15.167:6839","nonce":2821873023}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34502,"qdb_cluster":[34430,34463,34502]},"id":1}]} 2024-03-27T08:38:06.932 INFO:teuthology.orchestra.run.smithi164.stderr:dumped fsmap epoch 29 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 msgr2=0x7f91680a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 0x7f91680a5b50 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9170005fd0 tx=0x7f9170005850 comp rx=0 tx=0).stop 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 msgr2=0x7f9184199e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f9174000c00 tx=0x7f9174004e20 comp rx=0 tx=0).stop 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 shutdown_connections 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f91680a3690 0x7f91680a5b50 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9184103510 0x7f91841a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.934 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f9184102b50 0x7f918419a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 --2- 172.21.15.164:0/1263914928 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f9184101960 0x7f9184199e40 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:06.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.942+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 >> 172.21.15.164:0/1263914928 conn(0x7f91840fceb0 msgr2=0x7f9184073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:06.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.943+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 shutdown_connections 2024-03-27T08:38:06.935 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:06.943+0000 7f9188e00640 1 -- 172.21.15.164:0/1263914928 wait complete. 2024-03-27T08:38:06.951 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:06 smithi164 ceph-mon[31788]: pgmap v524: 97 pgs: 97 active+clean; 126 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.5 MiB/s wr, 28 op/s 2024-03-27T08:38:06.954 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:2 damage ls 2024-03-27T08:38:07.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:06 smithi167 ceph-mon[34903]: pgmap v524: 97 pgs: 97 active+clean; 126 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.5 MiB/s wr, 28 op/s 2024-03-27T08:38:07.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:06 smithi173 ceph-mon[35397]: pgmap v524: 97 pgs: 97 active+clean; 126 MiB data, 790 MiB used, 1.0 TiB / 1.0 TiB avail; 197 KiB/s rd, 1.5 MiB/s wr, 28 op/s 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 -- 172.21.15.164:0/3797401720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710105940 msgr2=0x7f871010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 --2- 172.21.15.164:0/3797401720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710105940 0x7f871010c1d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f8708009ca0 tx=0x7f870802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 -- 172.21.15.164:0/3797401720 shutdown_connections 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 --2- 172.21.15.164:0/3797401720 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710105940 0x7f871010c1d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 --2- 172.21.15.164:0/3797401720 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 0x7f8710105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 --2- 172.21.15.164:0/3797401720 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710103d90 0x7f87101041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 -- 172.21.15.164:0/3797401720 >> 172.21.15.164:0/3797401720 conn(0x7f87100ff300 msgr2=0x7f8710101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 -- 172.21.15.164:0/3797401720 shutdown_connections 2024-03-27T08:38:07.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.187+0000 7f8718400640 1 -- 172.21.15.164:0/3797401720 wait complete. 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 Processor -- start 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 -- start start 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 0x7f871019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710105940 0x7f87101a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f871010f9e0 con 0x7f8710103d90 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f871010f860 con 0x7f8710105940 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.188+0000 7f8718400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f871010fb60 con 0x7f8710104f80 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.181 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56984/0 (socket says 172.21.15.164:56984) 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 -- 172.21.15.164:0/3888005238 learned_addr learned my addr 172.21.15.164:0/3888005238 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8716400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710105940 0x7f87101a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715000640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 0x7f871019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 -- 172.21.15.164:0/3888005238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 msgr2=0x7f871019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 0x7f871019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 -- 172.21.15.164:0/3888005238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710105940 msgr2=0x7f87101a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710105940 0x7f87101a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.189+0000 7f8715a00640 1 -- 172.21.15.164:0/3888005238 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87101a1c20 con 0x7f8710103d90 2024-03-27T08:38:07.182 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f8715a00640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f870400d770 tx=0x7f870400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f870e000640 1 -- 172.21.15.164:0/3888005238 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704017070 con 0x7f8710103d90 2024-03-27T08:38:07.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f870e000640 1 -- 172.21.15.164:0/3888005238 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8704009c30 con 0x7f8710103d90 2024-03-27T08:38:07.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87101a1f10 con 0x7f8710103d90 2024-03-27T08:38:07.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f870e000640 1 -- 172.21.15.164:0/3888005238 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704003e10 con 0x7f8710103d90 2024-03-27T08:38:07.183 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.190+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87101a2370 con 0x7f8710103d90 2024-03-27T08:38:07.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 Processor -- start 2024-03-27T08:38:07.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f870e000640 1 -- 172.21.15.164:0/3888005238 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f8704004020 con 0x7f8710103d90 2024-03-27T08:38:07.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 -- start start 2024-03-27T08:38:07.186 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 0x561f5196dce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f51973420 0x561f519758b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561f519357b0 con 0x561f5196e2b0 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561f518d2670 con 0x561f51973420 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.194+0000 7f871b065740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561f5187a970 con 0x561f5196d8c0 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8716400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 0x561f5196dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56992/0 (socket says 172.21.15.164:56992) 2024-03-27T08:38:07.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 -- 172.21.15.164:0/2573715280 learned_addr learned my addr 172.21.15.164:0/2573715280 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8716400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 0x561f5196dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:40058/0 (socket says 172.21.15.164:40058) 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715000640 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f51973420 0x561f519758b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 -- 172.21.15.164:0/2573715280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 msgr2=0x561f5196dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 0x561f5196dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 -- 172.21.15.164:0/2573715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f51973420 msgr2=0x561f519758b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f51973420 0x561f519758b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.195+0000 7f8715a00640 1 -- 172.21.15.164:0/2573715280 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f515e63f0 con 0x561f5196e2b0 2024-03-27T08:38:07.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f870e000640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 0x7f86f80a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f870e000640 1 -- 172.21.15.164:0/3888005238 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f87040cfb10 con 0x7f8710103d90 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f8715a00640 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f87040d3b90 tx=0x7f87040d3c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfcb1830fe1a7d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f8716400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 0x7f86f80a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f8702a00640 1 -- 172.21.15.164:0/2573715280 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704020020 con 0x561f5196e2b0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f8702a00640 1 -- 172.21.15.164:0/2573715280 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f870409c690 con 0x561f5196e2b0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.196+0000 7f8702a00640 1 -- 172.21.15.164:0/2573715280 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870409bd60 con 0x561f5196e2b0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 -- 172.21.15.164:0/2573715280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 msgr2=0x561f51972db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f8716400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 0x7f86f80a5ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8708006010 tx=0x7f8708004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f87040d3b90 tx=0x7f87040d3c80 comp rx=0 tx=0).stop 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 -- 172.21.15.164:0/2573715280 shutdown_connections 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f51973420 0x561f519758b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51972db0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.190 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 --2- 172.21.15.164:0/2573715280 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f5196d8c0 0x561f5196dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.197+0000 7f871b065740 1 -- 172.21.15.164:0/2573715280 >> 172.21.15.164:0/2573715280 conn(0x561f51968e30 msgr2=0x561f51969230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.198+0000 7f871b065740 1 -- 172.21.15.164:0/2573715280 shutdown_connections 2024-03-27T08:38:07.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.198+0000 7f871b065740 1 -- 172.21.15.164:0/2573715280 wait complete. 2024-03-27T08:38:07.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.198+0000 7f871b065740 1 -- start start 2024-03-27T08:38:07.191 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.198+0000 7f871b065740 1 Processor -- start 2024-03-27T08:38:07.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f51977a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x561f5188dca0 con 0x561f5196e2b0 2024-03-27T08:38:07.193 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561f518ce620 con 0x561f5196d8c0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x561f519763d0 con 0x561f51973420 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f871b065740 10 client.0 _ll_register_callbacks cb 0x561f518ca160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f51977a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56996/0 (socket says 172.21.15.164:56996) 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 -- 172.21.15.164:0/3319050023 learned_addr learned my addr 172.21.15.164:0/3319050023 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8716400640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 -- 172.21.15.164:0/3319050023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 msgr2=0x561f5197eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197eff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 -- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 msgr2=0x561f51977a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f51977a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.199+0000 7f8715000640 1 -- 172.21.15.164:0/3319050023 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f516b07d0 con 0x561f5196e2b0 2024-03-27T08:38:07.194 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f8715000640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f86fc011740 tx=0x7f86fc011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b097ad08a978556 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f86f7400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86fc01e060 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f86fc00fd50 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870409c690 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f86fc0193f0 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.200+0000 7f871b065740 10 client.16131 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f51982480 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f870409c690 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f86fc018030 con 0x561f5196e2b0 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 10 client.16131 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 10 client.16131 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 20 client.16131 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f51983bd0 0x561f51986070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 4 client.16131 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:07.195 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.201+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561f518dfbb0 con 0x561f51983bd0 2024-03-27T08:38:07.196 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.202+0000 7f8715a00640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f51983bd0 0x561f51986070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.202+0000 7f8715a00640 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f51983bd0 0x561f51986070 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e281a294cfaeb6e6 server_cookie=5607b3d94f43a837 in_seq=0 out_seq=0 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.202+0000 7f86f7400640 10 client.16131 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f86f7400640 1 -- 172.21.15.164:0/3319050023 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x561f518dfbb0 con 0x561f51983bd0 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f86f7400640 10 client.16131 handle_command_reply: tid=0 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 client.16131 shutdown 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 msgr2=0x561f51977fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f86fc011740 tx=0x7f86fc011c00 comp rx=0 tx=0).stop 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 shutdown_connections 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.197 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f51983bd0 0x561f51986070 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f51977fb0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 --2- 172.21.15.164:0/3319050023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f51977a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 >> 172.21.15.164:0/3319050023 conn(0x561f51968e30 msgr2=0x561f51968030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f86f7400640 0 client.16131 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 shutdown_connections 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 1 -- 172.21.15.164:0/3319050023 wait complete. 2024-03-27T08:38:07.198 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.204+0000 7f871b065740 20 client.16131 trim_cache size 0 max 16384 2024-03-27T08:38:07.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.220+0000 7f871b065740 1 Processor -- start 2024-03-27T08:38:07.221 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.220+0000 7f871b065740 1 -- start start 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196e2b0 0x561f5196fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f87101adb20 con 0x561f5196d8c0 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87101ab390 con 0x561f5196e2b0 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f871b065740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87101a91e0 con 0x561f51973420 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56998/0 (socket says 172.21.15.164:56998) 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 -- 172.21.15.164:0/3219371766 learned_addr learned my addr 172.21.15.164:0/3219371766 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715000640 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196e2b0 0x561f5196fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8716400640 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.222 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 -- 172.21.15.164:0/3219371766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 msgr2=0x561f5197efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 -- 172.21.15.164:0/3219371766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196e2b0 msgr2=0x561f5196fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.221+0000 7f8715a00640 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196e2b0 0x561f5196fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.222+0000 7f8715a00640 1 -- 172.21.15.164:0/3219371766 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f5196e690 con 0x561f5196d8c0 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.222+0000 7f8715a00640 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f87040983f0 tx=0x7f870400de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2f2a914e6ae6a69 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.222+0000 7f8702000640 1 -- 172.21.15.164:0/3219371766 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704020040 con 0x561f5196d8c0 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.222+0000 7f8702000640 1 -- 172.21.15.164:0/3219371766 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f870409bf90 con 0x561f5196d8c0 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.222+0000 7f8702000640 1 -- 172.21.15.164:0/3219371766 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f870409b8f0 con 0x561f5196d8c0 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- 172.21.15.164:0/3219371766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 msgr2=0x561f5196f5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f87040983f0 tx=0x7f870400de80 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- 172.21.15.164:0/3219371766 shutdown_connections 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196e2b0 0x561f5196fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 --2- 172.21.15.164:0/3219371766 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196d8c0 0x561f5196f5d0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.223 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- 172.21.15.164:0/3219371766 >> 172.21.15.164:0/3219371766 conn(0x561f51968e30 msgr2=0x561f51977a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- 172.21.15.164:0/3219371766 shutdown_connections 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- 172.21.15.164:0/3219371766 wait complete. 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.223+0000 7f871b065740 1 -- start start 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 Processor -- start 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f87101a9850 con 0x561f5196e2b0 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f87101aacc0 con 0x561f5196d8c0 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f87101a9f20 con 0x561f51973420 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f871b065740 10 client.0 _ll_register_callbacks cb 0x7f86fc00c690 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f8715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f8715a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f8715a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56438/0 (socket says 172.21.15.164:56438) 2024-03-27T08:38:07.224 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f8715000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57004/0 (socket says 172.21.15.164:57004) 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.224+0000 7f8715a00640 1 -- 172.21.15.164:0/2105374046 learned_addr learned my addr 172.21.15.164:0/2105374046 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8716400640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 -- 172.21.15.164:0/2105374046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 msgr2=0x561f5197d7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197d7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 -- 172.21.15.164:0/2105374046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 msgr2=0x561f5197c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 -- 172.21.15.164:0/2105374046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f5197dd90 con 0x561f5196d8c0 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715000640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8716400640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f8715a00640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8704003ff0 tx=0x7f87040cfd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6557f980d01c90d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f86f7400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8704020040 con 0x561f5196d8c0 2024-03-27T08:38:07.225 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f870409a290 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.225+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f870409bf90 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f870409bad0 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 10 client.35816 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x561f5197f090 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f870409bf90 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f8704004310 con 0x561f5196d8c0 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 10 client.35816 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 10 client.35816 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 20 client.35816 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f519ea0f0 0x561f519ec510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 4 client.35816 mds_command: new command op to 34430 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:38:07.226 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.226+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 --> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561f518d9f00 con 0x561f519ea0f0 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.227+0000 7f8715000640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f519ea0f0 0x561f519ec510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.227+0000 7f8715000640 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f519ea0f0 0x561f519ec510 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=23ebc9150a0e8737 server_cookie=7c48a9201b8e4ca0 in_seq=0 out_seq=0 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.227+0000 7f86f7400640 10 client.35816 ms_handle_connect on v2:172.21.15.167:6834/2127625535 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f86f7400640 1 -- 172.21.15.164:0/2105374046 <== mds.2 v2:172.21.15.167:6834/2127625535 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561f518d9f00 con 0x561f519ea0f0 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f86f7400640 10 client.35816 handle_command_reply: tid=0 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 client.35816 shutdown 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 msgr2=0x561f5197c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8704003ff0 tx=0x7f87040cfd90 comp rx=0 tx=0).stop 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 shutdown_connections 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x561f51973420 0x561f5197d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:6834/2127625535,v1:172.21.15.167:6835/2127625535] conn(0x561f519ea0f0 0x561f519ec510 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x561f5196e2b0 0x561f5197c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 --2- 172.21.15.164:0/2105374046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561f5196d8c0 0x561f5197c250 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.227 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f86f7400640 0 client.35816 ms_handle_reset on v2:172.21.15.167:6834/2127625535 2024-03-27T08:38:07.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 >> 172.21.15.164:0/2105374046 conn(0x561f51968e30 msgr2=0x561f51977a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 shutdown_connections 2024-03-27T08:38:07.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 1 -- 172.21.15.164:0/2105374046 wait complete. 2024-03-27T08:38:07.228 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.228+0000 7f871b065740 20 client.35816 trim_cache size 0 max 16384 2024-03-27T08:38:07.228 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 msgr2=0x7f86f80a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 0x7f86f80a5ad0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f8708006010 tx=0x7f8708004a40 comp rx=0 tx=0).stop 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 msgr2=0x7f871019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f870400d770 tx=0x7f870400dc30 comp rx=0 tx=0).stop 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 shutdown_connections 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f86f80a3610 0x7f86f80a5ad0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8710105940 0x7f87101a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.229 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f8710104f80 0x7f871019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 --2- 172.21.15.164:0/3888005238 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f8710103d90 0x7f871019a000 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 >> 172.21.15.164:0/3888005238 conn(0x7f87100ff300 msgr2=0x7f8710108280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 shutdown_connections 2024-03-27T08:38:07.230 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.229+0000 7f8718400640 1 -- 172.21.15.164:0/3888005238 wait complete. 2024-03-27T08:38:07.238 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:1 damage ls 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 -- 172.21.15.164:0/1213344085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e50100c00 msgr2=0x7f4e50101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1213344085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e50100c00 0x7f4e50101060 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009ca0 tx=0x7f4e4002c100 comp rx=0 tx=0).stop 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 -- 172.21.15.164:0/1213344085 shutdown_connections 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1213344085 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e501015a0 0x7f4e50101a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1213344085 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e50100c00 0x7f4e50101060 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1213344085 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 0x7f4e501006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 -- 172.21.15.164:0/1213344085 >> 172.21.15.164:0/1213344085 conn(0x7f4e500fbec0 msgr2=0x7f4e500fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 -- 172.21.15.164:0/1213344085 shutdown_connections 2024-03-27T08:38:07.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.453+0000 7f4e4f200640 1 -- 172.21.15.164:0/1213344085 wait complete. 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.454+0000 7f4e4f200640 1 Processor -- start 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 -- start start 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 0x7f4e50199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 0x7f4e5019a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5010f8a0 con 0x7f4e501015a0 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5010f720 con 0x7f4e50100c00 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e5010fa20 con 0x7f4e501002a0 2024-03-27T08:38:07.447 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 0x7f4e5019a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57028/0 (socket says 172.21.15.164:57028) 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4e800640 1 -- 172.21.15.164:0/1001748663 learned_addr learned my addr 172.21.15.164:0/1001748663 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.455+0000 7f4e4de00640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 0x7f4e50199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 -- 172.21.15.164:0/1001748663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 msgr2=0x7f4e50199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 0x7f4e50199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 -- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 msgr2=0x7f4e501a14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 -- 172.21.15.164:0/1001748663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e501a1b50 con 0x7f4e50100c00 2024-03-27T08:38:07.448 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4e800640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.456+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 0x7f4e5019a470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009bf0 tx=0x7f4e40034cd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.457+0000 7f4e46a00640 1 -- 172.21.15.164:0/1001748663 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40039050 con 0x7f4e50100c00 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.457+0000 7f4e46a00640 1 -- 172.21.15.164:0/1001748663 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e4003a040 con 0x7f4e50100c00 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.457+0000 7f4e46a00640 1 -- 172.21.15.164:0/1001748663 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40004790 con 0x7f4e50100c00 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.457+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e501a1de0 con 0x7f4e50100c00 2024-03-27T08:38:07.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.457+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e501a21f0 con 0x7f4e50100c00 2024-03-27T08:38:07.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 Processor -- start 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e46a00640 1 -- 172.21.15.164:0/1001748663 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4e40003970 con 0x7f4e50100c00 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 -- start start 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43dcab0 0x55e2d43dced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2d43a47b0 con 0x55e2d43e2610 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e2d4341670 con 0x55e2d43dd4a0 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.460+0000 7f4e579a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e2d42e9970 con 0x55e2d43dcab0 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56474/0 (socket says 172.21.15.164:56474) 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 -- 172.21.15.164:0/2479755525 learned_addr learned my addr 172.21.15.164:0/2479755525 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4d400640 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4e800640 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43dcab0 0x55e2d43dced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 -- 172.21.15.164:0/2479755525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43dcab0 msgr2=0x55e2d43dced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43dcab0 0x55e2d43dced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 -- 172.21.15.164:0/2479755525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 msgr2=0x55e2d43e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.461+0000 7f4e4de00640 1 -- 172.21.15.164:0/2479755525 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d40553f0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e4de00640 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800bcf0 tx=0x7f4e3800f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=becfc75c7b16c727 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e46a00640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 0x7f4e340a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e46a00640 1 -- 172.21.15.164:0/1001748663 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4e400f2550 con 0x7f4e50100c00 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e3f000640 1 -- 172.21.15.164:0/2479755525 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38015070 con 0x55e2d43dd4a0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e4e800640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 0x7f4e340a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e3f000640 1 -- 172.21.15.164:0/2479755525 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e38011910 con 0x55e2d43dd4a0 2024-03-27T08:38:07.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.462+0000 7f4e3f000640 1 -- 172.21.15.164:0/2479755525 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38010920 con 0x55e2d43dd4a0 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 -- 172.21.15.164:0/2479755525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 msgr2=0x55e2d43e1fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e4e800640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 0x7f4e340a5ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55e2d43ddd00 tx=0x7f4e48005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800bcf0 tx=0x7f4e3800f730 comp rx=0 tx=0).stop 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 -- 172.21.15.164:0/2479755525 shutdown_connections 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e1fa0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.459 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 --2- 172.21.15.164:0/2479755525 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43dcab0 0x55e2d43dced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 -- 172.21.15.164:0/2479755525 >> 172.21.15.164:0/2479755525 conn(0x55e2d43d8020 msgr2=0x55e2d43d8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 -- 172.21.15.164:0/2479755525 shutdown_connections 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.463+0000 7f4e579a8740 1 -- 172.21.15.164:0/2479755525 wait complete. 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 -- start start 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 Processor -- start 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43ee160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55e2d42fcca0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e2d433d620 con 0x55e2d43dcab0 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55e2d43e55c0 con 0x55e2d43e2610 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.464+0000 7f4e579a8740 10 client.0 _ll_register_callbacks cb 0x55e2d4339160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.460 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57046/0 (socket says 172.21.15.164:57046) 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 -- 172.21.15.164:0/307737674 learned_addr learned my addr 172.21.15.164:0/307737674 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4e800640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43ee160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 -- 172.21.15.164:0/307737674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 msgr2=0x55e2d43ee160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43ee160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 -- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 msgr2=0x55e2d43e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 -- 172.21.15.164:0/307737674 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2d411f7d0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4e800640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e4d400640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4e400be960 tx=0x7f4e40032ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d71018e96bf31 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.465+0000 7f4e33400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400be510 con 0x55e2d43dd4a0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4e40003c60 con 0x55e2d43dd4a0 2024-03-27T08:38:07.461 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e38011910 con 0x55e2d43dd4a0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e400be330 con 0x55e2d43dd4a0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e579a8740 10 client.16149 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2d43f14d0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e38011910 con 0x55e2d43dd4a0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.466+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4e400c71b0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 10 client.16149 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 10 client.16149 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 20 client.16149 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d43f2ca0 0x55e2d43f50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 4 client.16149 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e2d434ebb0 con 0x55e2d43f2ca0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.467+0000 7f4e4de00640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d43f2ca0 0x55e2d43f50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.462 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.468+0000 7f4e4de00640 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d43f2ca0 0x55e2d43f50d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a6269bddc8ee1e25 server_cookie=8d5c7030aa239c10 in_seq=0 out_seq=0 2024-03-27T08:38:07.463 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.468+0000 7f4e33400640 10 client.16149 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e33400640 1 -- 172.21.15.164:0/307737674 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55e2d434ebb0 con 0x55e2d43f2ca0 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e33400640 10 client.16149 handle_command_reply: tid=0 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 client.16149 shutdown 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 msgr2=0x55e2d43e7120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f4e400be960 tx=0x7f4e40032ab0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 shutdown_connections 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d43f2ca0 0x55e2d43f50d0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43ee160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43e7120 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 --2- 172.21.15.164:0/307737674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43e6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 >> 172.21.15.164:0/307737674 conn(0x55e2d43d8020 msgr2=0x55e2d43d7240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.464 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e33400640 0 client.16149 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:38:07.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.469+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 shutdown_connections 2024-03-27T08:38:07.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.470+0000 7f4e579a8740 1 -- 172.21.15.164:0/307737674 wait complete. 2024-03-27T08:38:07.465 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.470+0000 7f4e579a8740 20 client.16149 trim_cache size 0 max 16384 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 Processor -- start 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 -- start start 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501ad880 con 0x55e2d43dd4a0 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501ab0f0 con 0x55e2d43dcab0 2024-03-27T08:38:07.480 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.488+0000 7f4e579a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501a8f40 con 0x55e2d43e2610 2024-03-27T08:38:07.481 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57054/0 (socket says 172.21.15.164:57054) 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56492/0 (socket says 172.21.15.164:56492) 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4d400640 1 -- 172.21.15.164:0/3251015800 learned_addr learned my addr 172.21.15.164:0/3251015800 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4e800640 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 -- 172.21.15.164:0/3251015800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 msgr2=0x55e2d43d6ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43d6ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 -- 172.21.15.164:0/3251015800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 msgr2=0x55e2d43ee120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4de00640 1 -- 172.21.15.164:0/3251015800 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e2d43d8d90 con 0x55e2d43dcab0 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.489+0000 7f4e4d400640 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.490+0000 7f4e4de00640 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55e2d43d8f90 tx=0x7f4e38005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6492270f5c3da6bd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.482 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.490+0000 7f4e3e600640 1 -- 172.21.15.164:0/3251015800 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38015040 con 0x55e2d43dcab0 2024-03-27T08:38:07.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.490+0000 7f4e3e600640 1 -- 172.21.15.164:0/3251015800 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e380055d0 con 0x55e2d43dcab0 2024-03-27T08:38:07.483 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.490+0000 7f4e3e600640 1 -- 172.21.15.164:0/3251015800 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e38004660 con 0x55e2d43dcab0 2024-03-27T08:38:07.484 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 -- 172.21.15.164:0/3251015800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 msgr2=0x55e2d43d69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x55e2d43d8f90 tx=0x7f4e38005850 comp rx=0 tx=0).stop 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 -- 172.21.15.164:0/3251015800 shutdown_connections 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43e2610 0x55e2d43d6ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43dd4a0 0x55e2d43ee120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 --2- 172.21.15.164:0/3251015800 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dcab0 0x55e2d43d69b0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 -- 172.21.15.164:0/3251015800 >> 172.21.15.164:0/3251015800 conn(0x55e2d43d8020 msgr2=0x55e2d43de6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 -- 172.21.15.164:0/3251015800 shutdown_connections 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.491+0000 7f4e579a8740 1 -- 172.21.15.164:0/3251015800 wait complete. 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 -- start start 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 Processor -- start 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.485 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43eca60 0x55e2d43ecee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501a95b0 con 0x55e2d43e2610 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501aaa20 con 0x55e2d43dd4a0 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501a9c80 con 0x55e2d43eca60 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.492+0000 7f4e579a8740 10 client.0 _ll_register_callbacks cb 0x7f4e400f5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56504/0 (socket says 172.21.15.164:56504) 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 -- 172.21.15.164:0/1569609654 learned_addr learned my addr 172.21.15.164:0/1569609654 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4e800640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43eca60 0x55e2d43ecee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 -- 172.21.15.164:0/1569609654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43eca60 msgr2=0x55e2d43ecee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43eca60 0x55e2d43ecee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 -- 172.21.15.164:0/1569609654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 msgr2=0x55e2d43eba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.486 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43eba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.487 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.493+0000 7f4e4de00640 1 -- 172.21.15.164:0/1569609654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e2d43ed420 con 0x55e2d43dd4a0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e4de00640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e380058c0 tx=0x7f4e3800bc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1e1c7f27497a740 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e33400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e3802b070 con 0x55e2d43dd4a0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e380055d0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4e380270d0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4e3800bde0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e579a8740 10 client.35834 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.494+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e2d4459090 con 0x55e2d43dd4a0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e380055d0 con 0x55e2d43dd4a0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f4e38011550 con 0x55e2d43dd4a0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 10 client.35834 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 10 client.35834 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 20 client.35834 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d4459740 0x55e2d445bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 4 client.35834 mds_command: new command op to 34463 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.495+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 --> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e2d43e69d0 con 0x55e2d4459740 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.496+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d4459740 0x55e2d445bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.496+0000 7f4e4d400640 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d4459740 0x55e2d445bb30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7c6647564c13aa5a server_cookie=8eba39438d2475f5 in_seq=0 out_seq=0 2024-03-27T08:38:07.490 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.496+0000 7f4e33400640 10 client.35834 ms_handle_connect on v2:172.21.15.167:6836/3651037274 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.509+0000 7f4e33400640 1 -- 172.21.15.164:0/1569609654 <== mds.1 v2:172.21.15.167:6836/3651037274 1 ==== command_reply(tid 0: 0 ) ==== 8+0+127227 (crc 0 0 0) 0x55e2d43e69d0 con 0x55e2d4459740 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.509+0000 7f4e33400640 10 client.35834 handle_command_reply: tid=0 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.509+0000 7f4e579a8740 1 client.35834 shutdown 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 msgr2=0x55e2d43eb510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4e380058c0 tx=0x7f4e3800bc10 comp rx=0 tx=0).stop 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 shutdown_connections 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:6836/3651037274,v1:172.21.15.167:6837/3651037274] conn(0x55e2d4459740 0x55e2d445bb30 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55e2d43eca60 0x55e2d43ecee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55e2d43e2610 0x55e2d43eba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e33400640 0 client.35834 ms_handle_reset on v2:172.21.15.167:6836/3651037274 2024-03-27T08:38:07.504 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 --2- 172.21.15.164:0/1569609654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e2d43dd4a0 0x55e2d43eb510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 >> 172.21.15.164:0/1569609654 conn(0x55e2d43d8020 msgr2=0x55e2d43db280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 shutdown_connections 2024-03-27T08:38:07.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 1 -- 172.21.15.164:0/1569609654 wait complete. 2024-03-27T08:38:07.505 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.510+0000 7f4e579a8740 20 client.35834 trim_cache size 0 max 16384 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout:[ 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 5326889, 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628529, 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab" 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.507 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 16474023, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628576, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl" 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 16734432, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628519, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio" 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.508 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 25525721, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628671, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml" 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 28960712, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628531, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo" 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 36851880, 2024-03-27T08:38:07.509 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628597, 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml" 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 53976579, 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628313, 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls" 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.510 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 59256520, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628665, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml" 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 75219623, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628584, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64" 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 75993470, 2024-03-27T08:38:07.511 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628567, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl" 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 82774325, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628465, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot" 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 125518724, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628574, 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl" 2024-03-27T08:38:07.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 132664277, 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628354, 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset" 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 133186312, 2024-03-27T08:38:07.513 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628447, 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host" 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 160877740, 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628471, 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun" 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.514 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 176464721, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628316, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb" 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 187940145, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628549, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp" 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 191318239, 2024-03-27T08:38:07.515 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628740, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml" 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 193528566, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628739, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml" 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 193761576, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628352, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial" 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.516 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 209411924, 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628713, 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml" 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 215390481, 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628524, 2024-03-27T08:38:07.517 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups" 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 218720976, 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628702, 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia" 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 219651657, 2024-03-27T08:38:07.518 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628493, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote" 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 222830865, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628523, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps" 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 224194955, 2024-03-27T08:38:07.519 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628783, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl" 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 236360599, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628379, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x" 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 259938793, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628715, 2024-03-27T08:38:07.520 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml" 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 270387006, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628680, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml" 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 283576312, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628353, 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink" 2024-03-27T08:38:07.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 286037318, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628515, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4" 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 293261876, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628326, 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp" 2024-03-27T08:38:07.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 306393156, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628786, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl" 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 327962998, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628730, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml" 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.523 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 330629477, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628540, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop" 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 336219192, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628720, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml" 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.524 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 341301324, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628476, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid" 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 343612669, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628384, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format" 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.525 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 343860037, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628716, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml" 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 349400086, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628361, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc" 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 354221065, 2024-03-27T08:38:07.526 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628294, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README" 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 361695922, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628747, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml" 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 374820090, 2024-03-27T08:38:07.527 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628687, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml" 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 375162288, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628623, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml" 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 385992974, 2024-03-27T08:38:07.528 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628322, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc" 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 390364411, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628454, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr" 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 391220569, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628412, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg" 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 396052736, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628757, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml" 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 398493185, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628601, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64" 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.530 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 400965181, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628450, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev" 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 403934609, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628530, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids" 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 404027959, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628600, 2024-03-27T08:38:07.531 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64" 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 407988121, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628634, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml" 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 411713475, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628521, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft" 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.532 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 423519560, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628761, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml" 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 426454454, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628764, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml" 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.533 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 430267024, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628561, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore" 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 442115634, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628551, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf" 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 443231271, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628603, 2024-03-27T08:38:07.534 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64" 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 447600586, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628775, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64" 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 456574714, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628511, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap" 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 456947283, 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628569, 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl" 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 462640865, 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628586, 2024-03-27T08:38:07.536 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore" 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 466387764, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628334, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp" 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 468564961, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628355, 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1" 2024-03-27T08:38:07.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 471865969, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628514, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv" 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 473050279, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628564, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl" 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.538 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 516380127, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628522, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params" 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 518762524, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628510, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log" 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 522547379, 2024-03-27T08:38:07.539 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628788, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl" 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 522749443, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628537, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91" 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 538037645, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628307, 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb" 2024-03-27T08:38:07.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 548250870, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628372, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm" 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 564953695, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628440, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd" 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.541 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 582534598, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628746, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml" 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 591039373, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628500, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse" 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.542 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 603249780, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628776, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl" 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 650852592, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628592, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf" 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 668503019, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628390, 2024-03-27T08:38:07.543 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352" 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 680905020, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628538, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb" 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 696402450, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628467, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state" 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.544 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 705286508, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628792, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl" 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 707586443, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628774, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64" 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 714314247, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628542, 2024-03-27T08:38:07.545 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim" 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 714335095, 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628689, 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml" 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.546 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 715407277, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628769, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml" 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 735627410, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628660, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml" 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 736421911, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628738, 2024-03-27T08:38:07.547 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml" 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 753952361, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628396, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160" 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 754339270, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628686, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml" 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.548 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 755495444, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628513, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi" 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 784324662, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628466, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup" 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.549 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 791344572, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628736, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml" 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 797802259, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628436, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan" 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 800489051, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628594, 2024-03-27T08:38:07.550 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml" 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 806161568, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628643, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml" 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 809843244, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628663, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml" 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.551 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 813189146, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628473, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl" 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 817830337, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628543, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop" 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.552 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 838992576, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628475, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe" 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 843632800, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628329, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04" 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 849231694, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628393, 2024-03-27T08:38:07.553 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150" 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 854518448, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628380, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel" 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 890559579, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628545, 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500" 2024-03-27T08:38:07.554 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 891668063, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628756, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml" 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 893163050, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628300, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus" 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.555 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 909038657, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628703, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg" 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 914975447, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628520, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085" 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 943153297, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628532, 2024-03-27T08:38:07.556 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline" 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 961375653, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628731, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml" 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 973904804, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628446, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration" 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.557 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 982026901, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628737, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml" 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 995290896, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628426, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd" 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.558 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1004790302, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628448, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc" 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1007143645, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628400, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs" 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1011104561, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628602, 2024-03-27T08:38:07.559 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64" 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1015386216, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628694, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml" 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1027549755, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628502, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom" 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.560 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1039540850, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628677, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml" 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1041722178, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628421, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq" 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1070614653, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628472, 2024-03-27T08:38:07.561 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu" 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1072605412, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628782, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl" 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1097416132, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628402, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media" 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.562 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1098879130, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628571, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl" 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1109851814, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628546, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power" 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1120135231, 2024-03-27T08:38:07.563 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628704, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia" 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1121383645, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628708, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml" 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1123155324, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628488, 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua" 2024-03-27T08:38:07.564 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1127259840, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628371, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache" 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1135934719, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628693, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml" 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.565 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1149665048, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628310, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable" 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1153808644, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628512, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw" 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1154866484, 2024-03-27T08:38:07.566 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628333, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module" 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1156702322, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628536, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi" 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1159157122, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628383, 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events" 2024-03-27T08:38:07.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1160551444, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628750, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml" 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1161404744, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628356, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2" 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.568 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1167859299, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628657, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml" 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1179721680, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628709, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml" 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.569 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1186289530, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628615, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml" 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1198569485, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628347, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi" 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1205943744, 2024-03-27T08:38:07.570 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628691, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml" 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1233017159, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628321, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi" 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1248725402, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628373, 2024-03-27T08:38:07.571 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd" 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1250061329, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628457, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online" 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1266516479, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628550, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty" 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.572 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1283342304, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628710, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf" 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1324632220, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628442, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap" 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.573 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1340145981, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628698, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml" 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1340948206, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628670, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml" 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1347993561, 2024-03-27T08:38:07.574 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628461, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power" 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1365555759, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628624, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml" 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1365812488, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628342, 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem" 2024-03-27T08:38:07.575 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1371043520, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628575, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl" 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1377550616, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628587, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml" 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.576 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1379047524, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628596, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml" 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1380182911, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628482, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo" 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1390051726, 2024-03-27T08:38:07.577 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628328, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc" 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1423513531, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628504, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront" 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1432253258, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628585, 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb" 2024-03-27T08:38:07.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1437367286, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628752, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml" 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1443719957, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628622, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml" 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.579 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1452758631, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628495, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start" 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1457892546, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628489, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra" 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1463585675, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628424, 2024-03-27T08:38:07.580 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu" 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1464609000, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628525, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch" 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1481306961, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628754, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml" 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.581 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1489774066, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628408, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd" 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1498531500, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628573, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl" 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.582 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1503907668, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628533, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module" 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1508566832, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628397, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als" 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1509394831, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628517, 2024-03-27T08:38:07.583 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2" 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1514555262, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628518, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs" 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1522130798, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628572, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl" 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.584 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1524654879, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628633, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml" 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1530586589, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628485, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus" 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1532577098, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628358, 2024-03-27T08:38:07.585 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe" 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1534852513, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628632, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml" 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1539025537, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628548, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling" 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.586 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1555891333, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628499, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid" 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1559028340, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628389, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480" 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.587 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1569111359, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628394, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523" 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1570694050, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628414, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port" 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.588 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1585719255, 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628395, 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350" 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1601373133, 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628535, 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop" 2024-03-27T08:38:07.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1615947037, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628486, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure" 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1649661696, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628627, 2024-03-27T08:38:07.590 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml" 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1671944980, 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628566, 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl" 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1679935396, 2024-03-27T08:38:07.591 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628589, 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml" 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1686861491, 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628728, 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml" 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.592 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1706226572, 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628314, 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile" 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1708441853, 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628388, 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi" 2024-03-27T08:38:07.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1713514450, 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628509, 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi" 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1714833027, 2024-03-27T08:38:07.594 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628606, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l" 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1725193109, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628734, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml" 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1728725180, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628721, 2024-03-27T08:38:07.595 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml" 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1733445079, 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628733, 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml" 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.596 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1741541710, 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628706, 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia" 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1755649697, 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628771, 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml" 2024-03-27T08:38:07.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1761954462, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628391, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533" 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1781005025, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628759, 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml" 2024-03-27T08:38:07.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1809011220, 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628685, 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml" 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.599 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1811253866, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628701, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml" 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1819165803, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628419, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi" 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.600 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1827096835, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628628, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml" 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1838669540, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628629, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml" 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1850209351, 2024-03-27T08:38:07.601 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628305, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue" 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1860708115, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628770, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml" 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1886547438, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628563, 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile" 2024-03-27T08:38:07.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1912526241, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628578, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl" 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1913498409, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628403, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei" 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.603 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1916751094, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628705, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg" 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1932054750, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628570, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl" 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1944062533, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628297, 2024-03-27T08:38:07.604 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb" 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1945798116, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628577, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl" 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1957864343, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628505, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi" 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.605 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1958029490, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628346, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage" 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1969033068, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628417, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870" 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.606 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1976546276, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628341, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm" 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 1986914078, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628410, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc" 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2001276760, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628441, 2024-03-27T08:38:07.607 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power" 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2015735419, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628298, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill" 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2021265279, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628413, 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest" 2024-03-27T08:38:07.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2044351438, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628562, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl" 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2045230008, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628343, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs" 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.609 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2047137199, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628636, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml" 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2051868477, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628718, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml" 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.610 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2057528187, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628676, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml" 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2080844036, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628330, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars" 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.611 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2082292991, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628639, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml" 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2090499878, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628609, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml" 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2096259097, 2024-03-27T08:38:07.612 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628748, 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml" 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2098262735, 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628755, 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml" 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.613 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2098724907, 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628416, 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class" 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2102499426, 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628336, 2024-03-27T08:38:07.614 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso" 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2108328218, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628588, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml" 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2108344810, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628478, 2024-03-27T08:38:07.615 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff" 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2110519082, 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628463, 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1" 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2133568381, 2024-03-27T08:38:07.616 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628363, 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd" 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2140213680, 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628345, 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback" 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.617 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2141020306, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628618, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml" 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2158508917, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628649, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml" 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.618 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2165834382, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628684, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml" 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2175459211, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628722, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml" 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.619 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2180473573, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628664, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml" 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2186030571, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628608, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml" 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2196797231, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628382, 2024-03-27T08:38:07.620 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css" 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2204075384, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628387, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe" 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2210056581, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628678, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml" 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.621 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2223519345, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628437, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh" 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2225938014, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628763, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml" 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.622 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2227493547, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628418, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533" 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2228171209, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628331, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump" 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.623 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2233619748, 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628349, 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex" 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2282541169, 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628335, 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification" 2024-03-27T08:38:07.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2305181852, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628749, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml" 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2319281201, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628490, 2024-03-27T08:38:07.625 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos" 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2324172703, 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628593, 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml" 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.626 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2335994175, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628539, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg" 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2350162609, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628516, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs" 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.627 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2357672424, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628323, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node" 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2360329123, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628368, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore" 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.628 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2390377383, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628742, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml" 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2413438079, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628487, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus" 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.629 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2414345213, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628667, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml" 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2414483846, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628338, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget" 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.630 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2428952266, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628365, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm" 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2429289823, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628768, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml" 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.631 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2455835194, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628295, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete" 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2458057062, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628777, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl" 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2458398003, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628630, 2024-03-27T08:38:07.632 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf" 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2463825436, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628445, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator" 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2464789952, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628501, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi" 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.633 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2470482137, 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628374, 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram" 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2477922280, 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628302, 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed" 2024-03-27T08:38:07.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2486562689, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628432, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd" 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2496772018, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628679, 2024-03-27T08:38:07.635 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml" 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2504438367, 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628449, 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc" 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.636 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2521091346, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628751, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml" 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2525565405, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628766, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml" 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.637 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2529018195, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628638, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml" 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2534684462, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628351, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis" 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.638 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2537918619, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628369, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata" 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2544143775, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628697, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml" 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2579214324, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628503, 2024-03-27T08:38:07.639 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback" 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2605848104, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628453, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node" 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2622225945, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628340, 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm" 2024-03-27T08:38:07.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2628689255, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628337, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing" 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2629906520, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628619, 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml" 2024-03-27T08:38:07.641 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2633153885, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628319, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill" 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2643658977, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628481, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys" 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.642 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2662263592, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628675, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml" 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2698442837, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628758, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml" 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.643 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2708473977, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628724, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml" 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2710310959, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628404, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci" 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.644 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2710427981, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628717, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml" 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2718095375, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628494, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek" 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2722281824, 2024-03-27T08:38:07.645 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628474, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu" 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2723404076, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628480, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd" 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2727210232, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628591, 2024-03-27T08:38:07.646 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml" 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2767115298, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628357, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc" 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2768760912, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628644, 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml" 2024-03-27T08:38:07.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2769511657, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628303, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs" 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2774134528, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628544, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb" 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.648 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2781627391, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628456, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc" 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2781811165, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628444, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc" 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2783735833, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628498, 2024-03-27T08:38:07.649 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop" 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2784746741, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628655, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml" 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2804118553, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628296, 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads" 2024-03-27T08:38:07.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2820922792, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628662, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml" 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2825254029, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628443, 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm" 2024-03-27T08:38:07.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2833153833, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628364, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg" 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2833727152, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628727, 2024-03-27T08:38:07.652 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml" 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2845499039, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628762, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml" 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2852384898, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628780, 2024-03-27T08:38:07.653 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl" 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2855069243, 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628398, 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050" 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2875908800, 2024-03-27T08:38:07.654 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628620, 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml" 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2881150114, 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628725, 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml" 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.655 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2901760538, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628614, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml" 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2905974224, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628743, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml" 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.656 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2911508853, 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628688, 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml" 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2914466575, 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628547, 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps" 2024-03-27T08:38:07.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2921083952, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628304, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394" 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2937361088, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628344, 2024-03-27T08:38:07.658 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid" 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2957798040, 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628491, 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu" 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.659 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2964176197, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628695, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml" 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2965244600, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628309, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394" 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.660 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2972003914, 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628507, 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi" 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2972022730, 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628359, 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec" 2024-03-27T08:38:07.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2988233421, 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628433, 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net" 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 2996034217, 2024-03-27T08:38:07.662 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628673, 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml" 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3027849189, 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628726, 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml" 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.663 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3037004272, 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628621, 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml" 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3047072873, 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628425, 2024-03-27T08:38:07.664 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu" 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3057506438, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628458, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget" 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3069778401, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628789, 2024-03-27T08:38:07.665 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl" 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3072912959, 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628723, 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml" 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3094016885, 2024-03-27T08:38:07.666 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628311, 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev" 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3094482044, 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628745, 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml" 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.667 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3096758995, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628645, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml" 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3102343810, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628654, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf" 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.668 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3106426370, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628470, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc" 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3115923047, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628672, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml" 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.669 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3116440311, 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628682, 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml" 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3124071871, 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628650, 2024-03-27T08:38:07.670 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml" 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3128991785, 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628779, 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl" 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.671 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3134080091, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628712, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf" 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3134953367, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628508, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map" 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3154915987, 2024-03-27T08:38:07.672 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628582, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64" 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3158068031, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628659, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml" 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3164529838, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628332, 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog" 2024-03-27T08:38:07.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3176045094, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628452, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac" 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3185400718, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628778, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl" 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.674 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3185823279, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628320, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm" 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3191401978, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628411, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb" 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.675 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3193665388, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628772, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml" 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3221352688, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628484, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone" 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3221954738, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628699, 2024-03-27T08:38:07.676 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml" 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3224867392, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628376, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba" 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3244353822, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628528, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm" 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.677 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3261787151, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628787, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl" 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3266057023, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628700, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml" 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.678 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3274143199, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628378, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10" 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3274507389, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628666, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml" 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3287405237, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628635, 2024-03-27T08:38:07.679 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml" 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3317860900, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628360, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad" 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3329173448, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628459, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3" 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.680 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3332328281, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628362, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto" 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3333716563, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628681, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml" 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.681 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3341778796, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628439, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics" 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3353694687, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628370, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block" 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3354905209, 2024-03-27T08:38:07.682 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628581, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile" 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3359290274, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628767, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml" 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3361255543, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628784, 2024-03-27T08:38:07.683 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl" 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3362299038, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628350, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet" 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3382601876, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628460, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb" 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.684 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3385308961, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628568, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl" 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3391007135, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628375, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi" 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3418132249, 2024-03-27T08:38:07.685 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628325, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory" 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3425083525, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628607, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore" 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3429283455, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628646, 2024-03-27T08:38:07.686 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml" 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3434124425, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628420, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl" 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3449350833, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628422, 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon" 2024-03-27T08:38:07.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3451180166, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628598, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml" 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3459332940, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628590, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml" 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.688 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3465963780, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628661, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml" 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3469400443, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628318, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight" 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.689 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3470622872, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628653, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml" 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3473090282, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628301, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra" 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3481092150, 2024-03-27T08:38:07.690 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628428, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533" 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3489863813, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628580, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media" 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3495351621, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628367, 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats" 2024-03-27T08:38:07.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3500546778, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628613, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf" 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3506079007, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628692, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml" 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.692 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3522300511, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628496, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback" 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3524756347, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628479, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch" 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3529954703, 2024-03-27T08:38:07.693 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628430, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei" 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3531999546, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628381, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc" 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3534106435, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628741, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml" 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.694 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3540264070, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628327, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx" 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3546291310, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628492, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1" 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.695 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3547859084, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628579, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl" 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3548108327, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628626, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml" 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3563461260, 2024-03-27T08:38:07.696 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628541, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop" 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3573020864, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628409, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg" 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3589816726, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628468, 2024-03-27T08:38:07.697 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state" 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3601352488, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628415, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency" 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3610614997, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628637, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml" 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.698 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3610896475, 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628604, 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64" 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3621806578, 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628299, 2024-03-27T08:38:07.699 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus" 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3631081008, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628625, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml" 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3637333253, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628527, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages" 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.700 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3640292809, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628651, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml" 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3648258041, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628386, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci" 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.701 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3649047520, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628308, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394" 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3656148852, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628435, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm" 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3667524918, 2024-03-27T08:38:07.702 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628612, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml" 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3691225029, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628674, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml" 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3695051170, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628348, 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm" 2024-03-27T08:38:07.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3697452069, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628765, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml" 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3701244256, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628483, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku" 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.704 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3721337405, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628690, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml" 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3729960136, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628434, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv" 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3757455161, 2024-03-27T08:38:07.705 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628583, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64" 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3765535914, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628669, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml" 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3767758815, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628631, 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf" 2024-03-27T08:38:07.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3772296229, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628407, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform" 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3773902003, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628641, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml" 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.707 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3780422855, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628506, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi" 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3781997836, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628595, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml" 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3782428049, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628423, 2024-03-27T08:38:07.708 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu" 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3785458096, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628753, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml" 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3787905378, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628306, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma" 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.709 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3808031357, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628565, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl" 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3816498050, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628781, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl" 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3821319186, 2024-03-27T08:38:07.710 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628785, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl" 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3821618118, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628610, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml" 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3822763882, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628791, 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl" 2024-03-27T08:38:07.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3825467174, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628366, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy" 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3836815545, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628462, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0" 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.712 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3846564528, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628324, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu" 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3847256364, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628729, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml" 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3860083039, 2024-03-27T08:38:07.713 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628438, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues" 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3860627505, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628317, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend" 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3865736325, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628683, 2024-03-27T08:38:07.714 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml" 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3868137099, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628377, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma" 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3911367815, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628392, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio" 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.715 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3912956529, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628339, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget" 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3937071842, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628399, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935" 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.716 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3942547644, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628427, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led" 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3948175243, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628668, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml" 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.717 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3962967583, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628714, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml" 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3978624889, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628534, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2" 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3987990695, 2024-03-27T08:38:07.718 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628431, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt" 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3991064475, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628526, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm" 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 3999506971, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628648, 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml" 2024-03-27T08:38:07.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4012179745, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628640, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml" 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4022925789, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628401, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio" 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.720 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4025313739, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628611, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml" 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4031604059, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628315, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire" 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4032609182, 2024-03-27T08:38:07.721 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628656, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml" 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4033414664, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628455, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory" 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4044175463, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628617, 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml" 2024-03-27T08:38:07.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4058251471, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628732, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml" 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4062158822, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628616, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml" 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.723 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4069351226, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628790, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl" 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4072615113, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628735, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml" 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4086906456, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628469, 2024-03-27T08:38:07.724 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use" 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4096304394, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628658, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml" 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4113838156, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628652, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml" 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.725 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4138559981, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628707, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg" 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4159123320, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628642, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml" 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4164271539, 2024-03-27T08:38:07.726 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628497, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi" 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4176281592, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628312, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb" 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4177552439, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628451, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices" 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.727 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4178879742, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628744, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml" 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4200375428, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628760, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml" 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.728 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4204673878, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628406, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd" 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4206228966, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628719, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml" 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4215044946, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628464, 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2" 2024-03-27T08:38:07.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4223832281, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628385, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7" 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4231766416, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628605, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64" 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.730 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4234748762, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628696, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml" 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4248797086, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628711, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf" 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4252355609, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628599, 2024-03-27T08:38:07.731 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64" 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4255913582, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628429, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r" 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4261370617, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628405, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss" 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.732 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4280976093, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628647, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml" 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4284718832, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628477, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo" 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "damage_type": "backtrace", 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "id": 4287018041, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "ino": 1099511628773, 2024-03-27T08:38:07.733 INFO:teuthology.orchestra.run.smithi164.stdout: "path": "/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64" 2024-03-27T08:38:07.734 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:38:07.734 INFO:teuthology.orchestra.run.smithi164.stdout:] 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 msgr2=0x7f4e340a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 0x7f4e340a5ad0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x55e2d43ddd00 tx=0x7f4e48005f90 comp rx=0 tx=0).stop 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 msgr2=0x7f4e5019a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 0x7f4e5019a470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009bf0 tx=0x7f4e40034cd0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 shutdown_connections 2024-03-27T08:38:07.735 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e340a3610 0x7f4e340a5ad0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e501015a0 0x7f4e501a14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50100c00 0x7f4e5019a470 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 --2- 172.21.15.164:0/1001748663 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e501002a0 0x7f4e50199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.511+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 >> 172.21.15.164:0/1001748663 conn(0x7f4e500fbec0 msgr2=0x7f4e500fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.512+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 shutdown_connections 2024-03-27T08:38:07.736 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.512+0000 7f4e4f200640 1 -- 172.21.15.164:0/1001748663 wait complete. 2024-03-27T08:38:07.737 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.1:0 damage ls 2024-03-27T08:38:07.825 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:07 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1263914928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:38:07.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 -- 172.21.15.164:0/4283410045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f01024b0 msgr2=0x7fc2f01048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 --2- 172.21.15.164:0/4283410045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f01024b0 0x7fc2f01048a0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009900 tx=0x7fc2e402bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:07.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 -- 172.21.15.164:0/4283410045 shutdown_connections 2024-03-27T08:38:07.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 --2- 172.21.15.164:0/4283410045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0107710 0x7fc2f0109b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.980 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 --2- 172.21.15.164:0/4283410045 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f0104de0 0x7fc2f01071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 --2- 172.21.15.164:0/4283410045 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f01024b0 0x7fc2f01048a0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 -- 172.21.15.164:0/4283410045 >> 172.21.15.164:0/4283410045 conn(0x7fc2f00fbec0 msgr2=0x7fc2f00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 -- 172.21.15.164:0/4283410045 shutdown_connections 2024-03-27T08:38:07.981 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.988+0000 7fc2f6800640 1 -- 172.21.15.164:0/4283410045 wait complete. 2024-03-27T08:38:07.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.989+0000 7fc2f6800640 1 Processor -- start 2024-03-27T08:38:07.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.989+0000 7fc2f6800640 1 -- start start 2024-03-27T08:38:07.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f01024b0 0x7fc2f0199fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0104de0 0x7fc2f019a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f010d6b0 con 0x7fc2f0107710 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f010d530 con 0x7fc2f0104de0 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f6800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f010d830 con 0x7fc2f01024b0 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f5e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f5e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57076/0 (socket says 172.21.15.164:57076) 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f5e00640 1 -- 172.21.15.164:0/1791019042 learned_addr learned my addr 172.21.15.164:0/1791019042 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0104de0 0x7fc2f019a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.990+0000 7fc2f5400640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f01024b0 0x7fc2f0199fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 -- 172.21.15.164:0/1791019042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f01024b0 msgr2=0x7fc2f0199fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f01024b0 0x7fc2f0199fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 -- 172.21.15.164:0/1791019042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0104de0 msgr2=0x7fc2f019a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0104de0 0x7fc2f019a4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 -- 172.21.15.164:0/1791019042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f01a1bd0 con 0x7fc2f0107710 2024-03-27T08:38:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800eaa0 tx=0x7fc2e800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2ee000640 1 -- 172.21.15.164:0/1791019042 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e800cdb0 con 0x7fc2f0107710 2024-03-27T08:38:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2ee000640 1 -- 172.21.15.164:0/1791019042 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e8005020 con 0x7fc2f0107710 2024-03-27T08:38:07.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f01a1ec0 con 0x7fc2f0107710 2024-03-27T08:38:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.991+0000 7fc2ee000640 1 -- 172.21.15.164:0/1791019042 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e80116b0 con 0x7fc2f0107710 2024-03-27T08:38:07.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.992+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f01a2380 con 0x7fc2f0107710 2024-03-27T08:38:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2ee000640 1 -- 172.21.15.164:0/1791019042 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc2e80051d0 con 0x7fc2f0107710 2024-03-27T08:38:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 Processor -- start 2024-03-27T08:38:07.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 -- start start 2024-03-27T08:38:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 0x55ada2d6baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ada2d2b7b0 con 0x55ada2d69610 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ada2cc8670 con 0x55ada2d644a0 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.995+0000 7fc2faa36740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ada2c70970 con 0x55ada2d63ab0 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 0x55ada2d6baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 0x55ada2d6baa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57092/0 (socket says 172.21.15.164:57092) 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f4a00640 1 -- 172.21.15.164:0/1714765007 learned_addr learned my addr 172.21.15.164:0/1714765007 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:56526/0 (socket says 172.21.15.164:56526) 2024-03-27T08:38:07.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 -- 172.21.15.164:0/1714765007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 msgr2=0x55ada2d63ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d63ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 -- 172.21.15.164:0/1714765007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 msgr2=0x55ada2d6baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 0x55ada2d6baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.996+0000 7fc2f5400640 1 -- 172.21.15.164:0/1714765007 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada29dc3f0 con 0x55ada2d644a0 2024-03-27T08:38:07.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2ee000640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 0x7fc2d80a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2f5400640 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009230 tx=0x7fc2e40095e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e92c59e318d4e5ee server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2ee000640 1 -- 172.21.15.164:0/1791019042 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc2e80cfef0 con 0x7fc2f0107710 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 0x7fc2d80a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2e2600640 1 -- 172.21.15.164:0/1714765007 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e402cb20 con 0x55ada2d644a0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2e2600640 1 -- 172.21.15.164:0/1714765007 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e4005040 con 0x55ada2d644a0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.997+0000 7fc2e2600640 1 -- 172.21.15.164:0/1714765007 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4004920 con 0x55ada2d644a0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 -- 172.21.15.164:0/1714765007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 msgr2=0x55ada2d68fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 0x7fc2d80a5b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ada2d64d00 tx=0x7fc2dc013040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fc2e4009230 tx=0x7fc2e40095e0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 -- 172.21.15.164:0/1714765007 shutdown_connections 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d69610 0x55ada2d6baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d68fa0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 --2- 172.21.15.164:0/1714765007 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d63ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 -- 172.21.15.164:0/1714765007 >> 172.21.15.164:0/1714765007 conn(0x55ada2d5f020 msgr2=0x55ada2d5f420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 -- 172.21.15.164:0/1714765007 shutdown_connections 2024-03-27T08:38:07.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.998+0000 7fc2faa36740 1 -- 172.21.15.164:0/1714765007 wait complete. 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 -- start start 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 Processor -- start 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d6dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d75160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ada2c83ca0 con 0x55ada2d644a0 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ada2cc4620 con 0x55ada2d69610 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:07.999+0000 7fc2faa36740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ada2d6c560 con 0x55ada2d63ab0 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2faa36740 10 client.0 _ll_register_callbacks cb 0x55ada2cc0160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57098/0 (socket says 172.21.15.164:57098) 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 -- 172.21.15.164:0/721957044 learned_addr learned my addr 172.21.15.164:0/721957044 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:07.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d75160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f5400640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d6dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 -- 172.21.15.164:0/721957044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 msgr2=0x55ada2d6dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d6dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 -- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 msgr2=0x55ada2d75160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d75160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.000+0000 7fc2f4a00640 1 -- 172.21.15.164:0/721957044 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada2aa67d0 con 0x55ada2d644a0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc01fd40 tx=0x7fc2dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=befb8c3b6d7bccca server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc020440 con 0x55ada2d644a0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc2dc0205e0 con 0x55ada2d644a0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e4005040 con 0x55ada2d644a0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2dc020820 con 0x55ada2d644a0 2024-03-27T08:38:07.996 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2faa36740 10 client.16167 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.001+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ada2d785a0 con 0x55ada2d644a0 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e4005040 con 0x55ada2d644a0 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc2dc02ac30 con 0x55ada2d644a0 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 10 client.16167 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 10 client.16167 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 20 client.16167 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2d79d20 0x55ada2d7c1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 4 client.16167 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ada2cd5bb0 con 0x55ada2d79d20 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.002+0000 7fc2f5400640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2d79d20 0x55ada2d7c1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.003+0000 7fc2f5400640 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2d79d20 0x55ada2d7c1e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9863c7c71c14fc61 server_cookie=6ca09256114e0687 in_seq=0 out_seq=0 2024-03-27T08:38:07.997 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.003+0000 7fc2d6a00640 10 client.16167 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:07.998 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.004+0000 7fc2d6a00640 1 -- 172.21.15.164:0/721957044 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ada2cd5bb0 con 0x55ada2d79d20 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.004+0000 7fc2d6a00640 10 client.16167 handle_command_reply: tid=0 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.004+0000 7fc2faa36740 1 client.16167 shutdown 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 msgr2=0x55ada2d6e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc01fd40 tx=0x7fc2dc004730 comp rx=0 tx=0).stop 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 shutdown_connections 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2d79d20 0x55ada2d7c1e0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d75160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d6e120 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 --2- 172.21.15.164:0/721957044 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d6dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2d6a00640 0 client.16167 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 >> 172.21.15.164:0/721957044 conn(0x55ada2d5f020 msgr2=0x55ada2d5e240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 shutdown_connections 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 1 -- 172.21.15.164:0/721957044 wait complete. 2024-03-27T08:38:07.999 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.005+0000 7fc2faa36740 20 client.16167 trim_cache size 0 max 16384 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 Processor -- start 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 -- start start 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d75120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d69610 0x55ada2d80ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.021+0000 7fc2faa36740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01ad990 con 0x55ada2d63ab0 2024-03-27T08:38:08.013 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2faa36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01ab200 con 0x55ada2d644a0 2024-03-27T08:38:08.014 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2faa36740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01a9050 con 0x55ada2d69610 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d75120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57106/0 (socket says 172.21.15.164:57106) 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 -- 172.21.15.164:0/42358244 learned_addr learned my addr 172.21.15.164:0/42358244 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d69610 0x55ada2d80ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 -- 172.21.15.164:0/42358244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d69610 msgr2=0x55ada2d80ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d69610 0x55ada2d80ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 -- 172.21.15.164:0/42358244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 msgr2=0x55ada2d75120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:08.015 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d75120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.022+0000 7fc2f5400640 1 -- 172.21.15.164:0/42358244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ada2d5fd90 con 0x55ada2d63ab0 2024-03-27T08:38:08.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.023+0000 7fc2f5400640 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc2e402c710 tx=0x7fc2e402bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c33840a4377522e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:08.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.023+0000 7fc2e1c00640 1 -- 172.21.15.164:0/42358244 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e404f070 con 0x55ada2d63ab0 2024-03-27T08:38:08.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.023+0000 7fc2e1c00640 1 -- 172.21.15.164:0/42358244 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e4050c30 con 0x55ada2d63ab0 2024-03-27T08:38:08.016 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.023+0000 7fc2e1c00640 1 -- 172.21.15.164:0/42358244 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e4005430 con 0x55ada2d63ab0 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- 172.21.15.164:0/42358244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 msgr2=0x55ada2d62990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fc2e402c710 tx=0x7fc2e402bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- 172.21.15.164:0/42358244 shutdown_connections 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d69610 0x55ada2d80ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d644a0 0x55ada2d75120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 --2- 172.21.15.164:0/42358244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d63ab0 0x55ada2d62990 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- 172.21.15.164:0/42358244 >> 172.21.15.164:0/42358244 conn(0x55ada2d5f020 msgr2=0x55ada2d62280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- 172.21.15.164:0/42358244 shutdown_connections 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- 172.21.15.164:0/42358244 wait complete. 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.024+0000 7fc2faa36740 1 -- start start 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 Processor -- start 2024-03-27T08:38:08.020 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d72c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d74130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01a96c0 con 0x55ada2d644a0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01aab30 con 0x55ada2d69610 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01a9d90 con 0x55ada2d63ab0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.025+0000 7fc2faa36740 10 client.0 _ll_register_callbacks cb 0x7fc2dc010f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:57120/0 (socket says 172.21.15.164:57120) 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 -- 172.21.15.164:0/3094324586 learned_addr learned my addr 172.21.15.164:0/3094324586 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f5400640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d72c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f5e00640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d74130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 -- 172.21.15.164:0/3094324586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 msgr2=0x55ada2d72c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d72c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.021 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 -- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 msgr2=0x55ada2d74130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d74130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 -- 172.21.15.164:0/3094324586 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ada2d74720 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2f4a00640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0058c0 tx=0x7fc2dc005c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a197b765d8b6a6c8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.026+0000 7fc2d6a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc035c20 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc2dc035dc0 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e4050c30 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc2dc00fc20 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 10 client.16173 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ada2de0500 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc2e4050c30 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fc2dc02a960 con 0x55ada2d644a0 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 10 client.16173 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:08.022 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 10 client.16173 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:08.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 20 client.16173 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:08.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2de0f30 0x55ada2de3350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:08.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 4 client.16173 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-03-27T08:38:08.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.027+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ada2ccff00 con 0x55ada2de0f30 2024-03-27T08:38:08.023 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.028+0000 7fc2f5400640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2de0f30 0x55ada2de3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:08.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2f5400640 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2de0f30 0x55ada2de3350 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87878769877a778f server_cookie=55c75105ca14dc52 in_seq=0 out_seq=0 2024-03-27T08:38:08.024 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2d6a00640 10 client.16173 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2d6a00640 1 -- 172.21.15.164:0/3094324586 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ada2ccff00 con 0x55ada2de0f30 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2d6a00640 10 client.16173 handle_command_reply: tid=0 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 client.16173 shutdown 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 msgr2=0x55ada2d73170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc0058c0 tx=0x7fc2dc005c40 comp rx=0 tx=0).stop 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 shutdown_connections 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ada2de0f30 0x55ada2de3350 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ada2d69610 0x55ada2d74130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ada2d644a0 0x55ada2d73170 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 --2- 172.21.15.164:0/3094324586 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ada2d63ab0 0x55ada2d72c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 >> 172.21.15.164:0/3094324586 conn(0x55ada2d5f020 msgr2=0x55ada2d62b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2d6a00640 0 client.16173 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 shutdown_connections 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.029+0000 7fc2faa36740 1 -- 172.21.15.164:0/3094324586 wait complete. 2024-03-27T08:38:08.025 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2faa36740 20 client.16173 trim_cache size 0 max 16384 2024-03-27T08:38:08.026 INFO:teuthology.orchestra.run.smithi164.stdout:[] 2024-03-27T08:38:08.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 msgr2=0x7fc2d80a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:08.026 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 0x7fc2d80a5b50 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x55ada2d64d00 tx=0x7fc2dc013040 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 msgr2=0x7fc2f01a1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fc2e800eaa0 tx=0x7fc2e800ef60 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 shutdown_connections 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc2d80a3690 0x7fc2d80a5b50 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc2f0107710 0x7fc2f01a1560 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc2f0104de0 0x7fc2f019a4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 --2- 172.21.15.164:0/1791019042 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc2f01024b0 0x7fc2f0199fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.030+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 >> 172.21.15.164:0/1791019042 conn(0x7fc2f00fbec0 msgr2=0x7fc2f0101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.031+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 shutdown_connections 2024-03-27T08:38:08.027 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:38:08.031+0000 7fc2f6800640 1 -- 172.21.15.164:0/1791019042 wait complete. 2024-03-27T08:38:08.041 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 5326889, 'ino': 1099511628529, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab'}, {'damage_type': 'backtrace', 'id': 16474023, 'ino': 1099511628576, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl'}, {'damage_type': 'backtrace', 'id': 16734432, 'ino': 1099511628519, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-gpio'}, {'damage_type': 'backtrace', 'id': 25525721, 'ino': 1099511628671, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml'}, {'damage_type': 'backtrace', 'id': 28960712, 'ino': 1099511628531, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo'}, {'damage_type': 'backtrace', 'id': 36851880, 'ino': 1099511628597, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml'}, {'damage_type': 'backtrace', 'id': 53976579, 'ino': 1099511628313, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls'}, {'damage_type': 'backtrace', 'id': 59256520, 'ino': 1099511628665, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml'}, {'damage_type': 'backtrace', 'id': 75219623, 'ino': 1099511628584, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64'}, {'damage_type': 'backtrace', 'id': 75993470, 'ino': 1099511628567, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl'}, {'damage_type': 'backtrace', 'id': 82774325, 'ino': 1099511628465, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot'}, {'damage_type': 'backtrace', 'id': 125518724, 'ino': 1099511628574, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl'}, {'damage_type': 'backtrace', 'id': 132664277, 'ino': 1099511628354, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset'}, {'damage_type': 'backtrace', 'id': 133186312, 'ino': 1099511628447, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host'}, {'damage_type': 'backtrace', 'id': 160877740, 'ino': 1099511628471, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun'}, {'damage_type': 'backtrace', 'id': 176464721, 'ino': 1099511628316, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb'}, {'damage_type': 'backtrace', 'id': 187940145, 'ino': 1099511628549, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp'}, {'damage_type': 'backtrace', 'id': 191318239, 'ino': 1099511628740, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml'}, {'damage_type': 'backtrace', 'id': 193528566, 'ino': 1099511628739, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml'}, {'damage_type': 'backtrace', 'id': 193761576, 'ino': 1099511628352, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial'}, {'damage_type': 'backtrace', 'id': 209411924, 'ino': 1099511628713, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml'}, {'damage_type': 'backtrace', 'id': 215390481, 'ino': 1099511628524, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups'}, {'damage_type': 'backtrace', 'id': 218720976, 'ino': 1099511628702, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia'}, {'damage_type': 'backtrace', 'id': 219651657, 'ino': 1099511628493, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote'}, {'damage_type': 'backtrace', 'id': 222830865, 'ino': 1099511628523, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps'}, {'damage_type': 'backtrace', 'id': 224194955, 'ino': 1099511628783, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/sh.tmpl'}, {'damage_type': 'backtrace', 'id': 236360599, 'ino': 1099511628379, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x'}, {'damage_type': 'backtrace', 'id': 259938793, 'ino': 1099511628715, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml'}, {'damage_type': 'backtrace', 'id': 270387006, 'ino': 1099511628680, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml'}, {'damage_type': 'backtrace', 'id': 283576312, 'ino': 1099511628353, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink'}, {'damage_type': 'backtrace', 'id': 286037318, 'ino': 1099511628515, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4'}, {'damage_type': 'backtrace', 'id': 293261876, 'ino': 1099511628326, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp'}, {'damage_type': 'backtrace', 'id': 306393156, 'ino': 1099511628786, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/uio-howto.tmpl'}, {'damage_type': 'backtrace', 'id': 327962998, 'ino': 1099511628730, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml'}, {'damage_type': 'backtrace', 'id': 330629477, 'ino': 1099511628540, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop'}, {'damage_type': 'backtrace', 'id': 336219192, 'ino': 1099511628720, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml'}, {'damage_type': 'backtrace', 'id': 341301324, 'ino': 1099511628476, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid'}, {'damage_type': 'backtrace', 'id': 343612669, 'ino': 1099511628384, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format'}, {'damage_type': 'backtrace', 'id': 343860037, 'ino': 1099511628716, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml'}, {'damage_type': 'backtrace', 'id': 349400086, 'ino': 1099511628361, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc'}, {'damage_type': 'backtrace', 'id': 354221065, 'ino': 1099511628294, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/README'}, {'damage_type': 'backtrace', 'id': 361695922, 'ino': 1099511628747, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml'}, {'damage_type': 'backtrace', 'id': 374820090, 'ino': 1099511628687, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml'}, {'damage_type': 'backtrace', 'id': 375162288, 'ino': 1099511628623, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml'}, {'damage_type': 'backtrace', 'id': 385992974, 'ino': 1099511628322, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc'}, {'damage_type': 'backtrace', 'id': 390364411, 'ino': 1099511628454, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr'}, {'damage_type': 'backtrace', 'id': 391220569, 'ino': 1099511628412, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg'}, {'damage_type': 'backtrace', 'id': 396052736, 'ino': 1099511628757, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 398493185, 'ino': 1099511628601, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64'}, {'damage_type': 'backtrace', 'id': 400965181, 'ino': 1099511628450, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev'}, {'damage_type': 'backtrace', 'id': 403934609, 'ino': 1099511628530, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids'}, {'damage_type': 'backtrace', 'id': 404027959, 'ino': 1099511628600, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64'}, {'damage_type': 'backtrace', 'id': 407988121, 'ino': 1099511628634, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml'}, {'damage_type': 'backtrace', 'id': 411713475, 'ino': 1099511628521, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ibft'}, {'damage_type': 'backtrace', 'id': 423519560, 'ino': 1099511628761, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml'}, {'damage_type': 'backtrace', 'id': 426454454, 'ino': 1099511628764, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml'}, {'damage_type': 'backtrace', 'id': 430267024, 'ino': 1099511628561, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore'}, {'damage_type': 'backtrace', 'id': 442115634, 'ino': 1099511628551, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf'}, {'damage_type': 'backtrace', 'id': 443231271, 'ino': 1099511628603, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64'}, {'damage_type': 'backtrace', 'id': 447600586, 'ino': 1099511628775, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64'}, {'damage_type': 'backtrace', 'id': 456574714, 'ino': 1099511628511, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap'}, {'damage_type': 'backtrace', 'id': 456947283, 'ino': 1099511628569, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl'}, {'damage_type': 'backtrace', 'id': 462640865, 'ino': 1099511628586, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore'}, {'damage_type': 'backtrace', 'id': 466387764, 'ino': 1099511628334, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp'}, {'damage_type': 'backtrace', 'id': 468564961, 'ino': 1099511628355, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1'}, {'damage_type': 'backtrace', 'id': 471865969, 'ino': 1099511628514, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv'}, {'damage_type': 'backtrace', 'id': 473050279, 'ino': 1099511628564, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl'}, {'damage_type': 'backtrace', 'id': 516380127, 'ino': 1099511628522, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params'}, {'damage_type': 'backtrace', 'id': 518762524, 'ino': 1099511628510, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log'}, {'damage_type': 'backtrace', 'id': 522547379, 'ino': 1099511628788, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/w1.tmpl'}, {'damage_type': 'backtrace', 'id': 522749443, 'ino': 1099511628537, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91'}, {'damage_type': 'backtrace', 'id': 538037645, 'ino': 1099511628307, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/o2cb'}, {'damage_type': 'backtrace', 'id': 548250870, 'ino': 1099511628372, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm'}, {'damage_type': 'backtrace', 'id': 564953695, 'ino': 1099511628440, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd'}, {'damage_type': 'backtrace', 'id': 582534598, 'ino': 1099511628746, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml'}, {'damage_type': 'backtrace', 'id': 591039373, 'ino': 1099511628500, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse'}, {'damage_type': 'backtrace', 'id': 603249780, 'ino': 1099511628776, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media_api.tmpl'}, {'damage_type': 'backtrace', 'id': 650852592, 'ino': 1099511628592, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf'}, {'damage_type': 'backtrace', 'id': 668503019, 'ino': 1099511628390, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352'}, {'damage_type': 'backtrace', 'id': 680905020, 'ino': 1099511628538, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb'}, {'damage_type': 'backtrace', 'id': 696402450, 'ino': 1099511628467, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state'}, {'damage_type': 'backtrace', 'id': 705286508, 'ino': 1099511628792, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/z8530book.tmpl'}, {'damage_type': 'backtrace', 'id': 707586443, 'ino': 1099511628774, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64'}, {'damage_type': 'backtrace', 'id': 714314247, 'ino': 1099511628542, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim'}, {'damage_type': 'backtrace', 'id': 714335095, 'ino': 1099511628689, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml'}, {'damage_type': 'backtrace', 'id': 715407277, 'ino': 1099511628769, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml'}, {'damage_type': 'backtrace', 'id': 735627410, 'ino': 1099511628660, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml'}, {'damage_type': 'backtrace', 'id': 736421911, 'ino': 1099511628738, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml'}, {'damage_type': 'backtrace', 'id': 753952361, 'ino': 1099511628396, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160'}, {'damage_type': 'backtrace', 'id': 754339270, 'ino': 1099511628686, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml'}, {'damage_type': 'backtrace', 'id': 755495444, 'ino': 1099511628513, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi'}, {'damage_type': 'backtrace', 'id': 784324662, 'ino': 1099511628466, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup'}, {'damage_type': 'backtrace', 'id': 791344572, 'ino': 1099511628736, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 797802259, 'ino': 1099511628436, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan'}, {'damage_type': 'backtrace', 'id': 800489051, 'ino': 1099511628594, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml'}, {'damage_type': 'backtrace', 'id': 806161568, 'ino': 1099511628643, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml'}, {'damage_type': 'backtrace', 'id': 809843244, 'ino': 1099511628663, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml'}, {'damage_type': 'backtrace', 'id': 813189146, 'ino': 1099511628473, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl'}, {'damage_type': 'backtrace', 'id': 817830337, 'ino': 1099511628543, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop'}, {'damage_type': 'backtrace', 'id': 838992576, 'ino': 1099511628475, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe'}, {'damage_type': 'backtrace', 'id': 843632800, 'ino': 1099511628329, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04'}, {'damage_type': 'backtrace', 'id': 849231694, 'ino': 1099511628393, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150'}, {'damage_type': 'backtrace', 'id': 854518448, 'ino': 1099511628380, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel'}, {'damage_type': 'backtrace', 'id': 890559579, 'ino': 1099511628545, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500'}, {'damage_type': 'backtrace', 'id': 891668063, 'ino': 1099511628756, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml'}, {'damage_type': 'backtrace', 'id': 893163050, 'ino': 1099511628300, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus'}, {'damage_type': 'backtrace', 'id': 909038657, 'ino': 1099511628703, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg'}, {'damage_type': 'backtrace', 'id': 914975447, 'ino': 1099511628520, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085'}, {'damage_type': 'backtrace', 'id': 943153297, 'ino': 1099511628532, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline'}, {'damage_type': 'backtrace', 'id': 961375653, 'ino': 1099511628731, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml'}, {'damage_type': 'backtrace', 'id': 973904804, 'ino': 1099511628446, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration'}, {'damage_type': 'backtrace', 'id': 982026901, 'ino': 1099511628737, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml'}, {'damage_type': 'backtrace', 'id': 995290896, 'ino': 1099511628426, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd'}, {'damage_type': 'backtrace', 'id': 1004790302, 'ino': 1099511628448, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc'}, {'damage_type': 'backtrace', 'id': 1007143645, 'ino': 1099511628400, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs'}, {'damage_type': 'backtrace', 'id': 1011104561, 'ino': 1099511628602, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64'}, {'damage_type': 'backtrace', 'id': 1015386216, 'ino': 1099511628694, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml'}, {'damage_type': 'backtrace', 'id': 1027549755, 'ino': 1099511628502, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom'}, {'damage_type': 'backtrace', 'id': 1039540850, 'ino': 1099511628677, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml'}, {'damage_type': 'backtrace', 'id': 1041722178, 'ino': 1099511628421, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq'}, {'damage_type': 'backtrace', 'id': 1070614653, 'ino': 1099511628472, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu'}, {'damage_type': 'backtrace', 'id': 1072605412, 'ino': 1099511628782, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/scsi.tmpl'}, {'damage_type': 'backtrace', 'id': 1097416132, 'ino': 1099511628402, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media'}, {'damage_type': 'backtrace', 'id': 1098879130, 'ino': 1099511628571, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl'}, {'damage_type': 'backtrace', 'id': 1109851814, 'ino': 1099511628546, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power'}, {'damage_type': 'backtrace', 'id': 1120135231, 'ino': 1099511628704, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia'}, {'damage_type': 'backtrace', 'id': 1121383645, 'ino': 1099511628708, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml'}, {'damage_type': 'backtrace', 'id': 1123155324, 'ino': 1099511628488, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua'}, {'damage_type': 'backtrace', 'id': 1127259840, 'ino': 1099511628371, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache'}, {'damage_type': 'backtrace', 'id': 1135934719, 'ino': 1099511628693, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml'}, {'damage_type': 'backtrace', 'id': 1149665048, 'ino': 1099511628310, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable'}, {'damage_type': 'backtrace', 'id': 1153808644, 'ino': 1099511628512, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw'}, {'damage_type': 'backtrace', 'id': 1154866484, 'ino': 1099511628333, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module'}, {'damage_type': 'backtrace', 'id': 1156702322, 'ino': 1099511628536, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi'}, {'damage_type': 'backtrace', 'id': 1159157122, 'ino': 1099511628383, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events'}, {'damage_type': 'backtrace', 'id': 1160551444, 'ino': 1099511628750, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml'}, {'damage_type': 'backtrace', 'id': 1161404744, 'ino': 1099511628356, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2'}, {'damage_type': 'backtrace', 'id': 1167859299, 'ino': 1099511628657, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml'}, {'damage_type': 'backtrace', 'id': 1179721680, 'ino': 1099511628709, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml'}, {'damage_type': 'backtrace', 'id': 1186289530, 'ino': 1099511628615, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml'}, {'damage_type': 'backtrace', 'id': 1198569485, 'ino': 1099511628347, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi'}, {'damage_type': 'backtrace', 'id': 1205943744, 'ino': 1099511628691, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml'}, {'damage_type': 'backtrace', 'id': 1233017159, 'ino': 1099511628321, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi'}, {'damage_type': 'backtrace', 'id': 1248725402, 'ino': 1099511628373, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd'}, {'damage_type': 'backtrace', 'id': 1250061329, 'ino': 1099511628457, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online'}, {'damage_type': 'backtrace', 'id': 1266516479, 'ino': 1099511628550, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty'}, {'damage_type': 'backtrace', 'id': 1283342304, 'ino': 1099511628710, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf'}, {'damage_type': 'backtrace', 'id': 1324632220, 'ino': 1099511628442, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap'}, {'damage_type': 'backtrace', 'id': 1340145981, 'ino': 1099511628698, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml'}, {'damage_type': 'backtrace', 'id': 1340948206, 'ino': 1099511628670, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml'}, {'damage_type': 'backtrace', 'id': 1347993561, 'ino': 1099511628461, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power'}, {'damage_type': 'backtrace', 'id': 1365555759, 'ino': 1099511628624, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml'}, {'damage_type': 'backtrace', 'id': 1365812488, 'ino': 1099511628342, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem'}, {'damage_type': 'backtrace', 'id': 1371043520, 'ino': 1099511628575, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl'}, {'damage_type': 'backtrace', 'id': 1377550616, 'ino': 1099511628587, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml'}, {'damage_type': 'backtrace', 'id': 1379047524, 'ino': 1099511628596, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml'}, {'damage_type': 'backtrace', 'id': 1380182911, 'ino': 1099511628482, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo'}, {'damage_type': 'backtrace', 'id': 1390051726, 'ino': 1099511628328, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc'}, {'damage_type': 'backtrace', 'id': 1423513531, 'ino': 1099511628504, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront'}, {'damage_type': 'backtrace', 'id': 1432253258, 'ino': 1099511628585, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb'}, {'damage_type': 'backtrace', 'id': 1437367286, 'ino': 1099511628752, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml'}, {'damage_type': 'backtrace', 'id': 1443719957, 'ino': 1099511628622, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml'}, {'damage_type': 'backtrace', 'id': 1452758631, 'ino': 1099511628495, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start'}, {'damage_type': 'backtrace', 'id': 1457892546, 'ino': 1099511628489, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra'}, {'damage_type': 'backtrace', 'id': 1463585675, 'ino': 1099511628424, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu'}, {'damage_type': 'backtrace', 'id': 1464609000, 'ino': 1099511628525, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch'}, {'damage_type': 'backtrace', 'id': 1481306961, 'ino': 1099511628754, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml'}, {'damage_type': 'backtrace', 'id': 1489774066, 'ino': 1099511628408, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd'}, {'damage_type': 'backtrace', 'id': 1498531500, 'ino': 1099511628573, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl'}, {'damage_type': 'backtrace', 'id': 1503907668, 'ino': 1099511628533, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module'}, {'damage_type': 'backtrace', 'id': 1508566832, 'ino': 1099511628397, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als'}, {'damage_type': 'backtrace', 'id': 1509394831, 'ino': 1099511628517, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2'}, {'damage_type': 'backtrace', 'id': 1514555262, 'ino': 1099511628518, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs'}, {'damage_type': 'backtrace', 'id': 1522130798, 'ino': 1099511628572, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl'}, {'damage_type': 'backtrace', 'id': 1524654879, 'ino': 1099511628633, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml'}, {'damage_type': 'backtrace', 'id': 1530586589, 'ino': 1099511628485, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus'}, {'damage_type': 'backtrace', 'id': 1532577098, 'ino': 1099511628358, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe'}, {'damage_type': 'backtrace', 'id': 1534852513, 'ino': 1099511628632, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml'}, {'damage_type': 'backtrace', 'id': 1539025537, 'ino': 1099511628548, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-profiling'}, {'damage_type': 'backtrace', 'id': 1555891333, 'ino': 1099511628499, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid'}, {'damage_type': 'backtrace', 'id': 1559028340, 'ino': 1099511628389, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480'}, {'damage_type': 'backtrace', 'id': 1569111359, 'ino': 1099511628394, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523'}, {'damage_type': 'backtrace', 'id': 1570694050, 'ino': 1099511628414, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-c2port'}, {'damage_type': 'backtrace', 'id': 1585719255, 'ino': 1099511628395, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350'}, {'damage_type': 'backtrace', 'id': 1601373133, 'ino': 1099511628535, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop'}, {'damage_type': 'backtrace', 'id': 1615947037, 'ino': 1099511628486, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure'}, {'damage_type': 'backtrace', 'id': 1649661696, 'ino': 1099511628627, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml'}, {'damage_type': 'backtrace', 'id': 1671944980, 'ino': 1099511628566, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl'}, {'damage_type': 'backtrace', 'id': 1679935396, 'ino': 1099511628589, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml'}, {'damage_type': 'backtrace', 'id': 1686861491, 'ino': 1099511628728, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml'}, {'damage_type': 'backtrace', 'id': 1706226572, 'ino': 1099511628314, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile'}, {'damage_type': 'backtrace', 'id': 1708441853, 'ino': 1099511628388, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi'}, {'damage_type': 'backtrace', 'id': 1713514450, 'ino': 1099511628509, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi'}, {'damage_type': 'backtrace', 'id': 1714833027, 'ino': 1099511628606, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l'}, {'damage_type': 'backtrace', 'id': 1725193109, 'ino': 1099511628734, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml'}, {'damage_type': 'backtrace', 'id': 1728725180, 'ino': 1099511628721, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 1733445079, 'ino': 1099511628733, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml'}, {'damage_type': 'backtrace', 'id': 1741541710, 'ino': 1099511628706, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia'}, {'damage_type': 'backtrace', 'id': 1755649697, 'ino': 1099511628771, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml'}, {'damage_type': 'backtrace', 'id': 1761954462, 'ino': 1099511628391, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533'}, {'damage_type': 'backtrace', 'id': 1781005025, 'ino': 1099511628759, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml'}, {'damage_type': 'backtrace', 'id': 1809011220, 'ino': 1099511628685, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml'}, {'damage_type': 'backtrace', 'id': 1811253866, 'ino': 1099511628701, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml'}, {'damage_type': 'backtrace', 'id': 1819165803, 'ino': 1099511628419, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi'}, {'damage_type': 'backtrace', 'id': 1827096835, 'ino': 1099511628628, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml'}, {'damage_type': 'backtrace', 'id': 1838669540, 'ino': 1099511628629, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml'}, {'damage_type': 'backtrace', 'id': 1850209351, 'ino': 1099511628305, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/ip_queue'}, {'damage_type': 'backtrace', 'id': 1860708115, 'ino': 1099511628770, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml'}, {'damage_type': 'backtrace', 'id': 1886547438, 'ino': 1099511628563, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile'}, {'damage_type': 'backtrace', 'id': 1912526241, 'ino': 1099511628578, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl'}, {'damage_type': 'backtrace', 'id': 1913498409, 'ino': 1099511628403, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei'}, {'damage_type': 'backtrace', 'id': 1916751094, 'ino': 1099511628705, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg'}, {'damage_type': 'backtrace', 'id': 1932054750, 'ino': 1099511628570, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl'}, {'damage_type': 'backtrace', 'id': 1944062533, 'ino': 1099511628297, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb'}, {'damage_type': 'backtrace', 'id': 1945798116, 'ino': 1099511628577, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl'}, {'damage_type': 'backtrace', 'id': 1957864343, 'ino': 1099511628505, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi'}, {'damage_type': 'backtrace', 'id': 1958029490, 'ino': 1099511628346, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage'}, {'damage_type': 'backtrace', 'id': 1969033068, 'ino': 1099511628417, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870'}, {'damage_type': 'backtrace', 'id': 1976546276, 'ino': 1099511628341, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm'}, {'damage_type': 'backtrace', 'id': 1986914078, 'ino': 1099511628410, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc'}, {'damage_type': 'backtrace', 'id': 2001276760, 'ino': 1099511628441, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-power'}, {'damage_type': 'backtrace', 'id': 2015735419, 'ino': 1099511628298, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill'}, {'damage_type': 'backtrace', 'id': 2021265279, 'ino': 1099511628413, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest'}, {'damage_type': 'backtrace', 'id': 2044351438, 'ino': 1099511628562, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl'}, {'damage_type': 'backtrace', 'id': 2045230008, 'ino': 1099511628343, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs'}, {'damage_type': 'backtrace', 'id': 2047137199, 'ino': 1099511628636, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml'}, {'damage_type': 'backtrace', 'id': 2051868477, 'ino': 1099511628718, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml'}, {'damage_type': 'backtrace', 'id': 2057528187, 'ino': 1099511628676, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml'}, {'damage_type': 'backtrace', 'id': 2080844036, 'ino': 1099511628330, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars'}, {'damage_type': 'backtrace', 'id': 2082292991, 'ino': 1099511628639, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml'}, {'damage_type': 'backtrace', 'id': 2090499878, 'ino': 1099511628609, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml'}, {'damage_type': 'backtrace', 'id': 2096259097, 'ino': 1099511628748, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml'}, {'damage_type': 'backtrace', 'id': 2098262735, 'ino': 1099511628755, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml'}, {'damage_type': 'backtrace', 'id': 2098724907, 'ino': 1099511628416, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class'}, {'damage_type': 'backtrace', 'id': 2102499426, 'ino': 1099511628336, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso'}, {'damage_type': 'backtrace', 'id': 2108328218, 'ino': 1099511628588, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml'}, {'damage_type': 'backtrace', 'id': 2108344810, 'ino': 1099511628478, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff'}, {'damage_type': 'backtrace', 'id': 2110519082, 'ino': 1099511628463, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1'}, {'damage_type': 'backtrace', 'id': 2133568381, 'ino': 1099511628363, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd'}, {'damage_type': 'backtrace', 'id': 2140213680, 'ino': 1099511628345, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback'}, {'damage_type': 'backtrace', 'id': 2141020306, 'ino': 1099511628618, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml'}, {'damage_type': 'backtrace', 'id': 2158508917, 'ino': 1099511628649, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml'}, {'damage_type': 'backtrace', 'id': 2165834382, 'ino': 1099511628684, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml'}, {'damage_type': 'backtrace', 'id': 2175459211, 'ino': 1099511628722, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml'}, {'damage_type': 'backtrace', 'id': 2180473573, 'ino': 1099511628664, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml'}, {'damage_type': 'backtrace', 'id': 2186030571, 'ino': 1099511628608, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml'}, {'damage_type': 'backtrace', 'id': 2196797231, 'ino': 1099511628382, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css'}, {'damage_type': 'backtrace', 'id': 2204075384, 'ino': 1099511628387, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe'}, {'damage_type': 'backtrace', 'id': 2210056581, 'ino': 1099511628678, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml'}, {'damage_type': 'backtrace', 'id': 2223519345, 'ino': 1099511628437, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh'}, {'damage_type': 'backtrace', 'id': 2225938014, 'ino': 1099511628763, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml'}, {'damage_type': 'backtrace', 'id': 2227493547, 'ino': 1099511628418, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533'}, {'damage_type': 'backtrace', 'id': 2228171209, 'ino': 1099511628331, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump'}, {'damage_type': 'backtrace', 'id': 2233619748, 'ino': 1099511628349, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex'}, {'damage_type': 'backtrace', 'id': 2282541169, 'ino': 1099511628335, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification'}, {'damage_type': 'backtrace', 'id': 2305181852, 'ino': 1099511628749, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml'}, {'damage_type': 'backtrace', 'id': 2319281201, 'ino': 1099511628490, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos'}, {'damage_type': 'backtrace', 'id': 2324172703, 'ino': 1099511628593, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml'}, {'damage_type': 'backtrace', 'id': 2335994175, 'ino': 1099511628539, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg'}, {'damage_type': 'backtrace', 'id': 2350162609, 'ino': 1099511628516, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs'}, {'damage_type': 'backtrace', 'id': 2357672424, 'ino': 1099511628323, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node'}, {'damage_type': 'backtrace', 'id': 2360329123, 'ino': 1099511628368, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore'}, {'damage_type': 'backtrace', 'id': 2390377383, 'ino': 1099511628742, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml'}, {'damage_type': 'backtrace', 'id': 2413438079, 'ino': 1099511628487, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus'}, {'damage_type': 'backtrace', 'id': 2414345213, 'ino': 1099511628667, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml'}, {'damage_type': 'backtrace', 'id': 2414483846, 'ino': 1099511628338, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget'}, {'damage_type': 'backtrace', 'id': 2428952266, 'ino': 1099511628365, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm'}, {'damage_type': 'backtrace', 'id': 2429289823, 'ino': 1099511628768, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml'}, {'damage_type': 'backtrace', 'id': 2455835194, 'ino': 1099511628295, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete'}, {'damage_type': 'backtrace', 'id': 2458057062, 'ino': 1099511628777, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/mtdnand.tmpl'}, {'damage_type': 'backtrace', 'id': 2458398003, 'ino': 1099511628630, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf'}, {'damage_type': 'backtrace', 'id': 2463825436, 'ino': 1099511628445, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator'}, {'damage_type': 'backtrace', 'id': 2464789952, 'ino': 1099511628501, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi'}, {'damage_type': 'backtrace', 'id': 2470482137, 'ino': 1099511628374, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram'}, {'damage_type': 'backtrace', 'id': 2477922280, 'ino': 1099511628302, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed'}, {'damage_type': 'backtrace', 'id': 2486562689, 'ino': 1099511628432, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd'}, {'damage_type': 'backtrace', 'id': 2496772018, 'ino': 1099511628679, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml'}, {'damage_type': 'backtrace', 'id': 2504438367, 'ino': 1099511628449, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc'}, {'damage_type': 'backtrace', 'id': 2521091346, 'ino': 1099511628751, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml'}, {'damage_type': 'backtrace', 'id': 2525565405, 'ino': 1099511628766, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml'}, {'damage_type': 'backtrace', 'id': 2529018195, 'ino': 1099511628638, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml'}, {'damage_type': 'backtrace', 'id': 2534684462, 'ino': 1099511628351, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis'}, {'damage_type': 'backtrace', 'id': 2537918619, 'ino': 1099511628369, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata'}, {'damage_type': 'backtrace', 'id': 2544143775, 'ino': 1099511628697, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml'}, {'damage_type': 'backtrace', 'id': 2579214324, 'ino': 1099511628503, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback'}, {'damage_type': 'backtrace', 'id': 2605848104, 'ino': 1099511628453, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node'}, {'damage_type': 'backtrace', 'id': 2622225945, 'ino': 1099511628340, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm'}, {'damage_type': 'backtrace', 'id': 2628689255, 'ino': 1099511628337, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing'}, {'damage_type': 'backtrace', 'id': 2629906520, 'ino': 1099511628619, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml'}, {'damage_type': 'backtrace', 'id': 2633153885, 'ino': 1099511628319, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill'}, {'damage_type': 'backtrace', 'id': 2643658977, 'ino': 1099511628481, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys'}, {'damage_type': 'backtrace', 'id': 2662263592, 'ino': 1099511628675, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml'}, {'damage_type': 'backtrace', 'id': 2698442837, 'ino': 1099511628758, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml'}, {'damage_type': 'backtrace', 'id': 2708473977, 'ino': 1099511628724, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml'}, {'damage_type': 'backtrace', 'id': 2710310959, 'ino': 1099511628404, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci'}, {'damage_type': 'backtrace', 'id': 2710427981, 'ino': 1099511628717, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml'}, {'damage_type': 'backtrace', 'id': 2718095375, 'ino': 1099511628494, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek'}, {'damage_type': 'backtrace', 'id': 2722281824, 'ino': 1099511628474, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu'}, {'damage_type': 'backtrace', 'id': 2723404076, 'ino': 1099511628480, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd'}, {'damage_type': 'backtrace', 'id': 2727210232, 'ino': 1099511628591, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml'}, {'damage_type': 'backtrace', 'id': 2767115298, 'ino': 1099511628357, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc'}, {'damage_type': 'backtrace', 'id': 2768760912, 'ino': 1099511628644, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml'}, {'damage_type': 'backtrace', 'id': 2769511657, 'ino': 1099511628303, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/devfs'}, {'damage_type': 'backtrace', 'id': 2774134528, 'ino': 1099511628544, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb'}, {'damage_type': 'backtrace', 'id': 2781627391, 'ino': 1099511628456, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc'}, {'damage_type': 'backtrace', 'id': 2781811165, 'ino': 1099511628444, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc'}, {'damage_type': 'backtrace', 'id': 2783735833, 'ino': 1099511628498, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop'}, {'damage_type': 'backtrace', 'id': 2784746741, 'ino': 1099511628655, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml'}, {'damage_type': 'backtrace', 'id': 2804118553, 'ino': 1099511628296, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads'}, {'damage_type': 'backtrace', 'id': 2820922792, 'ino': 1099511628662, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml'}, {'damage_type': 'backtrace', 'id': 2825254029, 'ino': 1099511628443, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm'}, {'damage_type': 'backtrace', 'id': 2833153833, 'ino': 1099511628364, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/dev-kmsg'}, {'damage_type': 'backtrace', 'id': 2833727152, 'ino': 1099511628727, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml'}, {'damage_type': 'backtrace', 'id': 2845499039, 'ino': 1099511628762, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml'}, {'damage_type': 'backtrace', 'id': 2852384898, 'ino': 1099511628780, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/regulator.tmpl'}, {'damage_type': 'backtrace', 'id': 2855069243, 'ino': 1099511628398, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050'}, {'damage_type': 'backtrace', 'id': 2875908800, 'ino': 1099511628620, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml'}, {'damage_type': 'backtrace', 'id': 2881150114, 'ino': 1099511628725, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml'}, {'damage_type': 'backtrace', 'id': 2901760538, 'ino': 1099511628614, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml'}, {'damage_type': 'backtrace', 'id': 2905974224, 'ino': 1099511628743, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml'}, {'damage_type': 'backtrace', 'id': 2911508853, 'ino': 1099511628688, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml'}, {'damage_type': 'backtrace', 'id': 2914466575, 'ino': 1099511628547, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps'}, {'damage_type': 'backtrace', 'id': 2921083952, 'ino': 1099511628304, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/dv1394'}, {'damage_type': 'backtrace', 'id': 2937361088, 'ino': 1099511628344, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid'}, {'damage_type': 'backtrace', 'id': 2957798040, 'ino': 1099511628491, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu'}, {'damage_type': 'backtrace', 'id': 2964176197, 'ino': 1099511628695, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml'}, {'damage_type': 'backtrace', 'id': 2965244600, 'ino': 1099511628309, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/video1394'}, {'damage_type': 'backtrace', 'id': 2972003914, 'ino': 1099511628507, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi'}, {'damage_type': 'backtrace', 'id': 2972022730, 'ino': 1099511628359, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ec'}, {'damage_type': 'backtrace', 'id': 2988233421, 'ino': 1099511628433, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net'}, {'damage_type': 'backtrace', 'id': 2996034217, 'ino': 1099511628673, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml'}, {'damage_type': 'backtrace', 'id': 3027849189, 'ino': 1099511628726, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml'}, {'damage_type': 'backtrace', 'id': 3037004272, 'ino': 1099511628621, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml'}, {'damage_type': 'backtrace', 'id': 3047072873, 'ino': 1099511628425, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu'}, {'damage_type': 'backtrace', 'id': 3057506438, 'ino': 1099511628458, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget'}, {'damage_type': 'backtrace', 'id': 3069778401, 'ino': 1099511628789, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl'}, {'damage_type': 'backtrace', 'id': 3072912959, 'ino': 1099511628723, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml'}, {'damage_type': 'backtrace', 'id': 3094016885, 'ino': 1099511628311, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev'}, {'damage_type': 'backtrace', 'id': 3094482044, 'ino': 1099511628745, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml'}, {'damage_type': 'backtrace', 'id': 3096758995, 'ino': 1099511628645, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml'}, {'damage_type': 'backtrace', 'id': 3102343810, 'ino': 1099511628654, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf'}, {'damage_type': 'backtrace', 'id': 3106426370, 'ino': 1099511628470, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc'}, {'damage_type': 'backtrace', 'id': 3115923047, 'ino': 1099511628672, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml'}, {'damage_type': 'backtrace', 'id': 3116440311, 'ino': 1099511628682, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml'}, {'damage_type': 'backtrace', 'id': 3124071871, 'ino': 1099511628650, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml'}, {'damage_type': 'backtrace', 'id': 3128991785, 'ino': 1099511628779, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/rapidio.tmpl'}, {'damage_type': 'backtrace', 'id': 3134080091, 'ino': 1099511628712, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf'}, {'damage_type': 'backtrace', 'id': 3134953367, 'ino': 1099511628508, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map'}, {'damage_type': 'backtrace', 'id': 3154915987, 'ino': 1099511628582, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64'}, {'damage_type': 'backtrace', 'id': 3158068031, 'ino': 1099511628659, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml'}, {'damage_type': 'backtrace', 'id': 3164529838, 'ino': 1099511628332, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog'}, {'damage_type': 'backtrace', 'id': 3176045094, 'ino': 1099511628452, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac'}, {'damage_type': 'backtrace', 'id': 3185400718, 'ino': 1099511628778, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/networking.tmpl'}, {'damage_type': 'backtrace', 'id': 3185823279, 'ino': 1099511628320, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm'}, {'damage_type': 'backtrace', 'id': 3191401978, 'ino': 1099511628411, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb'}, {'damage_type': 'backtrace', 'id': 3193665388, 'ino': 1099511628772, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml'}, {'damage_type': 'backtrace', 'id': 3221352688, 'ino': 1099511628484, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone'}, {'damage_type': 'backtrace', 'id': 3221954738, 'ino': 1099511628699, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml'}, {'damage_type': 'backtrace', 'id': 3224867392, 'ino': 1099511628376, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba'}, {'damage_type': 'backtrace', 'id': 3244353822, 'ino': 1099511628528, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm'}, {'damage_type': 'backtrace', 'id': 3261787151, 'ino': 1099511628787, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/usb.tmpl'}, {'damage_type': 'backtrace', 'id': 3266057023, 'ino': 1099511628700, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml'}, {'damage_type': 'backtrace', 'id': 3274143199, 'ino': 1099511628378, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10'}, {'damage_type': 'backtrace', 'id': 3274507389, 'ino': 1099511628666, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml'}, {'damage_type': 'backtrace', 'id': 3287405237, 'ino': 1099511628635, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml'}, {'damage_type': 'backtrace', 'id': 3317860900, 'ino': 1099511628360, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad'}, {'damage_type': 'backtrace', 'id': 3329173448, 'ino': 1099511628459, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3'}, {'damage_type': 'backtrace', 'id': 3332328281, 'ino': 1099511628362, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto'}, {'damage_type': 'backtrace', 'id': 3333716563, 'ino': 1099511628681, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml'}, {'damage_type': 'backtrace', 'id': 3341778796, 'ino': 1099511628439, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics'}, {'damage_type': 'backtrace', 'id': 3353694687, 'ino': 1099511628370, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block'}, {'damage_type': 'backtrace', 'id': 3354905209, 'ino': 1099511628581, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile'}, {'damage_type': 'backtrace', 'id': 3359290274, 'ino': 1099511628767, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml'}, {'damage_type': 'backtrace', 'id': 3361255543, 'ino': 1099511628784, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/stylesheet.xsl'}, {'damage_type': 'backtrace', 'id': 3362299038, 'ino': 1099511628350, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet'}, {'damage_type': 'backtrace', 'id': 3382601876, 'ino': 1099511628460, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb'}, {'damage_type': 'backtrace', 'id': 3385308961, 'ino': 1099511628568, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl'}, {'damage_type': 'backtrace', 'id': 3391007135, 'ino': 1099511628375, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi'}, {'damage_type': 'backtrace', 'id': 3418132249, 'ino': 1099511628325, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory'}, {'damage_type': 'backtrace', 'id': 3425083525, 'ino': 1099511628607, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore'}, {'damage_type': 'backtrace', 'id': 3429283455, 'ino': 1099511628646, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml'}, {'damage_type': 'backtrace', 'id': 3434124425, 'ino': 1099511628420, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl'}, {'damage_type': 'backtrace', 'id': 3449350833, 'ino': 1099511628422, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon'}, {'damage_type': 'backtrace', 'id': 3451180166, 'ino': 1099511628598, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml'}, {'damage_type': 'backtrace', 'id': 3459332940, 'ino': 1099511628590, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml'}, {'damage_type': 'backtrace', 'id': 3465963780, 'ino': 1099511628661, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml'}, {'damage_type': 'backtrace', 'id': 3469400443, 'ino': 1099511628318, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight'}, {'damage_type': 'backtrace', 'id': 3470622872, 'ino': 1099511628653, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml'}, {'damage_type': 'backtrace', 'id': 3473090282, 'ino': 1099511628301, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra'}, {'damage_type': 'backtrace', 'id': 3481092150, 'ino': 1099511628428, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533'}, {'damage_type': 'backtrace', 'id': 3489863813, 'ino': 1099511628580, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media'}, {'damage_type': 'backtrace', 'id': 3495351621, 'ino': 1099511628367, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/procfs-diskstats'}, {'damage_type': 'backtrace', 'id': 3500546778, 'ino': 1099511628613, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf'}, {'damage_type': 'backtrace', 'id': 3506079007, 'ino': 1099511628692, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml'}, {'damage_type': 'backtrace', 'id': 3522300511, 'ino': 1099511628496, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback'}, {'damage_type': 'backtrace', 'id': 3524756347, 'ino': 1099511628479, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch'}, {'damage_type': 'backtrace', 'id': 3529954703, 'ino': 1099511628430, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei'}, {'damage_type': 'backtrace', 'id': 3531999546, 'ino': 1099511628381, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc'}, {'damage_type': 'backtrace', 'id': 3534106435, 'ino': 1099511628741, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml'}, {'damage_type': 'backtrace', 'id': 3540264070, 'ino': 1099511628327, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx'}, {'damage_type': 'backtrace', 'id': 3546291310, 'ino': 1099511628492, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1'}, {'damage_type': 'backtrace', 'id': 3547859084, 'ino': 1099511628579, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl'}, {'damage_type': 'backtrace', 'id': 3548108327, 'ino': 1099511628626, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml'}, {'damage_type': 'backtrace', 'id': 3563461260, 'ino': 1099511628541, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop'}, {'damage_type': 'backtrace', 'id': 3573020864, 'ino': 1099511628409, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg'}, {'damage_type': 'backtrace', 'id': 3589816726, 'ino': 1099511628468, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state'}, {'damage_type': 'backtrace', 'id': 3601352488, 'ino': 1099511628415, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency'}, {'damage_type': 'backtrace', 'id': 3610614997, 'ino': 1099511628637, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml'}, {'damage_type': 'backtrace', 'id': 3610896475, 'ino': 1099511628604, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64'}, {'damage_type': 'backtrace', 'id': 3621806578, 'ino': 1099511628299, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus'}, {'damage_type': 'backtrace', 'id': 3631081008, 'ino': 1099511628625, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml'}, {'damage_type': 'backtrace', 'id': 3637333253, 'ino': 1099511628527, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages'}, {'damage_type': 'backtrace', 'id': 3640292809, 'ino': 1099511628651, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml'}, {'damage_type': 'backtrace', 'id': 3648258041, 'ino': 1099511628386, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci'}, {'damage_type': 'backtrace', 'id': 3649047520, 'ino': 1099511628308, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/raw1394'}, {'damage_type': 'backtrace', 'id': 3656148852, 'ino': 1099511628435, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm'}, {'damage_type': 'backtrace', 'id': 3667524918, 'ino': 1099511628612, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml'}, {'damage_type': 'backtrace', 'id': 3691225029, 'ino': 1099511628674, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml'}, {'damage_type': 'backtrace', 'id': 3695051170, 'ino': 1099511628348, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm'}, {'damage_type': 'backtrace', 'id': 3697452069, 'ino': 1099511628765, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml'}, {'damage_type': 'backtrace', 'id': 3701244256, 'ino': 1099511628483, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku'}, {'damage_type': 'backtrace', 'id': 3721337405, 'ino': 1099511628690, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml'}, {'damage_type': 'backtrace', 'id': 3729960136, 'ino': 1099511628434, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv'}, {'damage_type': 'backtrace', 'id': 3757455161, 'ino': 1099511628583, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64'}, {'damage_type': 'backtrace', 'id': 3765535914, 'ino': 1099511628669, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml'}, {'damage_type': 'backtrace', 'id': 3767758815, 'ino': 1099511628631, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf'}, {'damage_type': 'backtrace', 'id': 3772296229, 'ino': 1099511628407, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform'}, {'damage_type': 'backtrace', 'id': 3773902003, 'ino': 1099511628641, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml'}, {'damage_type': 'backtrace', 'id': 3780422855, 'ino': 1099511628506, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi'}, {'damage_type': 'backtrace', 'id': 3781997836, 'ino': 1099511628595, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml'}, {'damage_type': 'backtrace', 'id': 3782428049, 'ino': 1099511628423, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu'}, {'damage_type': 'backtrace', 'id': 3785458096, 'ino': 1099511628753, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml'}, {'damage_type': 'backtrace', 'id': 3787905378, 'ino': 1099511628306, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/removed/net_dma'}, {'damage_type': 'backtrace', 'id': 3808031357, 'ino': 1099511628565, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl'}, {'damage_type': 'backtrace', 'id': 3816498050, 'ino': 1099511628781, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl'}, {'damage_type': 'backtrace', 'id': 3821319186, 'ino': 1099511628785, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/tracepoint.tmpl'}, {'damage_type': 'backtrace', 'id': 3821618118, 'ino': 1099511628610, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml'}, {'damage_type': 'backtrace', 'id': 3822763882, 'ino': 1099511628791, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl'}, {'damage_type': 'backtrace', 'id': 3825467174, 'ino': 1099511628366, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/ima_policy'}, {'damage_type': 'backtrace', 'id': 3836815545, 'ino': 1099511628462, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0'}, {'damage_type': 'backtrace', 'id': 3846564528, 'ino': 1099511628324, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu'}, {'damage_type': 'backtrace', 'id': 3847256364, 'ino': 1099511628729, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml'}, {'damage_type': 'backtrace', 'id': 3860083039, 'ino': 1099511628438, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues'}, {'damage_type': 'backtrace', 'id': 3860627505, 'ino': 1099511628317, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend'}, {'damage_type': 'backtrace', 'id': 3865736325, 'ino': 1099511628683, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml'}, {'damage_type': 'backtrace', 'id': 3868137099, 'ino': 1099511628377, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma'}, {'damage_type': 'backtrace', 'id': 3911367815, 'ino': 1099511628392, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio'}, {'damage_type': 'backtrace', 'id': 3912956529, 'ino': 1099511628339, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget'}, {'damage_type': 'backtrace', 'id': 3937071842, 'ino': 1099511628399, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935'}, {'damage_type': 'backtrace', 'id': 3942547644, 'ino': 1099511628427, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led'}, {'damage_type': 'backtrace', 'id': 3948175243, 'ino': 1099511628668, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml'}, {'damage_type': 'backtrace', 'id': 3962967583, 'ino': 1099511628714, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml'}, {'damage_type': 'backtrace', 'id': 3978624889, 'ino': 1099511628534, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2'}, {'damage_type': 'backtrace', 'id': 3987990695, 'ino': 1099511628431, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt'}, {'damage_type': 'backtrace', 'id': 3991064475, 'ino': 1099511628526, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm'}, {'damage_type': 'backtrace', 'id': 3999506971, 'ino': 1099511628648, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml'}, {'damage_type': 'backtrace', 'id': 4012179745, 'ino': 1099511628640, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml'}, {'damage_type': 'backtrace', 'id': 4022925789, 'ino': 1099511628401, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio'}, {'damage_type': 'backtrace', 'id': 4025313739, 'ino': 1099511628611, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml'}, {'damage_type': 'backtrace', 'id': 4031604059, 'ino': 1099511628315, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire'}, {'damage_type': 'backtrace', 'id': 4032609182, 'ino': 1099511628656, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml'}, {'damage_type': 'backtrace', 'id': 4033414664, 'ino': 1099511628455, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory'}, {'damage_type': 'backtrace', 'id': 4044175463, 'ino': 1099511628617, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml'}, {'damage_type': 'backtrace', 'id': 4058251471, 'ino': 1099511628732, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml'}, {'damage_type': 'backtrace', 'id': 4062158822, 'ino': 1099511628616, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml'}, {'damage_type': 'backtrace', 'id': 4069351226, 'ino': 1099511628790, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl'}, {'damage_type': 'backtrace', 'id': 4072615113, 'ino': 1099511628735, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml'}, {'damage_type': 'backtrace', 'id': 4086906456, 'ino': 1099511628469, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use'}, {'damage_type': 'backtrace', 'id': 4096304394, 'ino': 1099511628658, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml'}, {'damage_type': 'backtrace', 'id': 4113838156, 'ino': 1099511628652, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml'}, {'damage_type': 'backtrace', 'id': 4138559981, 'ino': 1099511628707, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg'}, {'damage_type': 'backtrace', 'id': 4159123320, 'ino': 1099511628642, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml'}, {'damage_type': 'backtrace', 'id': 4164271539, 'ino': 1099511628497, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi'}, {'damage_type': 'backtrace', 'id': 4176281592, 'ino': 1099511628312, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb'}, {'damage_type': 'backtrace', 'id': 4177552439, 'ino': 1099511628451, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices'}, {'damage_type': 'backtrace', 'id': 4178879742, 'ino': 1099511628744, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml'}, {'damage_type': 'backtrace', 'id': 4200375428, 'ino': 1099511628760, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml'}, {'damage_type': 'backtrace', 'id': 4204673878, 'ino': 1099511628406, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd'}, {'damage_type': 'backtrace', 'id': 4206228966, 'ino': 1099511628719, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml'}, {'damage_type': 'backtrace', 'id': 4215044946, 'ino': 1099511628464, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2'}, {'damage_type': 'backtrace', 'id': 4223832281, 'ino': 1099511628385, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7'}, {'damage_type': 'backtrace', 'id': 4231766416, 'ino': 1099511628605, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64'}, {'damage_type': 'backtrace', 'id': 4234748762, 'ino': 1099511628696, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml'}, {'damage_type': 'backtrace', 'id': 4248797086, 'ino': 1099511628711, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf'}, {'damage_type': 'backtrace', 'id': 4252355609, 'ino': 1099511628599, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64'}, {'damage_type': 'backtrace', 'id': 4255913582, 'ino': 1099511628429, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r'}, {'damage_type': 'backtrace', 'id': 4261370617, 'ino': 1099511628405, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss'}, {'damage_type': 'backtrace', 'id': 4280976093, 'ino': 1099511628647, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml'}, {'damage_type': 'backtrace', 'id': 4284718832, 'ino': 1099511628477, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo'}, {'damage_type': 'backtrace', 'id': 4287018041, 'ino': 1099511628773, 'path': '/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64'}] 2024-03-27T08:38:08.041 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 38, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 55, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 79, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 90, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-03-27T08:38:08.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:07 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1263914928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:38:08.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:07 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1263914928' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-27T08:38:08.969 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:08 smithi167 ceph-mon[34903]: pgmap v525: 97 pgs: 97 active+clean; 126 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-27T08:38:09.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:08 smithi164 ceph-mon[31788]: pgmap v525: 97 pgs: 97 active+clean; 126 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-27T08:38:09.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:08 smithi173 ceph-mon[35397]: pgmap v525: 97 pgs: 97 active+clean; 126 MiB data, 802 MiB used, 1.0 TiB / 1.0 TiB avail; 175 KiB/s rd, 1.5 MiB/s wr, 13 op/s 2024-03-27T08:38:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:10 smithi164 ceph-mon[31788]: pgmap v526: 97 pgs: 97 active+clean; 133 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 2.1 MiB/s wr, 23 op/s 2024-03-27T08:38:11.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:10 smithi167 ceph-mon[34903]: pgmap v526: 97 pgs: 97 active+clean; 133 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 2.1 MiB/s wr, 23 op/s 2024-03-27T08:38:11.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:10 smithi173 ceph-mon[35397]: pgmap v526: 97 pgs: 97 active+clean; 133 MiB data, 824 MiB used, 1.0 TiB / 1.0 TiB avail; 207 KiB/s rd, 2.1 MiB/s wr, 23 op/s 2024-03-27T08:38:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:12 smithi164 ceph-mon[31788]: pgmap v527: 97 pgs: 97 active+clean; 133 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-27T08:38:13.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:12 smithi167 ceph-mon[34903]: pgmap v527: 97 pgs: 97 active+clean; 133 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-27T08:38:13.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:12 smithi173 ceph-mon[35397]: pgmap v527: 97 pgs: 97 active+clean; 133 MiB data, 835 MiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 1.7 MiB/s wr, 27 op/s 2024-03-27T08:38:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:14 smithi164 ceph-mon[31788]: pgmap v528: 97 pgs: 97 active+clean; 133 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-03-27T08:38:15.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:14 smithi167 ceph-mon[34903]: pgmap v528: 97 pgs: 97 active+clean; 133 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-03-27T08:38:15.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:14 smithi173 ceph-mon[35397]: pgmap v528: 97 pgs: 97 active+clean; 133 MiB data, 840 MiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 1.3 MiB/s wr, 40 op/s 2024-03-27T08:38:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 -- 172.21.15.164:0/2447317326 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68103db0 msgr2=0x7f3b681041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 --2- 172.21.15.164:0/2447317326 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68103db0 0x7f3b681041d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c009900 tx=0x7f3b5c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 -- 172.21.15.164:0/2447317326 shutdown_connections 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 --2- 172.21.15.164:0/2447317326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68105960 0x7f3b6810c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 --2- 172.21.15.164:0/2447317326 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 0x7f3b68105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 --2- 172.21.15.164:0/2447317326 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68103db0 0x7f3b681041d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 -- 172.21.15.164:0/2447317326 >> 172.21.15.164:0/2447317326 conn(0x7f3b680ff340 msgr2=0x7f3b68101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.808+0000 7f3b6f400640 1 -- 172.21.15.164:0/2447317326 shutdown_connections 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.809+0000 7f3b6f400640 1 -- 172.21.15.164:0/2447317326 wait complete. 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.809+0000 7f3b6f400640 1 Processor -- start 2024-03-27T08:38:15.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 -- start start 2024-03-27T08:38:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68103db0 0x7f3b6819a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 0x7f3b6819a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.803 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6810fa60 con 0x7f3b68105960 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6810f8e0 con 0x7f3b68103db0 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6f400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6810fbe0 con 0x7f3b68104fa0 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50914/0 (socket says 172.21.15.164:50914) 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6d400640 1 -- 172.21.15.164:0/770734466 learned_addr learned my addr 172.21.15.164:0/770734466 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b6ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68103db0 0x7f3b6819a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.810+0000 7f3b67e00640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 0x7f3b6819a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 -- 172.21.15.164:0/770734466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 msgr2=0x7f3b6819a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 0x7f3b6819a580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 -- 172.21.15.164:0/770734466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68103db0 msgr2=0x7f3b6819a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68103db0 0x7f3b6819a040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 -- 172.21.15.164:0/770734466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b681a1c60 con 0x7f3b68105960 2024-03-27T08:38:15.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6d400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009fd0 tx=0x7f3b6000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b65600640 1 -- 172.21.15.164:0/770734466 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60017070 con 0x7f3b68105960 2024-03-27T08:38:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b65600640 1 -- 172.21.15.164:0/770734466 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3b60003e40 con 0x7f3b68105960 2024-03-27T08:38:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b681a1f50 con 0x7f3b68105960 2024-03-27T08:38:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b65600640 1 -- 172.21.15.164:0/770734466 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600106c0 con 0x7f3b68105960 2024-03-27T08:38:15.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.811+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b681a23c0 con 0x7f3b68105960 2024-03-27T08:38:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b65600640 1 -- 172.21.15.164:0/770734466 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3b60003970 con 0x7f3b68105960 2024-03-27T08:38:15.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 Processor -- start 2024-03-27T08:38:15.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 -- start start 2024-03-27T08:38:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff0bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.808 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff10e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562f3fe70d10 con 0x562f3ff114e0 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f3fe19260 con 0x562f3ff0c370 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.815+0000 7f3b72033740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f3fe6ccc0 con 0x562f3ff0b980 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50926/0 (socket says 172.21.15.164:50926) 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 -- 172.21.15.164:0/2693002180 learned_addr learned my addr 172.21.15.164:0/2693002180 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b6ca00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff10e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff0bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 -- 172.21.15.164:0/2693002180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 msgr2=0x562f3ff0bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff0bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 -- 172.21.15.164:0/2693002180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 msgr2=0x562f3ff10e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff10e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 -- 172.21.15.164:0/2693002180 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3fe10aa0 con 0x562f3ff114e0 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.816+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3b540058c0 tx=0x7f3b5400c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b90cb4570071e0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b65600640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 0x7f3b500a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b59c00640 1 -- 172.21.15.164:0/2693002180 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54005020 con 0x562f3ff114e0 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b59c00640 1 -- 172.21.15.164:0/2693002180 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3b540047a0 con 0x562f3ff114e0 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b59c00640 1 -- 172.21.15.164:0/2693002180 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011700 con 0x562f3ff114e0 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b65600640 1 -- 172.21.15.164:0/770734466 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3b600cfa80 con 0x7f3b68105960 2024-03-27T08:38:15.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.817+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 0x7f3b500a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- 172.21.15.164:0/2693002180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 msgr2=0x562f3ff13970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f3b540058c0 tx=0x7f3b5400c4d0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- 172.21.15.164:0/2693002180 shutdown_connections 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff13970 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff10e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.814 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 --2- 172.21.15.164:0/2693002180 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff0bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- 172.21.15.164:0/2693002180 >> 172.21.15.164:0/2693002180 conn(0x562f3ff06ef0 msgr2=0x562f3ff072f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- 172.21.15.164:0/2693002180 shutdown_connections 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 0x7f3b500a5b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c02c170 tx=0x7f3b5c02c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- 172.21.15.164:0/2693002180 wait complete. 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.818+0000 7f3b72033740 1 -- start start 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 Processor -- start 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0b980 0x562f3ff15c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff114e0 0x562f3ff1d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x562f3ff144e0 con 0x562f3ff0b980 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f3fe2c630 con 0x562f3ff0c370 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x562f3ff14660 con 0x562f3ff114e0 2024-03-27T08:38:15.815 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b72033740 10 client.0 _ll_register_callbacks cb 0x562f3fe31c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b6ca00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0b980 0x562f3ff15c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:46416/0 (socket says 172.21.15.164:46416) 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b67e00640 1 -- 172.21.15.164:0/767070284 learned_addr learned my addr 172.21.15.164:0/767070284 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.819+0000 7f3b6d400640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff114e0 0x562f3ff1d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 -- 172.21.15.164:0/767070284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff114e0 msgr2=0x562f3ff1d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff114e0 0x562f3ff1d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 -- 172.21.15.164:0/767070284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0b980 msgr2=0x562f3ff15c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0b980 0x562f3ff15c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 -- 172.21.15.164:0/767070284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3fe385f0 con 0x562f3ff0c370 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b67e00640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b54005250 tx=0x7f3b54005280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6152b216730a686e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.820+0000 7f3b4e000640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54011910 con 0x562f3ff0c370 2024-03-27T08:38:15.816 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3b54011ab0 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b540047a0 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b54030050 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b72033740 10 client.35864 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.821+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f3fb85210 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3b540047a0 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3b5401fa30 con 0x562f3ff0c370 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 10 client.35864 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 10 client.35864 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 20 client.35864 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff21730 0x562f3ff23b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 4 client.35864 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.822+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f3fe7e250 con 0x562f3ff21730 2024-03-27T08:38:15.817 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.823+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff21730 0x562f3ff23b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.823+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff21730 0x562f3ff23b40 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=440baa77239b77cb server_cookie=cdeda353214812b6 in_seq=0 out_seq=0 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.823+0000 7f3b4e000640 10 client.35864 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b4e000640 1 -- 172.21.15.164:0/767070284 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x562f3fe7e250 con 0x562f3ff21730 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b4e000640 10 client.35864 handle_command_reply: tid=0 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 client.35864 shutdown 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 msgr2=0x562f3ff16150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f3b54005250 tx=0x7f3b54005280 comp rx=0 tx=0).stop 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 shutdown_connections 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff21730 0x562f3ff23b40 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff114e0 0x562f3ff1d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff16150 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.819 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b4e000640 0 client.35864 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 --2- 172.21.15.164:0/767070284 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0b980 0x562f3ff15c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.824+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 >> 172.21.15.164:0/767070284 conn(0x562f3ff06ef0 msgr2=0x562f3ff060f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.825+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 shutdown_connections 2024-03-27T08:38:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.825+0000 7f3b72033740 1 -- 172.21.15.164:0/767070284 wait complete. 2024-03-27T08:38:15.820 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.825+0000 7f3b72033740 20 client.35864 trim_cache size 0 max 16384 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 Processor -- start 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 -- start start 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff23b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 0x562f3ff1d150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681adab0 con 0x562f3ff0c370 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681ab320 con 0x562f3ff114e0 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.843+0000 7f3b72033740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a9170 con 0x562f3ff0b980 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50936/0 (socket says 172.21.15.164:50936) 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 -- 172.21.15.164:0/2959828205 learned_addr learned my addr 172.21.15.164:0/2959828205 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:15.836 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b6d400640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 0x562f3ff1d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff23b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 -- 172.21.15.164:0/2959828205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 msgr2=0x562f3ff23b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff23b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 -- 172.21.15.164:0/2959828205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 msgr2=0x562f3ff1d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 0x562f3ff1d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 -- 172.21.15.164:0/2959828205 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f3fc51620 con 0x562f3ff0c370 2024-03-27T08:38:15.837 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b6d400640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 0x562f3ff1d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.844+0000 7f3b67e00640 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3b54005f50 tx=0x7f3b54005cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64264d4f8ca3b674 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b59200640 1 -- 172.21.15.164:0/2959828205 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b54004780 con 0x562f3ff0c370 2024-03-27T08:38:15.840 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b59200640 1 -- 172.21.15.164:0/2959828205 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3b54039020 con 0x562f3ff0c370 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b59200640 1 -- 172.21.15.164:0/2959828205 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b540052f0 con 0x562f3ff0c370 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 -- 172.21.15.164:0/2959828205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 msgr2=0x562f3ff15230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f3b54005f50 tx=0x7f3b54005cb0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 -- 172.21.15.164:0/2959828205 shutdown_connections 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff114e0 0x562f3ff1d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff0c370 0x562f3ff15230 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 --2- 172.21.15.164:0/2959828205 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff23b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.845+0000 7f3b72033740 1 -- 172.21.15.164:0/2959828205 >> 172.21.15.164:0/2959828205 conn(0x562f3ff06ef0 msgr2=0x562f3ff072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- 172.21.15.164:0/2959828205 shutdown_connections 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- 172.21.15.164:0/2959828205 wait complete. 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- start start 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 Processor -- start 2024-03-27T08:38:15.841 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff1a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff1a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a97e0 con 0x562f3ff114e0 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681aac50 con 0x562f3ff0c370 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.846+0000 7f3b72033740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f3b681a9eb0 con 0x562f3ff0b980 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b72033740 10 client.0 _ll_register_callbacks cb 0x7f3b5c005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:50942/0 (socket says 172.21.15.164:50942) 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 -- 172.21.15.164:0/888431149 learned_addr learned my addr 172.21.15.164:0/888431149 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b67e00640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff1a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff1a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 -- 172.21.15.164:0/888431149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 msgr2=0x562f3ff1a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.842 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff1a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 -- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 msgr2=0x562f3ff1a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff1a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 -- 172.21.15.164:0/888431149 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f3ff85f70 con 0x562f3ff114e0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b6d400640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3b6009bef0 tx=0x7f3b60004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4315ca0b8aea419 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.847+0000 7f3b4e000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b60020040 con 0x562f3ff114e0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3b600985d0 con 0x562f3ff114e0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3b54039020 con 0x562f3ff114e0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3b6009bf60 con 0x562f3ff114e0 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 10 client.16191 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:15.843 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x562f3ff87260 con 0x562f3ff114e0 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3b54039020 con 0x562f3ff114e0 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3b60097cb0 con 0x562f3ff114e0 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 10 client.16191 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 10 client.16191 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.848+0000 7f3b72033740 20 client.16191 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:15.844 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff87c70 0x562f3ff8a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b72033740 4 client.16191 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:38:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562f3fe785a0 con 0x562f3ff87c70 2024-03-27T08:38:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff87c70 0x562f3ff8a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b4e000640 10 client.16191 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:15.845 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.849+0000 7f3b6ca00640 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff87c70 0x562f3ff8a090 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=745630f93bfb9433 server_cookie=97b04fea91de806c in_seq=0 out_seq=0 2024-03-27T08:38:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.890+0000 7f3b4e000640 1 -- 172.21.15.164:0/888431149 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562f3fe785a0 con 0x562f3ff87c70 2024-03-27T08:38:15.886 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.890+0000 7f3b4e000640 10 client.16191 handle_command_reply: tid=0 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.890+0000 7f3b72033740 1 client.16191 shutdown 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 msgr2=0x562f3ff85a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3b6009bef0 tx=0x7f3b60004270 comp rx=0 tx=0).stop 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 shutdown_connections 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x562f3ff87c70 0x562f3ff8a090 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x562f3ff114e0 0x562f3ff85a30 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f3ff0c370 0x562f3ff1a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.887 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 --2- 172.21.15.164:0/888431149 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x562f3ff0b980 0x562f3ff1a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 >> 172.21.15.164:0/888431149 conn(0x562f3ff06ef0 msgr2=0x562f3ff072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b4e000640 0 client.16191 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 shutdown_connections 2024-03-27T08:38:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 1 -- 172.21.15.164:0/888431149 wait complete. 2024-03-27T08:38:15.888 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.891+0000 7f3b72033740 20 client.16191 trim_cache size 0 max 16384 2024-03-27T08:38:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:38:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:38:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:38:15.889 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 msgr2=0x7f3b500a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 0x7f3b500a5b70 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c02c170 tx=0x7f3b5c02c820 comp rx=0 tx=0).stop 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 msgr2=0x7f3b681a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f3b60009fd0 tx=0x7f3b6000b260 comp rx=0 tx=0).stop 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 shutdown_connections 2024-03-27T08:38:15.890 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f3b500a36b0 0x7f3b500a5b70 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3b68105960 0x7f3b681a15f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3b68104fa0 0x7f3b6819a580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 --2- 172.21.15.164:0/770734466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3b68103db0 0x7f3b6819a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.892+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 >> 172.21.15.164:0/770734466 conn(0x7f3b680ff340 msgr2=0x7f3b68108240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.893+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 shutdown_connections 2024-03-27T08:38:15.891 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:15.893+0000 7f3b6f400640 1 -- 172.21.15.164:0/770734466 wait complete. 2024-03-27T08:38:17.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:16 smithi164 ceph-mon[31788]: pgmap v529: 97 pgs: 97 active+clean; 133 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-03-27T08:38:17.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:16 smithi167 ceph-mon[34903]: pgmap v529: 97 pgs: 97 active+clean; 133 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-03-27T08:38:17.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:16 smithi173 ceph-mon[35397]: pgmap v529: 97 pgs: 97 active+clean; 133 MiB data, 843 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.0 MiB/s wr, 51 op/s 2024-03-27T08:38:18.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:17 smithi164 ceph-mon[31788]: pgmap v530: 97 pgs: 97 active+clean; 135 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 794 KiB/s wr, 67 op/s 2024-03-27T08:38:18.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:17 smithi167 ceph-mon[34903]: pgmap v530: 97 pgs: 97 active+clean; 135 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 794 KiB/s wr, 67 op/s 2024-03-27T08:38:18.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:17 smithi173 ceph-mon[35397]: pgmap v530: 97 pgs: 97 active+clean; 135 MiB data, 844 MiB used, 1.0 TiB / 1.0 TiB avail; 182 KiB/s rd, 794 KiB/s wr, 67 op/s 2024-03-27T08:38:20.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:20 smithi164 ceph-mon[31788]: pgmap v531: 97 pgs: 97 active+clean; 135 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 857 KiB/s wr, 101 op/s 2024-03-27T08:38:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:20 smithi167 ceph-mon[34903]: pgmap v531: 97 pgs: 97 active+clean; 135 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 857 KiB/s wr, 101 op/s 2024-03-27T08:38:20.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:20 smithi173 ceph-mon[35397]: pgmap v531: 97 pgs: 97 active+clean; 135 MiB data, 849 MiB used, 1.0 TiB / 1.0 TiB avail; 228 KiB/s rd, 857 KiB/s wr, 101 op/s 2024-03-27T08:38:22.754 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:22 smithi164 ceph-mon[31788]: pgmap v532: 97 pgs: 97 active+clean; 136 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 115 op/s 2024-03-27T08:38:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:22 smithi167 ceph-mon[34903]: pgmap v532: 97 pgs: 97 active+clean; 136 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 115 op/s 2024-03-27T08:38:22.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:22 smithi173 ceph-mon[35397]: pgmap v532: 97 pgs: 97 active+clean; 136 MiB data, 851 MiB used, 1.0 TiB / 1.0 TiB avail; 253 KiB/s rd, 340 KiB/s wr, 115 op/s 2024-03-27T08:38:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:24 smithi167 ceph-mon[34903]: pgmap v533: 97 pgs: 97 active+clean; 136 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 326 KiB/s wr, 121 op/s 2024-03-27T08:38:24.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:24 smithi173 ceph-mon[35397]: pgmap v533: 97 pgs: 97 active+clean; 136 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 326 KiB/s wr, 121 op/s 2024-03-27T08:38:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:24 smithi164 ceph-mon[31788]: pgmap v533: 97 pgs: 97 active+clean; 136 MiB data, 852 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 326 KiB/s wr, 121 op/s 2024-03-27T08:38:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:26 smithi167 ceph-mon[34903]: pgmap v534: 97 pgs: 97 active+clean; 136 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 339 KiB/s wr, 124 op/s 2024-03-27T08:38:26.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:26 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:38:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:26 smithi173 ceph-mon[35397]: pgmap v534: 97 pgs: 97 active+clean; 136 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 339 KiB/s wr, 124 op/s 2024-03-27T08:38:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:26 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:38:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:26 smithi164 ceph-mon[31788]: pgmap v534: 97 pgs: 97 active+clean; 136 MiB data, 855 MiB used, 1.0 TiB / 1.0 TiB avail; 256 KiB/s rd, 339 KiB/s wr, 124 op/s 2024-03-27T08:38:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:26 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:38:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:27 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:38:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:27 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:38:27.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:27 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:38:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:38:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:38:27.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:38:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:38:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:38:28.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:38:28.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:28 smithi167 ceph-mon[34903]: pgmap v535: 97 pgs: 97 active+clean; 138 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 480 KiB/s wr, 134 op/s 2024-03-27T08:38:28.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:28 smithi173 ceph-mon[35397]: pgmap v535: 97 pgs: 97 active+clean; 138 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 480 KiB/s wr, 134 op/s 2024-03-27T08:38:28.905 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:28 smithi164 ceph-mon[31788]: pgmap v535: 97 pgs: 97 active+clean; 138 MiB data, 857 MiB used, 1.0 TiB / 1.0 TiB avail; 374 KiB/s rd, 480 KiB/s wr, 134 op/s 2024-03-27T08:38:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 -- 172.21.15.164:0/3969751514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 msgr2=0x7f89f0104890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 --2- 172.21.15.164:0/3969751514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0104890 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009900 tx=0x7f89e002bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 -- 172.21.15.164:0/3969751514 shutdown_connections 2024-03-27T08:38:29.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 --2- 172.21.15.164:0/3969751514 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0107700 0x7f89f0109af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 --2- 172.21.15.164:0/3969751514 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0104dd0 0x7f89f01071c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 --2- 172.21.15.164:0/3969751514 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0104890 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 -- 172.21.15.164:0/3969751514 >> 172.21.15.164:0/3969751514 conn(0x7f89f00fbe30 msgr2=0x7f89f00fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 -- 172.21.15.164:0/3969751514 shutdown_connections 2024-03-27T08:38:29.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.038+0000 7f89efe00640 1 -- 172.21.15.164:0/3969751514 wait complete. 2024-03-27T08:38:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.039+0000 7f89efe00640 1 Processor -- start 2024-03-27T08:38:29.032 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 -- start start 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 0x7f89f019a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0107700 0x7f89f01a14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89f010d620 con 0x7f89f01024a0 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89f010d4a0 con 0x7f89f0104dd0 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89efe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89f010d7a0 con 0x7f89f0107700 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89eea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89eea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42032/0 (socket says 172.21.15.164:42032) 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89eea00640 1 -- 172.21.15.164:0/3132174508 learned_addr learned my addr 172.21.15.164:0/3132174508 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.040+0000 7f89ee000640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 0x7f89f019a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89ef400640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0107700 0x7f89f01a14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 -- 172.21.15.164:0/3132174508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0107700 msgr2=0x7f89f01a14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0107700 0x7f89f01a14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 -- 172.21.15.164:0/3132174508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 msgr2=0x7f89f019a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 0x7f89f019a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 -- 172.21.15.164:0/3132174508 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f01a1b10 con 0x7f89f01024a0 2024-03-27T08:38:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89ee000640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 0x7f89f019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:29.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.041+0000 7f89eea00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009230 tx=0x7f89e0004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.042+0000 7f89e7400640 1 -- 172.21.15.164:0/3132174508 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0043020 con 0x7f89f01024a0 2024-03-27T08:38:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.042+0000 7f89e7400640 1 -- 172.21.15.164:0/3132174508 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89e0005460 con 0x7f89f01024a0 2024-03-27T08:38:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.042+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f01a1da0 con 0x7f89f01024a0 2024-03-27T08:38:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.042+0000 7f89e7400640 1 -- 172.21.15.164:0/3132174508 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0003c60 con 0x7f89f01024a0 2024-03-27T08:38:29.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.042+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f01a2210 con 0x7f89f01024a0 2024-03-27T08:38:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.045+0000 7f89e7400640 1 -- 172.21.15.164:0/3132174508 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f89e0046020 con 0x7f89f01024a0 2024-03-27T08:38:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 Processor -- start 2024-03-27T08:38:29.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 -- start start 2024-03-27T08:38:29.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad683b60 0x5626ad683f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad68bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5626ad5e8d10 con 0x5626ad683b60 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5626ad591260 con 0x5626ad684550 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.046+0000 7f89f89b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5626ad5e4cc0 con 0x5626ad6896c0 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89ef400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad683b60 0x5626ad683f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33882/0 (socket says 172.21.15.164:33882) 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 -- 172.21.15.164:0/1446116724 learned_addr learned my addr 172.21.15.164:0/1446116724 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89ee000640 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad68bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89e7400640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 0x7f89d40a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 -- 172.21.15.164:0/1446116724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 msgr2=0x5626ad68bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad68bb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 -- 172.21.15.164:0/1446116724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad683b60 msgr2=0x5626ad683f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad683b60 0x5626ad683f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.047+0000 7f89eea00640 1 -- 172.21.15.164:0/1446116724 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ad588aa0 con 0x5626ad684550 2024-03-27T08:38:29.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.048+0000 7f89e7400640 1 -- 172.21.15.164:0/3132174508 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f89e00f1a50 con 0x7f89f01024a0 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.048+0000 7f89ef400640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 0x7f89d40a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.048+0000 7f89eea00640 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89e0075c30 tx=0x7f89e002bc30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=766f0c250f52336c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.048+0000 7f89ef400640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 0x7f89d40a5ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5626ad684db0 tx=0x7f89e8004a40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.048+0000 7f89dbe00640 1 -- 172.21.15.164:0/1446116724 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00bdca0 con 0x5626ad684550 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89dbe00640 1 -- 172.21.15.164:0/1446116724 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89e00035f0 con 0x5626ad684550 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89dbe00640 1 -- 172.21.15.164:0/1446116724 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e0075a90 con 0x5626ad684550 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 -- 172.21.15.164:0/1446116724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 msgr2=0x5626ad689050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89e0075c30 tx=0x7f89e002bc30 comp rx=0 tx=0).stop 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 -- 172.21.15.164:0/1446116724 shutdown_connections 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad68bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad689050 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 --2- 172.21.15.164:0/1446116724 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad683b60 0x5626ad683f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.049+0000 7f89f89b4740 1 -- 172.21.15.164:0/1446116724 >> 172.21.15.164:0/1446116724 conn(0x5626ad67f0d0 msgr2=0x5626ad67f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.050+0000 7f89f89b4740 1 -- 172.21.15.164:0/1446116724 shutdown_connections 2024-03-27T08:38:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.050+0000 7f89f89b4740 1 -- 172.21.15.164:0/1446116724 wait complete. 2024-03-27T08:38:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.050+0000 7f89f89b4740 1 -- start start 2024-03-27T08:38:29.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.050+0000 7f89f89b4740 1 Processor -- start 2024-03-27T08:38:29.045 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 0x5626ad68de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad694e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5626ad591260 con 0x5626ad6896c0 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5626ad5a4630 con 0x5626ad683b60 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5626ad68c430 con 0x5626ad684550 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89f89b4740 10 client.0 _ll_register_callbacks cb 0x5626ad5a9c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89eea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89ef400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad694e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89eea00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33884/0 (socket says 172.21.15.164:33884) 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.051+0000 7f89eea00640 1 -- 172.21.15.164:0/3465163989 learned_addr learned my addr 172.21.15.164:0/3465163989 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:29.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89ee000640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 0x5626ad68de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 -- 172.21.15.164:0/3465163989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 msgr2=0x5626ad68de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 0x5626ad68de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 -- 172.21.15.164:0/3465163989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 msgr2=0x5626ad694e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad694e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 -- 172.21.15.164:0/3465163989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ad5b05f0 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89ee000640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 0x5626ad68de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89eea00640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e00f3ee0 tx=0x7f89e002ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bf6c4253bb4f636 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.052+0000 7f89d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e00bd830 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f89e00d7190 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5626ad5f6250 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89e00bda10 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89f89b4740 10 client.35882 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626ad2fd210 con 0x5626ad683b60 2024-03-27T08:38:29.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5626ad5f6250 con 0x5626ad683b60 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.053+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f89e00b9c20 con 0x5626ad683b60 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 10 client.35882 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 10 client.35882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 20 client.35882 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad6996f0 0x5626ad69bb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 4 client.35882 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626ad5f05a0 con 0x5626ad6996f0 2024-03-27T08:38:29.048 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.054+0000 7f89ee000640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad6996f0 0x5626ad69bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.049 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.055+0000 7f89ee000640 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad6996f0 0x5626ad69bb50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6b5cb24bf80a2457 server_cookie=1fe78f98b76b2f9b in_seq=0 out_seq=0 2024-03-27T08:38:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.055+0000 7f89d8c00640 10 client.35882 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89d8c00640 1 -- 172.21.15.164:0/3465163989 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5626ad5f05a0 con 0x5626ad6996f0 2024-03-27T08:38:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89d8c00640 10 client.35882 handle_command_reply: tid=0 2024-03-27T08:38:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 client.35882 shutdown 2024-03-27T08:38:29.050 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 msgr2=0x5626ad68d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f89e00f3ee0 tx=0x7f89e002ce20 comp rx=0 tx=0).stop 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 shutdown_connections 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad6996f0 0x5626ad69bb50 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad694e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad684550 0x5626ad68de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89d8c00640 0 client.35882 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 --2- 172.21.15.164:0/3465163989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad683b60 0x5626ad68d8f0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 >> 172.21.15.164:0/3465163989 conn(0x5626ad67f0d0 msgr2=0x5626ad67e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 shutdown_connections 2024-03-27T08:38:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.056+0000 7f89f89b4740 1 -- 172.21.15.164:0/3465163989 wait complete. 2024-03-27T08:38:29.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.057+0000 7f89f89b4740 20 client.35882 trim_cache size 0 max 16384 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 Processor -- start 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 -- start start 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad682a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad694e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01ad8e0 con 0x5626ad68cf40 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01ab150 con 0x5626ad684550 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89f89b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01a8fa0 con 0x5626ad6896c0 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89ef400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89ef400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42064/0 (socket says 172.21.15.164:42064) 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89ef400640 1 -- 172.21.15.164:0/2218118133 learned_addr learned my addr 172.21.15.164:0/2218118133 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.074+0000 7f89eea00640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad682a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ee000640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad694e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 -- 172.21.15.164:0/2218118133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 msgr2=0x5626ad694e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad694e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 -- 172.21.15.164:0/2218118133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 msgr2=0x5626ad682a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad682a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 -- 172.21.15.164:0/2218118133 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626ad3c9620 con 0x5626ad68cf40 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89eea00640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad682a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:29.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89ef400640 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009ae0 tx=0x7f89e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e459d9fbfc9857d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.075+0000 7f89db400640 1 -- 172.21.15.164:0/2218118133 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e80045e0 con 0x5626ad68cf40 2024-03-27T08:38:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89db400640 1 -- 172.21.15.164:0/2218118133 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89e8004780 con 0x5626ad68cf40 2024-03-27T08:38:29.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89db400640 1 -- 172.21.15.164:0/2218118133 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e80118b0 con 0x5626ad68cf40 2024-03-27T08:38:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 -- 172.21.15.164:0/2218118133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 msgr2=0x5626ad68d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f89e8009ae0 tx=0x7f89e8016000 comp rx=0 tx=0).stop 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 -- 172.21.15.164:0/2218118133 shutdown_connections 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad68cf40 0x5626ad68d3a0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad6896c0 0x5626ad694e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2218118133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad682a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.076+0000 7f89f89b4740 1 -- 172.21.15.164:0/2218118133 >> 172.21.15.164:0/2218118133 conn(0x5626ad67f0d0 msgr2=0x5626ad682330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.077+0000 7f89f89b4740 1 -- 172.21.15.164:0/2218118133 shutdown_connections 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.077+0000 7f89f89b4740 1 -- 172.21.15.164:0/2218118133 wait complete. 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.077+0000 7f89f89b4740 1 -- start start 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.077+0000 7f89f89b4740 1 Processor -- start 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad692900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 0x5626ad693d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01a9610 con 0x5626ad6896c0 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01aaa80 con 0x5626ad684550 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f89f01a9ce0 con 0x5626ad68cf40 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89f89b4740 10 client.0 _ll_register_callbacks cb 0x7f89e80099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:42066/0 (socket says 172.21.15.164:42066) 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 -- 172.21.15.164:0/2663850430 learned_addr learned my addr 172.21.15.164:0/2663850430 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89eea00640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad692900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ef400640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 0x5626ad693d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 -- 172.21.15.164:0/2663850430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 msgr2=0x5626ad693d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 0x5626ad693d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.078+0000 7f89ee000640 1 -- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 msgr2=0x5626ad692900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89ee000640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad692900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89ee000640 1 -- 172.21.15.164:0/2663850430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626ad694330 con 0x5626ad6896c0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89ef400640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 0x5626ad693d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89eea00640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad692900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89ee000640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0041f0 tx=0x7f89dc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705890654b7f6953 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89d8c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89dc01de60 con 0x5626ad6896c0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f89e8004780 con 0x5626ad6896c0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.079+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f89dc01d5b0 con 0x5626ad6896c0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f89dc02d050 con 0x5626ad6896c0 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 10 client.16209 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:29.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5626ad6ffd70 con 0x5626ad6896c0 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89e8004780 con 0x5626ad6896c0 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f89dc010430 con 0x5626ad6896c0 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 10 client.16209 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 10 client.16209 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 20 client.16209 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad700800 0x5626ad702c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 4 client.16209 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.080+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5626ad56e630 con 0x5626ad700800 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.081+0000 7f89eea00640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad700800 0x5626ad702c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.081+0000 7f89eea00640 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad700800 0x5626ad702c20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=295e80c7d137fde6 server_cookie=ae99cef02d5d61a9 in_seq=0 out_seq=0 2024-03-27T08:38:29.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.081+0000 7f89d8c00640 10 client.16209 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:29.108 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89d8c00640 1 -- 172.21.15.164:0/2663850430 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626ad56e630 con 0x5626ad700800 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89d8c00640 10 client.16209 handle_command_reply: tid=0 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 client.16209 shutdown 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 msgr2=0x5626ad692e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f89dc0041f0 tx=0x7f89dc0039c0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 shutdown_connections 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5626ad700800 0x5626ad702c20 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5626ad68cf40 0x5626ad693d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5626ad6896c0 0x5626ad692e40 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 --2- 172.21.15.164:0/2663850430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5626ad684550 0x5626ad692900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.109 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 >> 172.21.15.164:0/2663850430 conn(0x5626ad67f0d0 msgr2=0x5626ad67da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89d8c00640 0 client.16209 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 shutdown_connections 2024-03-27T08:38:29.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 1 -- 172.21.15.164:0/2663850430 wait complete. 2024-03-27T08:38:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.116+0000 7f89f89b4740 20 client.16209 trim_cache size 0 max 16384 2024-03-27T08:38:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:38:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:38:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:38:29.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.117+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 msgr2=0x7f89d40a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.117+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 0x7f89d40a5ac0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5626ad684db0 tx=0x7f89e8004a40 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.117+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 msgr2=0x7f89f0199ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.117+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f89e0009230 tx=0x7f89e0004e20 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 shutdown_connections 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f89d40a3600 0x7f89d40a5ac0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f89f0107700 0x7f89f01a14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89f0104dd0 0x7f89f019a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 --2- 172.21.15.164:0/3132174508 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f89f01024a0 0x7f89f0199ef0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:29.112 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 >> 172.21.15.164:0/3132174508 conn(0x7f89f00fbe30 msgr2=0x7f89f0101c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 shutdown_connections 2024-03-27T08:38:29.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:29.118+0000 7f89efe00640 1 -- 172.21.15.164:0/3132174508 wait complete. 2024-03-27T08:38:30.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:30 smithi167 ceph-mon[34903]: pgmap v536: 97 pgs: 97 active+clean; 138 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 139 op/s 2024-03-27T08:38:30.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:30 smithi173 ceph-mon[35397]: pgmap v536: 97 pgs: 97 active+clean; 138 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 139 op/s 2024-03-27T08:38:31.007 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:30 smithi164 ceph-mon[31788]: pgmap v536: 97 pgs: 97 active+clean; 138 MiB data, 858 MiB used, 1.0 TiB / 1.0 TiB avail; 271 KiB/s rd, 373 KiB/s wr, 139 op/s 2024-03-27T08:38:32.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:32 smithi167 ceph-mon[34903]: pgmap v537: 97 pgs: 97 active+clean; 138 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-03-27T08:38:32.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:32 smithi173 ceph-mon[35397]: pgmap v537: 97 pgs: 97 active+clean; 138 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-03-27T08:38:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:32 smithi164 ceph-mon[31788]: pgmap v537: 97 pgs: 97 active+clean; 138 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 335 KiB/s wr, 118 op/s 2024-03-27T08:38:34.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:34 smithi167 ceph-mon[34903]: pgmap v538: 97 pgs: 97 active+clean; 139 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 375 KiB/s wr, 118 op/s 2024-03-27T08:38:34.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:34 smithi173 ceph-mon[35397]: pgmap v538: 97 pgs: 97 active+clean; 139 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 375 KiB/s wr, 118 op/s 2024-03-27T08:38:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:34 smithi164 ceph-mon[31788]: pgmap v538: 97 pgs: 97 active+clean; 139 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 303 KiB/s rd, 375 KiB/s wr, 118 op/s 2024-03-27T08:38:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:36 smithi167 ceph-mon[34903]: pgmap v539: 97 pgs: 97 active+clean; 139 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 397 KiB/s wr, 127 op/s 2024-03-27T08:38:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:36 smithi173 ceph-mon[35397]: pgmap v539: 97 pgs: 97 active+clean; 139 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 397 KiB/s wr, 127 op/s 2024-03-27T08:38:37.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:36 smithi164 ceph-mon[31788]: pgmap v539: 97 pgs: 97 active+clean; 139 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 324 KiB/s rd, 397 KiB/s wr, 127 op/s 2024-03-27T08:38:38.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:38 smithi167 ceph-mon[34903]: pgmap v540: 97 pgs: 97 active+clean; 141 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 465 KiB/s wr, 126 op/s 2024-03-27T08:38:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:38 smithi173 ceph-mon[35397]: pgmap v540: 97 pgs: 97 active+clean; 141 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 465 KiB/s wr, 126 op/s 2024-03-27T08:38:39.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:38 smithi164 ceph-mon[31788]: pgmap v540: 97 pgs: 97 active+clean; 141 MiB data, 856 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 465 KiB/s wr, 126 op/s 2024-03-27T08:38:40.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:40 smithi167 ceph-mon[34903]: pgmap v541: 97 pgs: 97 active+clean; 141 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 366 KiB/s wr, 120 op/s 2024-03-27T08:38:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:40 smithi173 ceph-mon[35397]: pgmap v541: 97 pgs: 97 active+clean; 141 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 366 KiB/s wr, 120 op/s 2024-03-27T08:38:41.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:40 smithi164 ceph-mon[31788]: pgmap v541: 97 pgs: 97 active+clean; 141 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 366 KiB/s wr, 120 op/s 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 -- 172.21.15.164:0/1287147730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100440 msgr2=0x7f3540100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 --2- 172.21.15.164:0/1287147730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100440 0x7f3540100860 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f3530009900 tx=0x7f353002bc50 comp rx=0 tx=0).stop 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 -- 172.21.15.164:0/1287147730 shutdown_connections 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 --2- 172.21.15.164:0/1287147730 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540101740 0x7f3540101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 --2- 172.21.15.164:0/1287147730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540100da0 0x7f3540101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 --2- 172.21.15.164:0/1287147730 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100440 0x7f3540100860 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 -- 172.21.15.164:0/1287147730 >> 172.21.15.164:0/1287147730 conn(0x7f35400fbfe0 msgr2=0x7f35400fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 -- 172.21.15.164:0/1287147730 shutdown_connections 2024-03-27T08:38:42.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.273+0000 7f3546800640 1 -- 172.21.15.164:0/1287147730 wait complete. 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.274+0000 7f3546800640 1 Processor -- start 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.274+0000 7f3546800640 1 -- start start 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540100440 0x7f3540199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540101740 0x7f35401a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f354010fa30 con 0x7f3540100da0 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f354010f8b0 con 0x7f3540101740 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3546800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f354010fbb0 con 0x7f3540100440 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51194/0 (socket says 172.21.15.164:51194) 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 -- 172.21.15.164:0/3272924055 learned_addr learned my addr 172.21.15.164:0/3272924055 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f353f400640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540100440 0x7f3540199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f353fe00640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540101740 0x7f35401a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.269 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 -- 172.21.15.164:0/3272924055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540100440 msgr2=0x7f3540199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540100440 0x7f3540199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 -- 172.21.15.164:0/3272924055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540101740 msgr2=0x7f35401a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540101740 0x7f35401a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.275+0000 7f3537e00640 1 -- 172.21.15.164:0/3272924055 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35401a1c10 con 0x7f3540100da0 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f3537e00640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9f0 tx=0x7f352800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f353cc00640 1 -- 172.21.15.164:0/3272924055 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352800cd80 con 0x7f3540100da0 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f353cc00640 1 -- 172.21.15.164:0/3272924055 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3528010900 con 0x7f3540100da0 2024-03-27T08:38:42.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35401a1f00 con 0x7f3540100da0 2024-03-27T08:38:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f353cc00640 1 -- 172.21.15.164:0/3272924055 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35280189e0 con 0x7f3540100da0 2024-03-27T08:38:42.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.276+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35401a23c0 con 0x7f3540100da0 2024-03-27T08:38:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.280+0000 7f3549592740 1 Processor -- start 2024-03-27T08:38:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.280+0000 7f3549592740 1 -- start start 2024-03-27T08:38:42.274 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.280+0000 7f353cc00640 1 -- 172.21.15.164:0/3272924055 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f3528010ab0 con 0x7f3540100da0 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.280+0000 7f3549592740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3549592740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed04de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3549592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed050970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3549592740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d2ecfadd10 con 0x55d2ed048980 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3549592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d2ecf56260 con 0x55d2ed04e4e0 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3549592740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2ecfa9cc0 con 0x55d2ed049370 2024-03-27T08:38:42.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51208/0 (socket says 172.21.15.164:51208) 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 -- 172.21.15.164:0/591345568 learned_addr learned my addr 172.21.15.164:0/591345568 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f3537e00640 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed050970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353f400640 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed04de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 -- 172.21.15.164:0/591345568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 msgr2=0x55d2ed04de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed04de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 -- 172.21.15.164:0/591345568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 msgr2=0x55d2ed050970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed050970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.281+0000 7f353fe00640 1 -- 172.21.15.164:0/591345568 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ecf4daa0 con 0x55d2ed048980 2024-03-27T08:38:42.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f353fe00640 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3538009fa0 tx=0x7f353800f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76acbb7431dc8f27 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f353cc00640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 0x7f35240a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f353cc00640 1 -- 172.21.15.164:0/3272924055 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f35280d0320 con 0x7f3540100da0 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f3534c00640 1 -- 172.21.15.164:0/591345568 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538015070 con 0x55d2ed048980 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f3534c00640 1 -- 172.21.15.164:0/591345568 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f353801ab30 con 0x55d2ed048980 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f3534c00640 1 -- 172.21.15.164:0/591345568 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538011d70 con 0x55d2ed048980 2024-03-27T08:38:42.277 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.282+0000 7f353f400640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 0x7f35240a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 -- 172.21.15.164:0/591345568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 msgr2=0x55d2ed048da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f3538009fa0 tx=0x7f353800f7f0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f353f400640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 0x7f35240a5b70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3530006010 tx=0x7f353002c840 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.284 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 -- 172.21.15.164:0/591345568 shutdown_connections 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed050970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed04de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 --2- 172.21.15.164:0/591345568 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed048da0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 -- 172.21.15.164:0/591345568 >> 172.21.15.164:0/591345568 conn(0x55d2ed043ef0 msgr2=0x55d2ed0442f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 -- 172.21.15.164:0/591345568 shutdown_connections 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.283+0000 7f3549592740 1 -- 172.21.15.164:0/591345568 wait complete. 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.284+0000 7f3549592740 1 -- start start 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.284+0000 7f3549592740 1 Processor -- start 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed048980 0x55d2ed052ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed053220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.285 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed0514e0 con 0x55d2ed04e4e0 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d2ecf69630 con 0x55d2ed048980 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55d2ed051660 con 0x55d2ed049370 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f3549592740 10 client.0 _ll_register_callbacks cb 0x55d2ecf6ec50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51216/0 (socket says 172.21.15.164:51216) 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 -- 172.21.15.164:0/3991679088 learned_addr learned my addr 172.21.15.164:0/3991679088 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353f400640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed048980 0x55d2ed052ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.286 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 -- 172.21.15.164:0/3991679088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 msgr2=0x55d2ed053220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed053220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 -- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed048980 msgr2=0x55d2ed052ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed048980 0x55d2ed052ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.285+0000 7f353fe00640 1 -- 172.21.15.164:0/3991679088 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2ecf755f0 con 0x55d2ed04e4e0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f353fe00640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3538011720 tx=0x7f3538009ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdfc974acc728076 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f352d600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3538028060 con 0x55d2ed04e4e0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3538011d00 con 0x55d2ed04e4e0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f353801ab30 con 0x55d2ed04e4e0 2024-03-27T08:38:42.287 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3538015070 con 0x55d2ed04e4e0 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f3549592740 10 client.16221 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2eccc2210 con 0x55d2ed04e4e0 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.286+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f353801ab30 con 0x55d2ed04e4e0 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f3538005040 con 0x55d2ed04e4e0 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 10 client.16221 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 10 client.16221 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 20 client.16221 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed05e850 0x55d2ed060c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 4 client.16221 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2ecfbb250 con 0x55d2ed05e850 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.287+0000 7f353f400640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed05e850 0x55d2ed060c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.288+0000 7f353f400640 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed05e850 0x55d2ed060c90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5eb5dc3673e822 server_cookie=4bc643b5dbf708ef in_seq=0 out_seq=0 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.288+0000 7f352d600640 10 client.16221 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.289+0000 7f352d600640 1 -- 172.21.15.164:0/3991679088 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55d2ecfbb250 con 0x55d2ed05e850 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.289+0000 7f352d600640 10 client.16221 handle_command_reply: tid=0 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.289+0000 7f3549592740 1 client.16221 shutdown 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 msgr2=0x55d2ed05a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f3538011720 tx=0x7f3538009ce0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 shutdown_connections 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed05e850 0x55d2ed060c90 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed04e4e0 0x55d2ed05a260 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed053220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 --2- 172.21.15.164:0/3991679088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed048980 0x55d2ed052ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 >> 172.21.15.164:0/3991679088 conn(0x55d2ed043ef0 msgr2=0x55d2ed0430f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f352d600640 0 client.16221 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 shutdown_connections 2024-03-27T08:38:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 1 -- 172.21.15.164:0/3991679088 wait complete. 2024-03-27T08:38:42.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.290+0000 7f3549592740 20 client.16221 trim_cache size 0 max 16384 2024-03-27T08:38:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.307+0000 7f3549592740 1 Processor -- start 2024-03-27T08:38:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 -- start start 2024-03-27T08:38:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 0x55d2ed03ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.299 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed052ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f35401ada50 con 0x55d2ed049370 2024-03-27T08:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35401ab2c0 con 0x55d2ed04e4e0 2024-03-27T08:38:42.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3549592740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35401a9110 con 0x55d2ed048980 2024-03-27T08:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3537e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3537e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51228/0 (socket says 172.21.15.164:51228) 2024-03-27T08:38:42.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f353fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed052ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.308+0000 7f3537e00640 1 -- 172.21.15.164:0/2785704458 learned_addr learned my addr 172.21.15.164:0/2785704458 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f353f400640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 0x55d2ed03ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 -- 172.21.15.164:0/2785704458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 msgr2=0x55d2ed03ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 0x55d2ed03ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 -- 172.21.15.164:0/2785704458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 msgr2=0x55d2ed052ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed052ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 -- 172.21.15.164:0/2785704458 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2ecd8e620 con 0x55d2ed049370 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f353fe00640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed052ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f353f400640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 0x55d2ed03ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f3537e00640 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3528099220 tx=0x7f352800cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e43f621e6c32c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f352fe00640 1 -- 172.21.15.164:0/2785704458 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352809c620 con 0x55d2ed049370 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f352fe00640 1 -- 172.21.15.164:0/2785704458 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f352809c850 con 0x55d2ed049370 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.309+0000 7f352fe00640 1 -- 172.21.15.164:0/2785704458 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f352809c1b0 con 0x55d2ed049370 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 -- 172.21.15.164:0/2785704458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 msgr2=0x55d2ed05a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f3528099220 tx=0x7f352800cf20 comp rx=0 tx=0).stop 2024-03-27T08:38:42.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 -- 172.21.15.164:0/2785704458 shutdown_connections 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed052ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed049370 0x55d2ed05a220 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 --2- 172.21.15.164:0/2785704458 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed048980 0x55d2ed03ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 -- 172.21.15.164:0/2785704458 >> 172.21.15.164:0/2785704458 conn(0x55d2ed043ef0 msgr2=0x55d2ed04a650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 -- 172.21.15.164:0/2785704458 shutdown_connections 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.310+0000 7f3549592740 1 -- 172.21.15.164:0/2785704458 wait complete. 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 -- start start 2024-03-27T08:38:42.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 Processor -- start 2024-03-27T08:38:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed0572b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed0c2b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f35401a9780 con 0x55d2ed048980 2024-03-27T08:38:42.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35401aabf0 con 0x55d2ed04e4e0 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.311+0000 7f3549592740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f35401a9e50 con 0x55d2ed049370 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f3549592740 10 client.0 _ll_register_callbacks cb 0x7f35280d3c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:51240/0 (socket says 172.21.15.164:51240) 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 -- 172.21.15.164:0/2886036832 learned_addr learned my addr 172.21.15.164:0/2886036832 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:42.310 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353fe00640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed0c2b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f3537e00640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed0572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 -- 172.21.15.164:0/2886036832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 msgr2=0x55d2ed0572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed0572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 -- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 msgr2=0x55d2ed0c2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed0c2b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.312+0000 7f353f400640 1 -- 172.21.15.164:0/2886036832 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2ed05a380 con 0x55d2ed048980 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f353f400640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f35300096c0 tx=0x7f3530009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17a63f6ce8bc22c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f352d600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:42.311 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3530056030 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f3530052d00 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f352809c850 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f3530052310 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f3549592740 10 client.16227 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d2ed0c3fd0 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.313+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f352809c850 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f35300046c0 con 0x55d2ed048980 2024-03-27T08:38:42.312 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 10 client.16227 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 20 client.16227 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed0c4a60 0x55d2ed0c6e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 4 client.16227 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2ecfb55a0 con 0x55d2ed0c4a60 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.314+0000 7f3537e00640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed0c4a60 0x55d2ed0c6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:42.313 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.315+0000 7f352d600640 10 client.16227 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:42.314 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.315+0000 7f3537e00640 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed0c4a60 0x55d2ed0c6e80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d599cf607397befc server_cookie=d258758391b7aac3 in_seq=0 out_seq=0 2024-03-27T08:38:42.439 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.446+0000 7f352d600640 1 -- 172.21.15.164:0/2886036832 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2ecfb55a0 con 0x55d2ed0c4a60 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.446+0000 7f352d600640 10 client.16227 handle_command_reply: tid=0 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.446+0000 7f3549592740 1 client.16227 shutdown 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 msgr2=0x55d2ed056d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f35300096c0 tx=0x7f3530009260 comp rx=0 tx=0).stop 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 shutdown_connections 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55d2ed0c4a60 0x55d2ed0c6e80 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d2ed04e4e0 0x55d2ed0c2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55d2ed049370 0x55d2ed0572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 --2- 172.21.15.164:0/2886036832 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55d2ed048980 0x55d2ed056d70 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.440 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 >> 172.21.15.164:0/2886036832 conn(0x55d2ed043ef0 msgr2=0x55d2ed052ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f352d600640 0 client.16227 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 shutdown_connections 2024-03-27T08:38:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 1 -- 172.21.15.164:0/2886036832 wait complete. 2024-03-27T08:38:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.447+0000 7f3549592740 20 client.16227 trim_cache size 0 max 16384 2024-03-27T08:38:42.441 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:38:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:38:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:38:42.442 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:38:42.446 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 msgr2=0x7f35240a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 0x7f35240a5b70 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3530006010 tx=0x7f353002c840 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 msgr2=0x7f354019a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f352800e9f0 tx=0x7f352800eeb0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 shutdown_connections 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f35240a36b0 0x7f35240a5b70 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3540101740 0x7f35401a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f3540100da0 0x7f354019a530 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 --2- 172.21.15.164:0/3272924055 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f3540100440 0x7f3540199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.448+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 >> 172.21.15.164:0/3272924055 conn(0x7f35400fbfe0 msgr2=0x7f35400fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:42.447 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.449+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 shutdown_connections 2024-03-27T08:38:42.448 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:42.449+0000 7f3546800640 1 -- 172.21.15.164:0/3272924055 wait complete. 2024-03-27T08:38:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:42 smithi167 ceph-mon[34903]: pgmap v542: 97 pgs: 97 active+clean; 141 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 347 KiB/s wr, 106 op/s 2024-03-27T08:38:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:42 smithi173 ceph-mon[35397]: pgmap v542: 97 pgs: 97 active+clean; 141 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 347 KiB/s wr, 106 op/s 2024-03-27T08:38:43.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:42 smithi164 ceph-mon[31788]: pgmap v542: 97 pgs: 97 active+clean; 141 MiB data, 868 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 347 KiB/s wr, 106 op/s 2024-03-27T08:38:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:44 smithi173 ceph-mon[35397]: pgmap v543: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 427 KiB/s wr, 125 op/s 2024-03-27T08:38:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:44 smithi164 ceph-mon[31788]: pgmap v543: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 427 KiB/s wr, 125 op/s 2024-03-27T08:38:45.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:44 smithi167 ceph-mon[34903]: pgmap v543: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 427 KiB/s wr, 125 op/s 2024-03-27T08:38:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:46 smithi164 ceph-mon[31788]: pgmap v544: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 375 KiB/s wr, 137 op/s 2024-03-27T08:38:47.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:46 smithi167 ceph-mon[34903]: pgmap v544: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 375 KiB/s wr, 137 op/s 2024-03-27T08:38:47.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:46 smithi173 ceph-mon[35397]: pgmap v544: 97 pgs: 97 active+clean; 142 MiB data, 859 MiB used, 1.0 TiB / 1.0 TiB avail; 278 KiB/s rd, 375 KiB/s wr, 137 op/s 2024-03-27T08:38:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:48 smithi164 ceph-mon[31788]: pgmap v545: 97 pgs: 97 active+clean; 143 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 426 KiB/s wr, 136 op/s 2024-03-27T08:38:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:48 smithi167 ceph-mon[34903]: pgmap v545: 97 pgs: 97 active+clean; 143 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 426 KiB/s wr, 136 op/s 2024-03-27T08:38:49.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:48 smithi173 ceph-mon[35397]: pgmap v545: 97 pgs: 97 active+clean; 143 MiB data, 861 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 426 KiB/s wr, 136 op/s 2024-03-27T08:38:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:50 smithi164 ceph-mon[31788]: pgmap v546: 97 pgs: 97 active+clean; 144 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 433 KiB/s wr, 139 op/s 2024-03-27T08:38:51.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:50 smithi167 ceph-mon[34903]: pgmap v546: 97 pgs: 97 active+clean; 144 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 433 KiB/s wr, 139 op/s 2024-03-27T08:38:51.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:50 smithi173 ceph-mon[35397]: pgmap v546: 97 pgs: 97 active+clean; 144 MiB data, 871 MiB used, 1.0 TiB / 1.0 TiB avail; 254 KiB/s rd, 433 KiB/s wr, 139 op/s 2024-03-27T08:38:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:52 smithi164 ceph-mon[31788]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 389 KiB/s wr, 134 op/s 2024-03-27T08:38:53.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:52 smithi167 ceph-mon[34903]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 389 KiB/s wr, 134 op/s 2024-03-27T08:38:53.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:52 smithi173 ceph-mon[35397]: pgmap v547: 97 pgs: 97 active+clean; 144 MiB data, 872 MiB used, 1.0 TiB / 1.0 TiB avail; 214 KiB/s rd, 389 KiB/s wr, 134 op/s 2024-03-27T08:38:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:54 smithi164 ceph-mon[31788]: pgmap v548: 97 pgs: 97 active+clean; 145 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 416 KiB/s wr, 142 op/s 2024-03-27T08:38:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:54 smithi167 ceph-mon[34903]: pgmap v548: 97 pgs: 97 active+clean; 145 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 416 KiB/s wr, 142 op/s 2024-03-27T08:38:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:54 smithi173 ceph-mon[35397]: pgmap v548: 97 pgs: 97 active+clean; 145 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 241 KiB/s rd, 416 KiB/s wr, 142 op/s 2024-03-27T08:38:55.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 -- 172.21.15.164:0/3953579018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70102620 msgr2=0x7f6c70108eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 --2- 172.21.15.164:0/3953579018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70102620 0x7f6c70108eb0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6c68009ca0 tx=0x7f6c6802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 -- 172.21.15.164:0/3953579018 shutdown_connections 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 --2- 172.21.15.164:0/3953579018 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70102620 0x7f6c70108eb0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 --2- 172.21.15.164:0/3953579018 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c701020e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 --2- 172.21.15.164:0/3953579018 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70100a70 0x7f6c70100e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 -- 172.21.15.164:0/3953579018 >> 172.21.15.164:0/3953579018 conn(0x7f6c700fbfe0 msgr2=0x7f6c700fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 -- 172.21.15.164:0/3953579018 shutdown_connections 2024-03-27T08:38:55.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.599+0000 7f6c76a00640 1 -- 172.21.15.164:0/3953579018 wait complete. 2024-03-27T08:38:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.600+0000 7f6c76a00640 1 Processor -- start 2024-03-27T08:38:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.600+0000 7f6c76a00640 1 -- start start 2024-03-27T08:38:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c7019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70102620 0x7f6c701a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7010c6d0 con 0x7f6c70100a70 2024-03-27T08:38:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7010c550 con 0x7f6c70101c60 2024-03-27T08:38:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c76a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c7010c850 con 0x7f6c70102620 2024-03-27T08:38:55.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43340/0 (socket says 172.21.15.164:43340) 2024-03-27T08:38:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c6fe00640 1 -- 172.21.15.164:0/1400479755 learned_addr learned my addr 172.21.15.164:0/1400479755 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.601+0000 7f6c6f400640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c7019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c74a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70102620 0x7f6c701a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 -- 172.21.15.164:0/1400479755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70102620 msgr2=0x7f6c701a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70102620 0x7f6c701a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 -- 172.21.15.164:0/1400479755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 msgr2=0x7f6c7019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c7019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 -- 172.21.15.164:0/1400479755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c701a1c20 con 0x7f6c70100a70 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6f400640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c7019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:38:55.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000d950 tx=0x7f6c6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.602+0000 7f6c6cc00640 1 -- 172.21.15.164:0/1400479755 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60017070 con 0x7f6c70100a70 2024-03-27T08:38:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.603+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c701a1f10 con 0x7f6c70100a70 2024-03-27T08:38:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.603+0000 7f6c6cc00640 1 -- 172.21.15.164:0/1400479755 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c60009c30 con 0x7f6c70100a70 2024-03-27T08:38:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.603+0000 7f6c6cc00640 1 -- 172.21.15.164:0/1400479755 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c6000f620 con 0x7f6c70100a70 2024-03-27T08:38:55.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.603+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c701a2370 con 0x7f6c70100a70 2024-03-27T08:38:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 Processor -- start 2024-03-27T08:38:55.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 -- start start 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c6cc00640 1 -- 172.21.15.164:0/1400479755 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f6c6001a070 con 0x7f6c70100a70 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72d3da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72d8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x558fc7238d10 con 0x558fc72d94e0 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fc71e1260 con 0x558fc72d3980 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.606+0000 7f6c795ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558fc7234cc0 con 0x558fc72d4370 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c74a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72d3da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c74a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72d3da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33460/0 (socket says 172.21.15.164:33460) 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43344/0 (socket says 172.21.15.164:43344) 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c74a00640 1 -- 172.21.15.164:0/849354043 learned_addr learned my addr 172.21.15.164:0/849354043 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72d8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 -- 172.21.15.164:0/849354043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 msgr2=0x558fc72d8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72d8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 -- 172.21.15.164:0/849354043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 msgr2=0x558fc72d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72d3da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6f400640 1 -- 172.21.15.164:0/849354043 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc71d8aa0 con 0x558fc72d94e0 2024-03-27T08:38:55.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.607+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72d8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.608+0000 7f6c6f400640 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005d00 tx=0x7f6c5c00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73a545028017f917 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.608+0000 7f6c65200640 1 -- 172.21.15.164:0/849354043 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011700 con 0x558fc72d94e0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.608+0000 7f6c6cc00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 0x7f6c540a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.608+0000 7f6c65200640 1 -- 172.21.15.164:0/849354043 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c5c011d70 con 0x558fc72d94e0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.608+0000 7f6c65200640 1 -- 172.21.15.164:0/849354043 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c01a380 con 0x558fc72d94e0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.609+0000 7f6c6cc00640 1 -- 172.21.15.164:0/1400479755 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f6c600cf6f0 con 0x7f6c70100a70 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.609+0000 7f6c74a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 0x7f6c540a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.609+0000 7f6c795ff740 1 -- 172.21.15.164:0/849354043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 msgr2=0x558fc72db970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.609+0000 7f6c795ff740 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c005d00 tx=0x7f6c5c00bf90 comp rx=0 tx=0).stop 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c74a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 0x7f6c540a5bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6c68004af0 tx=0x7f6c68005d80 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 -- 172.21.15.164:0/849354043 shutdown_connections 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72db970 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72d8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 --2- 172.21.15.164:0/849354043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72d3da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 -- 172.21.15.164:0/849354043 >> 172.21.15.164:0/849354043 conn(0x558fc72ceef0 msgr2=0x558fc72cf2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 -- 172.21.15.164:0/849354043 shutdown_connections 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 -- 172.21.15.164:0/849354043 wait complete. 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.610+0000 7f6c795ff740 1 -- start start 2024-03-27T08:38:55.604 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 Processor -- start 2024-03-27T08:38:55.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72ddc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72de1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x558fc72dc490 con 0x558fc72d94e0 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558fc71f4630 con 0x558fc72d3980 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x558fc72dc610 con 0x558fc72d4370 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c795ff740 10 client.0 _ll_register_callbacks cb 0x558fc71f9c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c74a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c74a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43356/0 (socket says 172.21.15.164:43356) 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.611+0000 7f6c74a00640 1 -- 172.21.15.164:0/3212205873 learned_addr learned my addr 172.21.15.164:0/3212205873 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72ddc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c6f400640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72de1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 -- 172.21.15.164:0/3212205873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 msgr2=0x558fc72de1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72de1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 -- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 msgr2=0x558fc72ddc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72ddc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 -- 172.21.15.164:0/3212205873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc72005f0 con 0x558fc72d94e0 2024-03-27T08:38:55.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:38:55.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c74a00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6c68037040 tx=0x7f6c6802c0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9fc0515d9771a09 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.612+0000 7f6c59600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:55.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c68051020 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f6c68040660 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c5c011d70 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c68039040 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c795ff740 10 client.16239 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558fc6f4d210 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c5c011d70 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.613+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6c680349b0 con 0x558fc72d94e0 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 10 client.16239 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 10 client.16239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 20 client.16239 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc72e9c10 0x558fc72ec0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 4 client.16239 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:38:55.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558fc7246250 con 0x558fc72e9c10 2024-03-27T08:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.614+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc72e9c10 0x558fc72ec0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.615+0000 7f6c59600640 10 client.16239 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:55.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.615+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc72e9c10 0x558fc72ec0a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b00e961cdb0afd2a server_cookie=7e2174ab94618758 in_seq=0 out_seq=0 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c59600640 1 -- 172.21.15.164:0/3212205873 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x558fc7246250 con 0x558fc72e9c10 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c59600640 10 client.16239 handle_command_reply: tid=0 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 client.16239 shutdown 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 msgr2=0x558fc72e5200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6c68037040 tx=0x7f6c6802c0f0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 shutdown_connections 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc72e9c10 0x558fc72ec0a0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d94e0 0x558fc72e5200 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72de1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3212205873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d3980 0x558fc72ddc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c59600640 0 client.16239 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 >> 172.21.15.164:0/3212205873 conn(0x558fc72ceef0 msgr2=0x558fc72ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 shutdown_connections 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.616+0000 7f6c795ff740 1 -- 172.21.15.164:0/3212205873 wait complete. 2024-03-27T08:38:55.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.617+0000 7f6c795ff740 20 client.16239 trim_cache size 0 max 16384 2024-03-27T08:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 Processor -- start 2024-03-27T08:38:55.627 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 -- start start 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d4370 0x558fc72d5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d94e0 0x558fc72e51c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701adaf0 con 0x558fc72d3980 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701ab360 con 0x558fc72d4370 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.634+0000 7f6c795ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701a91b0 con 0x558fc72d94e0 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43370/0 (socket says 172.21.15.164:43370) 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 -- 172.21.15.164:0/672773217 learned_addr learned my addr 172.21.15.164:0/672773217 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6f400640 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d4370 0x558fc72d5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.628 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c74a00640 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d94e0 0x558fc72e51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 -- 172.21.15.164:0/672773217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d94e0 msgr2=0x558fc72e51c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d94e0 0x558fc72e51c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 -- 172.21.15.164:0/672773217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d4370 msgr2=0x558fc72d5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d4370 0x558fc72d5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.635+0000 7f6c6fe00640 1 -- 172.21.15.164:0/672773217 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558fc7019620 con 0x558fc72d3980 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.636+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000bfd0 tx=0x7f6c600cf9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe900232c6c492ff server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.636+0000 7f6c5be00640 1 -- 172.21.15.164:0/672773217 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60021040 con 0x558fc72d3980 2024-03-27T08:38:55.630 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.636+0000 7f6c5be00640 1 -- 172.21.15.164:0/672773217 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c6009c2d0 con 0x558fc72d3980 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.636+0000 7f6c5be00640 1 -- 172.21.15.164:0/672773217 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60099f60 con 0x558fc72d3980 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- 172.21.15.164:0/672773217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 msgr2=0x558fc72d5690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000bfd0 tx=0x7f6c600cf9f0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- 172.21.15.164:0/672773217 shutdown_connections 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d94e0 0x558fc72e51c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d4370 0x558fc72d5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 --2- 172.21.15.164:0/672773217 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72d5690 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- 172.21.15.164:0/672773217 >> 172.21.15.164:0/672773217 conn(0x558fc72ceef0 msgr2=0x558fc72cf2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- 172.21.15.164:0/672773217 shutdown_connections 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- 172.21.15.164:0/672773217 wait complete. 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.637+0000 7f6c795ff740 1 -- start start 2024-03-27T08:38:55.631 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 Processor -- start 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72e2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d94e0 0x558fc72e3c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701a9820 con 0x558fc72d3980 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701aac90 con 0x558fc72d94e0 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f6c701a9ef0 con 0x558fc72d4370 2024-03-27T08:38:55.634 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c795ff740 10 client.0 _ll_register_callbacks cb 0x7f6c68009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.638+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:43386/0 (socket says 172.21.15.164:43386) 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 -- 172.21.15.164:0/3244595459 learned_addr learned my addr 172.21.15.164:0/3244595459 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c74a00640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d94e0 0x558fc72e3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6f400640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72e2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 -- 172.21.15.164:0/3244595459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 msgr2=0x558fc72e2bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72e2bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 -- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d94e0 msgr2=0x558fc72e3c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d94e0 0x558fc72e3c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 -- 172.21.15.164:0/3244595459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558fc72e41f0 con 0x558fc72d3980 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c6fe00640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c600cd250 tx=0x7f6c60099d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f575fb7453cb1b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c59600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:38:55.635 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.639+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c60021070 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f6c60098240 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c6009c2d0 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6c6009ff80 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 10 client.16245 fetch_fsmap learned FSMap version 29 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x558fc72e5500 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c6009c2d0 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f6c600d2ce0 con 0x558fc72d3980 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 10 client.16245 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 20 client.16245 populate_metadata read hostname 'smithi164' 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc73507f0 0x558fc7352c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 4 client.16245 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.640+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558fc72405a0 con 0x558fc73507f0 2024-03-27T08:38:55.636 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.641+0000 7f6c6f400640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc73507f0 0x558fc7352c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:38:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.641+0000 7f6c6f400640 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc73507f0 0x558fc7352c10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=995486661337744e server_cookie=5cccbb92972bd748 in_seq=0 out_seq=0 2024-03-27T08:38:55.637 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.641+0000 7f6c59600640 10 client.16245 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.957+0000 7f6c59600640 1 -- 172.21.15.164:0/3244595459 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558fc72405a0 con 0x558fc73507f0 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.957+0000 7f6c59600640 10 client.16245 handle_command_reply: tid=0 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.957+0000 7f6c795ff740 1 client.16245 shutdown 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.957+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 msgr2=0x558fc72e26b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6c600cd250 tx=0x7f6c60099d00 comp rx=0 tx=0).stop 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 shutdown_connections 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x558fc73507f0 0x558fc7352c10 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558fc72d94e0 0x558fc72e3c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c59600640 0 client.16245 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x558fc72d4370 0x558fc72e2bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 --2- 172.21.15.164:0/3244595459 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x558fc72d3980 0x558fc72e26b0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.951 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 >> 172.21.15.164:0/3244595459 conn(0x558fc72ceef0 msgr2=0x558fc72ddbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 shutdown_connections 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 1 -- 172.21.15.164:0/3244595459 wait complete. 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.958+0000 7f6c795ff740 20 client.16245 trim_cache size 0 max 16384 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:38:55.952 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 msgr2=0x7f6c540a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 0x7f6c540a5bf0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6c68004af0 tx=0x7f6c68005d80 comp rx=0 tx=0).stop 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 msgr2=0x7f6c7019a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6c6000d950 tx=0x7f6c6000de10 comp rx=0 tx=0).stop 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 shutdown_connections 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f6c540a3730 0x7f6c540a5bf0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f6c70102620 0x7f6c701a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c70101c60 0x7f6c7019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.953 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 --2- 172.21.15.164:0/1400479755 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f6c70100a70 0x7f6c7019a000 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.959+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 >> 172.21.15.164:0/1400479755 conn(0x7f6c700fbfe0 msgr2=0x7f6c700fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.960+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 shutdown_connections 2024-03-27T08:38:55.954 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:38:55.960+0000 7f6c76a00640 1 -- 172.21.15.164:0/1400479755 wait complete. 2024-03-27T08:38:57.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:56 smithi164 ceph-mon[31788]: pgmap v549: 97 pgs: 97 active+clean; 146 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 459 KiB/s wr, 126 op/s 2024-03-27T08:38:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:56 smithi167 ceph-mon[34903]: pgmap v549: 97 pgs: 97 active+clean; 146 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 459 KiB/s wr, 126 op/s 2024-03-27T08:38:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:56 smithi173 ceph-mon[35397]: pgmap v549: 97 pgs: 97 active+clean; 146 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 331 KiB/s rd, 459 KiB/s wr, 126 op/s 2024-03-27T08:38:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:38:58 smithi164 ceph-mon[31788]: pgmap v550: 97 pgs: 97 active+clean; 146 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 452 KiB/s wr, 126 op/s 2024-03-27T08:38:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:38:58 smithi167 ceph-mon[34903]: pgmap v550: 97 pgs: 97 active+clean; 146 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 452 KiB/s wr, 126 op/s 2024-03-27T08:38:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:38:58 smithi173 ceph-mon[35397]: pgmap v550: 97 pgs: 97 active+clean; 146 MiB data, 884 MiB used, 1.0 TiB / 1.0 TiB avail; 301 KiB/s rd, 452 KiB/s wr, 126 op/s 2024-03-27T08:39:00.878 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:00 smithi173 ceph-mon[35397]: pgmap v551: 97 pgs: 97 active+clean; 144 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 593 KiB/s wr, 180 op/s 2024-03-27T08:39:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:00 smithi164 ceph-mon[31788]: pgmap v551: 97 pgs: 97 active+clean; 144 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 593 KiB/s wr, 180 op/s 2024-03-27T08:39:01.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:00 smithi167 ceph-mon[34903]: pgmap v551: 97 pgs: 97 active+clean; 144 MiB data, 863 MiB used, 1.0 TiB / 1.0 TiB avail; 394 KiB/s rd, 593 KiB/s wr, 180 op/s 2024-03-27T08:39:03.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:02 smithi164 ceph-mon[31788]: pgmap v552: 97 pgs: 97 active+clean; 144 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 553 KiB/s wr, 209 op/s 2024-03-27T08:39:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:02 smithi167 ceph-mon[34903]: pgmap v552: 97 pgs: 97 active+clean; 144 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 553 KiB/s wr, 209 op/s 2024-03-27T08:39:03.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:02 smithi173 ceph-mon[35397]: pgmap v552: 97 pgs: 97 active+clean; 144 MiB data, 860 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 553 KiB/s wr, 209 op/s 2024-03-27T08:39:05.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:04 smithi164 ceph-mon[31788]: pgmap v553: 97 pgs: 97 active+clean; 145 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 614 KiB/s wr, 214 op/s 2024-03-27T08:39:05.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:04 smithi167 ceph-mon[34903]: pgmap v553: 97 pgs: 97 active+clean; 145 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 614 KiB/s wr, 214 op/s 2024-03-27T08:39:05.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:04 smithi173 ceph-mon[35397]: pgmap v553: 97 pgs: 97 active+clean; 145 MiB data, 862 MiB used, 1.0 TiB / 1.0 TiB avail; 380 KiB/s rd, 614 KiB/s wr, 214 op/s 2024-03-27T08:39:07.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:06 smithi164 ceph-mon[31788]: pgmap v554: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 718 KiB/s wr, 225 op/s 2024-03-27T08:39:07.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:06 smithi167 ceph-mon[34903]: pgmap v554: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 718 KiB/s wr, 225 op/s 2024-03-27T08:39:07.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:06 smithi173 ceph-mon[35397]: pgmap v554: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 443 KiB/s rd, 718 KiB/s wr, 225 op/s 2024-03-27T08:39:08.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:07 smithi164 ceph-mon[31788]: pgmap v555: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 596 KiB/s wr, 213 op/s 2024-03-27T08:39:08.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:07 smithi167 ceph-mon[34903]: pgmap v555: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 596 KiB/s wr, 213 op/s 2024-03-27T08:39:08.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:07 smithi173 ceph-mon[35397]: pgmap v555: 97 pgs: 97 active+clean; 145 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 267 KiB/s rd, 596 KiB/s wr, 213 op/s 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.117+0000 7f2d3d200640 1 -- 172.21.15.164:0/1247381960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 msgr2=0x7f2d3810c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.117+0000 7f2d3d200640 1 --2- 172.21.15.164:0/1247381960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d3810c1f0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009be0 tx=0x7f2d3002bef0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 -- 172.21.15.164:0/1247381960 shutdown_connections 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 --2- 172.21.15.164:0/1247381960 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d3810c1f0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 --2- 172.21.15.164:0/1247381960 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 0x7f2d38105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 --2- 172.21.15.164:0/1247381960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d381041d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 -- 172.21.15.164:0/1247381960 >> 172.21.15.164:0/1247381960 conn(0x7f2d380ff340 msgr2=0x7f2d38101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.110 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 -- 172.21.15.164:0/1247381960 shutdown_connections 2024-03-27T08:39:09.111 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.118+0000 7f2d3d200640 1 -- 172.21.15.164:0/1247381960 wait complete. 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 Processor -- start 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 -- start start 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 0x7f2d3819a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d381a15d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3810fa70 con 0x7f2d38105960 2024-03-27T08:39:09.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3810f8f0 con 0x7f2d38103db0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d3d200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d3810fbf0 con 0x7f2d38104fa0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d35e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d35e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33410/0 (socket says 172.21.15.164:33410) 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d35e00640 1 -- 172.21.15.164:0/3118129547 learned_addr learned my addr 172.21.15.164:0/3118129547 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.119+0000 7f2d36800640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d381a15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35400640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 0x7f2d3819a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 -- 172.21.15.164:0/3118129547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 msgr2=0x7f2d3819a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 0x7f2d3819a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 -- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 msgr2=0x7f2d381a15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d381a15d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 -- 172.21.15.164:0/3118129547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d381a1c40 con 0x7f2d38103db0 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d36800640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d381a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:09.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.120+0000 7f2d35e00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e9f0 tx=0x7f2d2800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.121+0000 7f2d2ea00640 1 -- 172.21.15.164:0/3118129547 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800ccc0 con 0x7f2d38103db0 2024-03-27T08:39:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.121+0000 7f2d2ea00640 1 -- 172.21.15.164:0/3118129547 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d280035f0 con 0x7f2d38103db0 2024-03-27T08:39:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.121+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d381a1f30 con 0x7f2d38103db0 2024-03-27T08:39:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.121+0000 7f2d2ea00640 1 -- 172.21.15.164:0/3118129547 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2800ce60 con 0x7f2d38103db0 2024-03-27T08:39:09.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.121+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381a2390 con 0x7f2d38103db0 2024-03-27T08:39:09.116 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 Processor -- start 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d2ea00640 1 -- 172.21.15.164:0/3118129547 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f2d280037a0 con 0x7f2d38103db0 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 -- start start 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8664370 0x55f3b8668e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f3b85c8d10 con 0x55f3b8663980 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3b8571260 con 0x55f3b86694e0 2024-03-27T08:39:09.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.125+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3b85c4cc0 con 0x55f3b8664370 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33420/0 (socket says 172.21.15.164:33420) 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44636/0 (socket says 172.21.15.164:44636) 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d35400640 1 -- 172.21.15.164:0/1422495693 learned_addr learned my addr 172.21.15.164:0/1422495693 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d35e00640 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8664370 0x55f3b8668e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 -- 172.21.15.164:0/1422495693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8664370 msgr2=0x55f3b8668e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8664370 0x55f3b8668e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 -- 172.21.15.164:0/1422495693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 msgr2=0x55f3b866b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d36800640 1 -- 172.21.15.164:0/1422495693 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3b8568aa0 con 0x55f3b8663980 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.126+0000 7f2d35400640 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d2ea00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 0x7f2d1c0a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d36800640 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002c500 tx=0x7f2d30033f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2628e438f49bcdeb server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d2ea00640 1 -- 172.21.15.164:0/3118129547 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d280d0030 con 0x7f2d38103db0 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d35e00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 0x7f2d1c0a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d23400640 1 -- 172.21.15.164:0/1422495693 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30043030 con 0x55f3b8663980 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d23400640 1 -- 172.21.15.164:0/1422495693 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d30003970 con 0x55f3b8663980 2024-03-27T08:39:09.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.127+0000 7f2d23400640 1 -- 172.21.15.164:0/1422495693 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d3002cb10 con 0x55f3b8663980 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 -- 172.21.15.164:0/1422495693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 msgr2=0x55f3b8663da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d35e00640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 0x7f2d1c0a5b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55f3b8664770 tx=0x7f2d280d3b50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002c500 tx=0x7f2d30033f40 comp rx=0 tx=0).stop 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 -- 172.21.15.164:0/1422495693 shutdown_connections 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b866b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8664370 0x55f3b8668e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/1422495693 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8663980 0x55f3b8663da0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 -- 172.21.15.164:0/1422495693 >> 172.21.15.164:0/1422495693 conn(0x55f3b865eef0 msgr2=0x55f3b865f2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.123 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 -- 172.21.15.164:0/1422495693 shutdown_connections 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.128+0000 7f2d3fe11740 1 -- 172.21.15.164:0/1422495693 wait complete. 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 -- start start 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 Processor -- start 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b866dd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b866e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b8675220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f3b866c430 con 0x55f3b8664370 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3b8584630 con 0x55f3b86694e0 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.129+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f3b866c5b0 con 0x55f3b8663980 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d3fe11740 10 client.0 _ll_register_callbacks cb 0x55f3b8589c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b866e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d36800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b8675220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d36800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b8675220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33434/0 (socket says 172.21.15.164:33434) 2024-03-27T08:39:09.124 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d36800640 1 -- 172.21.15.164:0/2354140816 learned_addr learned my addr 172.21.15.164:0/2354140816 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d36800640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b866dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 -- 172.21.15.164:0/2354140816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 msgr2=0x55f3b866dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b866dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 -- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 msgr2=0x55f3b8675220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b8675220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.130+0000 7f2d35400640 1 -- 172.21.15.164:0/2354140816 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b85905f0 con 0x55f3b8664370 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d35400640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b866e250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d240058c0 tx=0x7f2d24012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92f7b8b33f59881 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d17e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24005220 con 0x55f3b8664370 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d30003970 con 0x55f3b8664370 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d240053c0 con 0x55f3b8664370 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d240055c0 con 0x55f3b8664370 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.131+0000 7f2d3fe11740 10 client.16257 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:09.125 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f3b82dd210 con 0x55f3b8664370 2024-03-27T08:39:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d30003970 con 0x55f3b8664370 2024-03-27T08:39:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2d24019070 con 0x55f3b8664370 2024-03-27T08:39:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 10 client.16257 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:09.127 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 10 client.16257 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 20 client.16257 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b8679c20 0x55f3b867c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 4 client.16257 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.132+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f3b85d6250 con 0x55f3b8679c20 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.133+0000 7f2d36800640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b8679c20 0x55f3b867c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.134+0000 7f2d36800640 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b8679c20 0x55f3b867c040 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37945a3bfb0f85a7 server_cookie=f534d3fa69c24391 in_seq=0 out_seq=0 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.134+0000 7f2d17e00640 10 client.16257 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d17e00640 1 -- 172.21.15.164:0/2354140816 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f3b85d6250 con 0x55f3b8679c20 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d17e00640 10 client.16257 handle_command_reply: tid=0 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 client.16257 shutdown 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 msgr2=0x55f3b866e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b866e250 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f2d240058c0 tx=0x7f2d24012820 comp rx=0 tx=0).stop 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 shutdown_connections 2024-03-27T08:39:09.128 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b8679c20 0x55f3b867c040 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b86694e0 0x55f3b8675220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b866e250 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2354140816 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b866dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d17e00640 0 client.16257 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 >> 172.21.15.164:0/2354140816 conn(0x55f3b865eef0 msgr2=0x55f3b865e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 shutdown_connections 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2354140816 wait complete. 2024-03-27T08:39:09.129 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.135+0000 7f2d3fe11740 20 client.16257 trim_cache size 0 max 16384 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 Processor -- start 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 -- start start 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b8662860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 0x55f3b86751e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ada90 con 0x55f3b86694e0 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381ab300 con 0x55f3b8664370 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.153+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381a9150 con 0x55f3b8663980 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 0x55f3b86751e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44654/0 (socket says 172.21.15.164:44654) 2024-03-27T08:39:09.148 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d35400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 0x55f3b86751e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:33436/0 (socket says 172.21.15.164:33436) 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 -- 172.21.15.164:0/2598681165 learned_addr learned my addr 172.21.15.164:0/2598681165 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b8662860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 -- 172.21.15.164:0/2598681165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 msgr2=0x55f3b8662860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b8662860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 -- 172.21.15.164:0/2598681165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 msgr2=0x55f3b86751e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 0x55f3b86751e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.154+0000 7f2d36800640 1 -- 172.21.15.164:0/2598681165 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3b83a9620 con 0x55f3b86694e0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.155+0000 7f2d36800640 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002c500 tx=0x7f2d30004a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8a9cde1c572f3f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.155+0000 7f2d22a00640 1 -- 172.21.15.164:0/2598681165 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30043070 con 0x55f3b86694e0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.155+0000 7f2d22a00640 1 -- 172.21.15.164:0/2598681165 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d30044040 con 0x55f3b86694e0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.155+0000 7f2d22a00640 1 -- 172.21.15.164:0/2598681165 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d30056c90 con 0x55f3b86694e0 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2598681165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 msgr2=0x55f3b8680920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f2d3002c500 tx=0x7f2d30004a80 comp rx=0 tx=0).stop 2024-03-27T08:39:09.149 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2598681165 shutdown_connections 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b86694e0 0x55f3b8680920 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8664370 0x55f3b86751e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2598681165 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b8663980 0x55f3b8662860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2598681165 >> 172.21.15.164:0/2598681165 conn(0x55f3b865eef0 msgr2=0x55f3b8662150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2598681165 shutdown_connections 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2598681165 wait complete. 2024-03-27T08:39:09.150 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.156+0000 7f2d3fe11740 1 -- start start 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 Processor -- start 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8663980 0x55f3b86728f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b86694e0 0x55f3b8673e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381a97c0 con 0x55f3b8664370 2024-03-27T08:39:09.153 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381aac30 con 0x55f3b8663980 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2d381a9e90 con 0x55f3b86694e0 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d3fe11740 10 client.0 _ll_register_callbacks cb 0x7f2d2400ba20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.157+0000 7f2d35400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44658/0 (socket says 172.21.15.164:44658) 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 -- 172.21.15.164:0/2971075397 learned_addr learned my addr 172.21.15.164:0/2971075397 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d36800640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8663980 0x55f3b86728f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 -- 172.21.15.164:0/2971075397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b86694e0 msgr2=0x55f3b8673e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d36800640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b86694e0 0x55f3b8673e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b86694e0 0x55f3b8673e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 -- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8663980 msgr2=0x55f3b86728f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8663980 0x55f3b86728f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 -- 172.21.15.164:0/2971075397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3b8674430 con 0x55f3b8664370 2024-03-27T08:39:09.154 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d35400640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55f3b866f180 tx=0x7f2d24010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45e7813e2c0f6439 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d17e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.158+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d24033060 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2d2402e650 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d30044040 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f2d2402a070 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 10 client.16263 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f3b86dffd0 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d30044040 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f2d24019070 con 0x55f3b8664370 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 10 client.16263 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 20 client.16263 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b86e0a30 0x55f3b86e2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 4 client.16263 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:39:09.155 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.159+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f3b866db00 con 0x55f3b86e0a30 2024-03-27T08:39:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.160+0000 7f2d36800640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b86e0a30 0x55f3b86e2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.160+0000 7f2d36800640 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b86e0a30 0x55f3b86e2e50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d938667e26c3cb5f server_cookie=dd7f2fa01c265996 in_seq=0 out_seq=0 2024-03-27T08:39:09.156 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.160+0000 7f2d17e00640 10 client.16263 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.425+0000 7f2d17e00640 1 -- 172.21.15.164:0/2971075397 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f3b866db00 con 0x55f3b86e0a30 2024-03-27T08:39:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.425+0000 7f2d17e00640 10 client.16263 handle_command_reply: tid=0 2024-03-27T08:39:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.425+0000 7f2d3fe11740 1 client.16263 shutdown 2024-03-27T08:39:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 msgr2=0x55f3b8672e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.417 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x55f3b866f180 tx=0x7f2d24010ee0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 shutdown_connections 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f3b86e0a30 0x55f3b86e2e50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f3b86694e0 0x55f3b8673e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f3b8664370 0x55f3b8672e30 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 --2- 172.21.15.164:0/2971075397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3b8663980 0x55f3b86728f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d17e00640 0 client.16263 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:09.418 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 >> 172.21.15.164:0/2971075397 conn(0x55f3b865eef0 msgr2=0x55f3b86629e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 shutdown_connections 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 1 -- 172.21.15.164:0/2971075397 wait complete. 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.426+0000 7f2d3fe11740 20 client.16263 trim_cache size 0 max 16384 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:39:09.419 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 msgr2=0x7f2d1c0a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 0x7f2d1c0a5b70 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x55f3b8664770 tx=0x7f2d280d3b50 comp rx=0 tx=0).stop 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 msgr2=0x7f2d3819a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2d2800e9f0 tx=0x7f2d2800eeb0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 shutdown_connections 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2d1c0a36b0 0x7f2d1c0a5b70 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.420 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2d38105960 0x7f2d381a15d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.427+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2d38104fa0 0x7f2d3819a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.428+0000 7f2d3d200640 1 --2- 172.21.15.164:0/3118129547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d38103db0 0x7f2d3819a020 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.428+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 >> 172.21.15.164:0/3118129547 conn(0x7f2d380ff340 msgr2=0x7f2d381081d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.428+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 shutdown_connections 2024-03-27T08:39:09.421 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:09.428+0000 7f2d3d200640 1 -- 172.21.15.164:0/3118129547 wait complete. 2024-03-27T08:39:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:10 smithi167 ceph-mon[34903]: pgmap v556: 97 pgs: 97 active+clean; 148 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 796 KiB/s wr, 202 op/s 2024-03-27T08:39:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:10 smithi173 ceph-mon[35397]: pgmap v556: 97 pgs: 97 active+clean; 148 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 796 KiB/s wr, 202 op/s 2024-03-27T08:39:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:10 smithi164 ceph-mon[31788]: pgmap v556: 97 pgs: 97 active+clean; 148 MiB data, 874 MiB used, 1.0 TiB / 1.0 TiB avail; 429 KiB/s rd, 796 KiB/s wr, 202 op/s 2024-03-27T08:39:12.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:12 smithi167 ceph-mon[34903]: pgmap v557: 97 pgs: 97 active+clean; 148 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 639 KiB/s wr, 174 op/s 2024-03-27T08:39:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:12 smithi173 ceph-mon[35397]: pgmap v557: 97 pgs: 97 active+clean; 148 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 639 KiB/s wr, 174 op/s 2024-03-27T08:39:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:12 smithi164 ceph-mon[31788]: pgmap v557: 97 pgs: 97 active+clean; 148 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 264 KiB/s rd, 639 KiB/s wr, 174 op/s 2024-03-27T08:39:14.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:14 smithi167 ceph-mon[34903]: pgmap v558: 97 pgs: 97 active+clean; 149 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 721 KiB/s wr, 188 op/s 2024-03-27T08:39:14.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:14 smithi173 ceph-mon[35397]: pgmap v558: 97 pgs: 97 active+clean; 149 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 721 KiB/s wr, 188 op/s 2024-03-27T08:39:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:14 smithi164 ceph-mon[31788]: pgmap v558: 97 pgs: 97 active+clean; 149 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 721 KiB/s wr, 188 op/s 2024-03-27T08:39:16.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:16 smithi167 ceph-mon[34903]: pgmap v559: 97 pgs: 97 active+clean; 145 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 825 KiB/s wr, 222 op/s 2024-03-27T08:39:16.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:16 smithi173 ceph-mon[35397]: pgmap v559: 97 pgs: 97 active+clean; 145 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 825 KiB/s wr, 222 op/s 2024-03-27T08:39:17.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:16 smithi164 ceph-mon[31788]: pgmap v559: 97 pgs: 97 active+clean; 145 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 385 KiB/s rd, 825 KiB/s wr, 222 op/s 2024-03-27T08:39:18.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:18 smithi167 ceph-mon[34903]: pgmap v560: 97 pgs: 97 active+clean; 147 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 830 KiB/s wr, 209 op/s 2024-03-27T08:39:18.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:18 smithi173 ceph-mon[35397]: pgmap v560: 97 pgs: 97 active+clean; 147 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 830 KiB/s wr, 209 op/s 2024-03-27T08:39:19.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:18 smithi164 ceph-mon[31788]: pgmap v560: 97 pgs: 97 active+clean; 147 MiB data, 890 MiB used, 1.0 TiB / 1.0 TiB avail; 399 KiB/s rd, 830 KiB/s wr, 209 op/s 2024-03-27T08:39:20.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:20 smithi167 ceph-mon[34903]: pgmap v561: 97 pgs: 97 active+clean; 147 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 939 KiB/s wr, 226 op/s 2024-03-27T08:39:20.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:20 smithi173 ceph-mon[35397]: pgmap v561: 97 pgs: 97 active+clean; 147 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 939 KiB/s wr, 226 op/s 2024-03-27T08:39:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:20 smithi164 ceph-mon[31788]: pgmap v561: 97 pgs: 97 active+clean; 147 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 475 KiB/s rd, 939 KiB/s wr, 226 op/s 2024-03-27T08:39:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 -- 172.21.15.164:0/2746172883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 msgr2=0x7fd8341041c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 --2- 172.21.15.164:0/2746172883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd8341041c0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fd82c009ca0 tx=0x7fd82c02c0f0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 -- 172.21.15.164:0/2746172883 shutdown_connections 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 --2- 172.21.15.164:0/2746172883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 0x7fd83410c1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 --2- 172.21.15.164:0/2746172883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 0x7fd834105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 --2- 172.21.15.164:0/2746172883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd8341041c0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 -- 172.21.15.164:0/2746172883 >> 172.21.15.164:0/2746172883 conn(0x7fd8340ff310 msgr2=0x7fd834101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 -- 172.21.15.164:0/2746172883 shutdown_connections 2024-03-27T08:39:22.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.581+0000 7fd83a000640 1 -- 172.21.15.164:0/2746172883 wait complete. 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.582+0000 7fd83a000640 1 Processor -- start 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.582+0000 7fd83a000640 1 -- start start 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 0x7fd83419a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 0x7fd8341a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410fa00 con 0x7fd834103da0 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410f880 con 0x7fd834105950 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd83a000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd83410fb80 con 0x7fd834104f90 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48920/0 (socket says 172.21.15.164:48920) 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 -- 172.21.15.164:0/1039390194 learned_addr learned my addr 172.21.15.164:0/1039390194 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833e00640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 0x7fd8341a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd832a00640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 0x7fd83419a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 -- 172.21.15.164:0/1039390194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 msgr2=0x7fd83419a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 0x7fd83419a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 -- 172.21.15.164:0/1039390194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 msgr2=0x7fd8341a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 0x7fd8341a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.583+0000 7fd833400640 1 -- 172.21.15.164:0/1039390194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8341a1c10 con 0x7fd834103da0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd833400640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000f80 tx=0x7fd82c032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd82be00640 1 -- 172.21.15.164:0/1039390194 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c039050 con 0x7fd834103da0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd82be00640 1 -- 172.21.15.164:0/1039390194 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82c03a040 con 0x7fd834103da0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8341a1ea0 con 0x7fd834103da0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd82be00640 1 -- 172.21.15.164:0/1039390194 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c040450 con 0x7fd834103da0 2024-03-27T08:39:22.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.584+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8341a2300 con 0x7fd834103da0 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.588+0000 7fd82be00640 1 -- 172.21.15.164:0/1039390194 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fd82c003b70 con 0x7fd834103da0 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.588+0000 7fd83cc11740 1 Processor -- start 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.588+0000 7fd83cc11740 1 -- start start 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x564897820da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x564897825e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897828970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564897785d10 con 0x564897821370 2024-03-27T08:39:22.582 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56489772e260 con 0x564897820980 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd83cc11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x564897781cc0 con 0x5648978264e0 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd833400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x564897825e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd833e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x564897820da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd833e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x564897820da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:60344/0 (socket says 172.21.15.164:60344) 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd833e00640 1 -- 172.21.15.164:0/3935347367 learned_addr learned my addr 172.21.15.164:0/3935347367 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd82be00640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 0x7fd8180a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.583 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.589+0000 7fd832a00640 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897828970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd82be00640 1 -- 172.21.15.164:0/1039390194 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd82c0f28a0 con 0x7fd834103da0 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 -- 172.21.15.164:0/3935347367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 msgr2=0x564897828970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897828970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 -- 172.21.15.164:0/3935347367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 msgr2=0x564897820da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x564897820da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 -- 172.21.15.164:0/3935347367 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564897725aa0 con 0x564897821370 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833e00640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 0x7fd8180a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd833400640 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x564897825e70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0f0320 tx=0x7fd82c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d9e6ec5827d7266 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd823e00640 1 -- 172.21.15.164:0/3935347367 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0beaf0 con 0x564897821370 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd823e00640 1 -- 172.21.15.164:0/3935347367 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82c0348f0 con 0x564897821370 2024-03-27T08:39:22.584 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.590+0000 7fd823e00640 1 -- 172.21.15.164:0/3935347367 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82c0be680 con 0x564897821370 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 -- 172.21.15.164:0/3935347367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 msgr2=0x564897825e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x564897825e70 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fd82c0f0320 tx=0x7fd82c0095c0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd833e00640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 0x7fd8180a5bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd824005fd0 tx=0x7fd8240046c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 -- 172.21.15.164:0/3935347367 shutdown_connections 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897828970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x564897825e70 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 --2- 172.21.15.164:0/3935347367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x564897820da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.591+0000 7fd83cc11740 1 -- 172.21.15.164:0/3935347367 >> 172.21.15.164:0/3935347367 conn(0x56489781bef0 msgr2=0x56489781c2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.592+0000 7fd83cc11740 1 -- 172.21.15.164:0/3935347367 shutdown_connections 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.592+0000 7fd83cc11740 1 -- 172.21.15.164:0/3935347367 wait complete. 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.592+0000 7fd83cc11740 1 -- start start 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.592+0000 7fd83cc11740 1 Processor -- start 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x56489782a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897831f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x564897829250 con 0x564897821370 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564897741630 con 0x564897820980 2024-03-27T08:39:22.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5648978293d0 con 0x5648978264e0 2024-03-27T08:39:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd83cc11740 10 client.0 _ll_register_callbacks cb 0x564897746c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd832a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd832a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48940/0 (socket says 172.21.15.164:48940) 2024-03-27T08:39:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.593+0000 7fd832a00640 1 -- 172.21.15.164:0/218453883 learned_addr learned my addr 172.21.15.164:0/218453883 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:22.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd833400640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x56489782a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd833e00640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897831f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 -- 172.21.15.164:0/218453883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 msgr2=0x564897831f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897831f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 -- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 msgr2=0x56489782a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x56489782a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 -- 172.21.15.164:0/218453883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56489774d5f0 con 0x564897821370 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd833400640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x56489782a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd832a00640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd81c010420 tx=0x7fd81c0108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c940203ffd30d4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.594+0000 7fd820c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c004220 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd81c0043c0 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82c0348f0 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd81c012720 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd83cc11740 10 client.16275 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56489749a210 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82c0348f0 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.595+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd81c00f040 con 0x564897821370 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 10 client.16275 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 10 client.16275 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:22.594 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 20 client.16275 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x564897836920 0x564897838d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 4 client.16275 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564897793250 con 0x564897836920 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.596+0000 7fd833400640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x564897836920 0x564897838d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.597+0000 7fd833400640 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x564897836920 0x564897838d70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1507d75d977970c0 server_cookie=bb7e4ff1d56ebf77 in_seq=0 out_seq=0 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.597+0000 7fd820c00640 10 client.16275 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd820c00640 1 -- 172.21.15.164:0/218453883 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x564897793250 con 0x564897836920 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd820c00640 10 client.16275 handle_command_reply: tid=0 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 client.16275 shutdown 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 msgr2=0x56489782aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fd81c010420 tx=0x7fd81c0108e0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 shutdown_connections 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x564897836920 0x564897838d70 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5648978264e0 0x564897831f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x564897821370 0x56489782aec0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 --2- 172.21.15.164:0/218453883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897820980 0x56489782a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd820c00640 0 client.16275 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 >> 172.21.15.164:0/218453883 conn(0x56489781bef0 msgr2=0x56489781b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 shutdown_connections 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 1 -- 172.21.15.164:0/218453883 wait complete. 2024-03-27T08:39:22.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.598+0000 7fd83cc11740 20 client.16275 trim_cache size 0 max 16384 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 Processor -- start 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 -- start start 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x564897825d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x564897831ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341adad0 con 0x5648978264e0 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341ab340 con 0x564897821370 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.617+0000 7fd83cc11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a9190 con 0x564897820980 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48944/0 (socket says 172.21.15.164:48944) 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 -- 172.21.15.164:0/1918488396 learned_addr learned my addr 172.21.15.164:0/1918488396 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd832a00640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x564897831ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833400640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x564897825d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 -- 172.21.15.164:0/1918488396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 msgr2=0x564897825d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x564897825d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 -- 172.21.15.164:0/1918488396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 msgr2=0x564897831ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x564897831ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd833e00640 1 -- 172.21.15.164:0/1918488396 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564897566620 con 0x5648978264e0 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.618+0000 7fd832a00640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x564897831ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.619+0000 7fd833e00640 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b850 tx=0x7fd824012f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b58aa6bf6d6af943 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.612 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.619+0000 7fd823400640 1 -- 172.21.15.164:0/1918488396 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82402c070 con 0x5648978264e0 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.619+0000 7fd823400640 1 -- 172.21.15.164:0/1918488396 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82401ca80 con 0x5648978264e0 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.619+0000 7fd823400640 1 -- 172.21.15.164:0/1918488396 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824027b80 con 0x5648978264e0 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 -- 172.21.15.164:0/1918488396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 msgr2=0x56489782a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fd82400b850 tx=0x7fd824012f90 comp rx=0 tx=0).stop 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 -- 172.21.15.164:0/1918488396 shutdown_connections 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x56489782a980 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x564897831ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 --2- 172.21.15.164:0/1918488396 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x564897825d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 -- 172.21.15.164:0/1918488396 >> 172.21.15.164:0/1918488396 conn(0x56489781bef0 msgr2=0x56489781c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 -- 172.21.15.164:0/1918488396 shutdown_connections 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.620+0000 7fd83cc11740 1 -- 172.21.15.164:0/1918488396 wait complete. 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 -- start start 2024-03-27T08:39:22.613 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 Processor -- start 2024-03-27T08:39:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x56489782f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x56489782f640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.616 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a9800 con 0x5648978264e0 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341aac70 con 0x564897821370 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8341a9ed0 con 0x564897820980 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.621+0000 7fd83cc11740 10 client.0 _ll_register_callbacks cb 0x7fd81c00e2f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48956/0 (socket says 172.21.15.164:48956) 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 -- 172.21.15.164:0/2690652406 learned_addr learned my addr 172.21.15.164:0/2690652406 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833400640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x56489782f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd832a00640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x56489782f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.617 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 -- 172.21.15.164:0/2690652406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 msgr2=0x56489782f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x56489782f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 -- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 msgr2=0x56489782f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x56489782f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 -- 172.21.15.164:0/2690652406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564897830c40 con 0x5648978264e0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833400640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x56489782f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd833e00640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd82400be10 tx=0x7fd824027640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18a9d102070acb87 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.622+0000 7fd820c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd824037060 con 0x5648978264e0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd824024040 con 0x5648978264e0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82401ca80 con 0x5648978264e0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd82402c030 con 0x5648978264e0 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 10 client.16281 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:22.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x564897831fc0 con 0x5648978264e0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82401ca80 con 0x5648978264e0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fd82403db20 con 0x5648978264e0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 10 client.16281 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 10 client.16281 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 20 client.16281 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.623+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56489789d2b0 0x56489789f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.624+0000 7fd83cc11740 4 client.16281 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.624+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56489778d5a0 con 0x56489789d2b0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.624+0000 7fd833400640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56489789d2b0 0x56489789f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.625+0000 7fd833400640 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56489789d2b0 0x56489789f6d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2db6e3a14d5a2360 server_cookie=c250d73f0986cd05 in_seq=0 out_seq=0 2024-03-27T08:39:22.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.625+0000 7fd820c00640 10 client.16281 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:22.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:22 smithi167 ceph-mon[34903]: pgmap v562: 97 pgs: 97 active+clean; 148 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 788 KiB/s wr, 212 op/s 2024-03-27T08:39:22.823 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:22 smithi173 ceph-mon[35397]: pgmap v562: 97 pgs: 97 active+clean; 148 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 788 KiB/s wr, 212 op/s 2024-03-27T08:39:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.920+0000 7fd820c00640 1 -- 172.21.15.164:0/2690652406 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56489778d5a0 con 0x56489789d2b0 2024-03-27T08:39:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.920+0000 7fd820c00640 10 client.16281 handle_command_reply: tid=0 2024-03-27T08:39:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.920+0000 7fd83cc11740 1 client.16281 shutdown 2024-03-27T08:39:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 msgr2=0x564897830650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.912 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fd82400be10 tx=0x7fd824027640 comp rx=0 tx=0).stop 2024-03-27T08:39:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 shutdown_connections 2024-03-27T08:39:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56489789d2b0 0x56489789f6d0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5648978264e0 0x564897830650 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.913 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564897821370 0x56489782f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 --2- 172.21.15.164:0/2690652406 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x564897820980 0x56489782f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 >> 172.21.15.164:0/2690652406 conn(0x56489781bef0 msgr2=0x56489781c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd820c00640 0 client.16281 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 shutdown_connections 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.921+0000 7fd83cc11740 1 -- 172.21.15.164:0/2690652406 wait complete. 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.922+0000 7fd83cc11740 20 client.16281 trim_cache size 0 max 16384 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:39:22.914 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 msgr2=0x7fd8180a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 0x7fd8180a5bf0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fd824005fd0 tx=0x7fd8240046c0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 msgr2=0x7fd834199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fd82c000f80 tx=0x7fd82c032900 comp rx=0 tx=0).stop 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 shutdown_connections 2024-03-27T08:39:22.915 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd8180a3730 0x7fd8180a5bf0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd834105950 0x7fd8341a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd834104f90 0x7fd83419a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 --2- 172.21.15.164:0/1039390194 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd834103da0 0x7fd834199ff0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:22.916 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.923+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 >> 172.21.15.164:0/1039390194 conn(0x7fd8340ff310 msgr2=0x7fd834108230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.924+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 shutdown_connections 2024-03-27T08:39:22.917 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:22.924+0000 7fd83a000640 1 -- 172.21.15.164:0/1039390194 wait complete. 2024-03-27T08:39:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:22 smithi164 ceph-mon[31788]: pgmap v562: 97 pgs: 97 active+clean; 148 MiB data, 904 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 788 KiB/s wr, 212 op/s 2024-03-27T08:39:24.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:24 smithi167 ceph-mon[34903]: pgmap v563: 97 pgs: 97 active+clean; 149 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 867 KiB/s wr, 185 op/s 2024-03-27T08:39:24.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:24 smithi173 ceph-mon[35397]: pgmap v563: 97 pgs: 97 active+clean; 149 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 867 KiB/s wr, 185 op/s 2024-03-27T08:39:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:24 smithi164 ceph-mon[31788]: pgmap v563: 97 pgs: 97 active+clean; 149 MiB data, 912 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 867 KiB/s wr, 185 op/s 2024-03-27T08:39:26.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:26 smithi173 ceph-mon[35397]: pgmap v564: 97 pgs: 97 active+clean; 150 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 946 KiB/s wr, 168 op/s 2024-03-27T08:39:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:26 smithi164 ceph-mon[31788]: pgmap v564: 97 pgs: 97 active+clean; 150 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 946 KiB/s wr, 168 op/s 2024-03-27T08:39:27.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:26 smithi167 ceph-mon[34903]: pgmap v564: 97 pgs: 97 active+clean; 150 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 423 KiB/s rd, 946 KiB/s wr, 168 op/s 2024-03-27T08:39:28.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:27 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:39:28.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:27 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:39:28.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:27 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:39:28.905 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:28 smithi164 ceph-mon[31788]: pgmap v565: 97 pgs: 97 active+clean; 150 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 811 KiB/s wr, 140 op/s 2024-03-27T08:39:29.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:28 smithi167 ceph-mon[34903]: pgmap v565: 97 pgs: 97 active+clean; 150 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 811 KiB/s wr, 140 op/s 2024-03-27T08:39:29.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:28 smithi173 ceph-mon[35397]: pgmap v565: 97 pgs: 97 active+clean; 150 MiB data, 919 MiB used, 1.0 TiB / 1.0 TiB avail; 372 KiB/s rd, 811 KiB/s wr, 140 op/s 2024-03-27T08:39:30.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:39:30.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:39:30.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:39:30.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:39:30.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:39:30.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:39:30.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:39:30.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:39:30.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:39:30.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:30 smithi173 ceph-mon[35397]: pgmap v566: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 907 KiB/s wr, 153 op/s 2024-03-27T08:39:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:30 smithi164 ceph-mon[31788]: pgmap v566: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 907 KiB/s wr, 153 op/s 2024-03-27T08:39:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:30 smithi167 ceph-mon[34903]: pgmap v566: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 409 KiB/s rd, 907 KiB/s wr, 153 op/s 2024-03-27T08:39:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:32 smithi164 ceph-mon[31788]: pgmap v567: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 805 KiB/s wr, 142 op/s 2024-03-27T08:39:33.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:32 smithi167 ceph-mon[34903]: pgmap v567: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 805 KiB/s wr, 142 op/s 2024-03-27T08:39:33.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:32 smithi173 ceph-mon[35397]: pgmap v567: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 336 KiB/s rd, 805 KiB/s wr, 142 op/s 2024-03-27T08:39:34.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:33 smithi164 ceph-mon[31788]: pgmap v568: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 763 KiB/s wr, 151 op/s 2024-03-27T08:39:34.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:33 smithi167 ceph-mon[34903]: pgmap v568: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 763 KiB/s wr, 151 op/s 2024-03-27T08:39:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:33 smithi173 ceph-mon[35397]: pgmap v568: 97 pgs: 97 active+clean; 151 MiB data, 910 MiB used, 1.0 TiB / 1.0 TiB avail; 345 KiB/s rd, 763 KiB/s wr, 151 op/s 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.068+0000 7fa772400640 1 -- 172.21.15.164:0/710834587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c102650 msgr2=0x7fa76c104a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.068+0000 7fa772400640 1 --2- 172.21.15.164:0/710834587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c102650 0x7fa76c104a40 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fa75c009900 tx=0x7fa75c02bc40 comp rx=0 tx=0).stop 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 -- 172.21.15.164:0/710834587 shutdown_connections 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 --2- 172.21.15.164:0/710834587 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c1078b0 0x7fa76c109ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 --2- 172.21.15.164:0/710834587 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 0x7fa76c107370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 --2- 172.21.15.164:0/710834587 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c102650 0x7fa76c104a40 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 -- 172.21.15.164:0/710834587 >> 172.21.15.164:0/710834587 conn(0x7fa76c0fbfe0 msgr2=0x7fa76c0fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 -- 172.21.15.164:0/710834587 shutdown_connections 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.069+0000 7fa772400640 1 -- 172.21.15.164:0/710834587 wait complete. 2024-03-27T08:39:36.062 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 Processor -- start 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 -- start start 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c102650 0x7fa76c19a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 0x7fa76c19a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c10d8a0 con 0x7fa76c1078b0 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c10d720 con 0x7fa76c102650 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa772400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c10da20 con 0x7fa76c104f80 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa76be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa76b400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c102650 0x7fa76c19a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa76be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60482/0 (socket says 172.21.15.164:60482) 2024-03-27T08:39:36.063 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.070+0000 7fa76be00640 1 -- 172.21.15.164:0/3347999738 learned_addr learned my addr 172.21.15.164:0/3347999738 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:36.064 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76aa00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 0x7fa76c19a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 -- 172.21.15.164:0/3347999738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 msgr2=0x7fa76c19a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 0x7fa76c19a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 -- 172.21.15.164:0/3347999738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c102650 msgr2=0x7fa76c19a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c102650 0x7fa76c19a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 -- 172.21.15.164:0/3347999738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa76c1a1cb0 con 0x7fa76c1078b0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa76be00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa76400eaa0 tx=0x7fa76400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.071+0000 7fa763e00640 1 -- 172.21.15.164:0/3347999738 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76400cdb0 con 0x7fa76c1078b0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.072+0000 7fa763e00640 1 -- 172.21.15.164:0/3347999738 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa764005020 con 0x7fa76c1078b0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.072+0000 7fa763e00640 1 -- 172.21.15.164:0/3347999738 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7640116b0 con 0x7fa76c1078b0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.072+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa76c1a1fa0 con 0x7fa76c1078b0 2024-03-27T08:39:36.065 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.072+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa76c1a24e0 con 0x7fa76c1078b0 2024-03-27T08:39:36.066 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.075+0000 7fa763e00640 1 -- 172.21.15.164:0/3347999738 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fa7640051d0 con 0x7fa76c1078b0 2024-03-27T08:39:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.075+0000 7fa7751f6740 1 Processor -- start 2024-03-27T08:39:36.067 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 -- start start 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a9759980 0x55f8a9759da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 0x55f8a975ee70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f8a96bed10 con 0x55f8a975f4e0 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f8a9667260 con 0x55f8a975a370 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa7751f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f8a96bacc0 con 0x55f8a9759980 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60488/0 (socket says 172.21.15.164:60488) 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.076+0000 7fa76aa00640 1 -- 172.21.15.164:0/273591632 learned_addr learned my addr 172.21.15.164:0/273591632 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a9759980 0x55f8a9759da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.068 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76b400640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 0x55f8a975ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.069 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa763e00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 0x7fa7500a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 -- 172.21.15.164:0/273591632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a9759980 msgr2=0x55f8a9759da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a9759980 0x55f8a9759da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa763e00640 1 -- 172.21.15.164:0/3347999738 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa7640cff50 con 0x7fa76c1078b0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 -- 172.21.15.164:0/273591632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 msgr2=0x55f8a975ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 0x55f8a975ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 -- 172.21.15.164:0/273591632 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a965eaa0 con 0x55f8a975f4e0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76b400640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 0x55f8a975ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76be00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 0x7fa7500a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.077+0000 7fa76aa00640 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa758006fd0 tx=0x7fa75800c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4eebb708eecddb27 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.078+0000 7fa760c00640 1 -- 172.21.15.164:0/273591632 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75801d070 con 0x55f8a975f4e0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.078+0000 7fa760c00640 1 -- 172.21.15.164:0/273591632 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa758018b40 con 0x55f8a975f4e0 2024-03-27T08:39:36.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.078+0000 7fa760c00640 1 -- 172.21.15.164:0/273591632 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75800f040 con 0x55f8a975f4e0 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 -- 172.21.15.164:0/273591632 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 msgr2=0x55f8a9761970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7fa758006fd0 tx=0x7fa75800c170 comp rx=0 tx=0).stop 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa76be00640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 0x7fa7500a5bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7640a4b10 tx=0x7fa764098040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 -- 172.21.15.164:0/273591632 shutdown_connections 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975f4e0 0x55f8a9761970 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975a370 0x55f8a975ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 --2- 172.21.15.164:0/273591632 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a9759980 0x55f8a9759da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.079+0000 7fa7751f6740 1 -- 172.21.15.164:0/273591632 >> 172.21.15.164:0/273591632 conn(0x55f8a9754ef0 msgr2=0x55f8a97552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.080+0000 7fa7751f6740 1 -- 172.21.15.164:0/273591632 shutdown_connections 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.080+0000 7fa7751f6740 1 -- 172.21.15.164:0/273591632 wait complete. 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.080+0000 7fa7751f6740 1 -- start start 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 Processor -- start 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a976ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9773a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f8a9762490 con 0x55f8a9759980 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f8a967a630 con 0x55f8a975f4e0 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f8a9762610 con 0x55f8a975a370 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.081+0000 7fa7751f6740 10 client.0 _ll_register_callbacks cb 0x55f8a967fc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60502/0 (socket says 172.21.15.164:60502) 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 -- 172.21.15.164:0/3728062375 learned_addr learned my addr 172.21.15.164:0/3728062375 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76b400640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a976ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 -- 172.21.15.164:0/3728062375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 msgr2=0x55f8a976ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a976ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 -- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 msgr2=0x55f8a9773a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9773a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 -- 172.21.15.164:0/3728062375 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a96865f0 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa76aa00640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa75800cf00 tx=0x7fa75800cad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f190288c986f6808 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa755600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.082+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75801d070 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa7580165b0 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa758018b40 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa7580167b0 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 10 client.16293 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f8a93d3210 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa758018b40 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa758021070 con 0x55f8a9759980 2024-03-27T08:39:36.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 10 client.16293 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 10 client.16293 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 20 client.16293 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.083+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a9777f90 0x55f8a977a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.084+0000 7fa7751f6740 4 client.16293 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:39:36.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.084+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f8a96cc250 con 0x55f8a9777f90 2024-03-27T08:39:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.084+0000 7fa76b400640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a9777f90 0x55f8a977a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.084+0000 7fa76b400640 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a9777f90 0x55f8a977a380 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da92b642c1b0690f server_cookie=3b97a01050bd76b2 in_seq=0 out_seq=0 2024-03-27T08:39:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.084+0000 7fa755600640 10 client.16293 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.085+0000 7fa755600640 1 -- 172.21.15.164:0/3728062375 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f8a96cc250 con 0x55f8a9777f90 2024-03-27T08:39:36.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.085+0000 7fa755600640 10 client.16293 handle_command_reply: tid=0 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.085+0000 7fa7751f6740 1 client.16293 shutdown 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 msgr2=0x55f8a976c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7fa75800cf00 tx=0x7fa75800cad0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 shutdown_connections 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a9777f90 0x55f8a977a380 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9773a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a976ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 --2- 172.21.15.164:0/3728062375 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a976c4c0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa755600640 0 client.16293 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 >> 172.21.15.164:0/3728062375 conn(0x55f8a9754ef0 msgr2=0x55f8a97540f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 shutdown_connections 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 1 -- 172.21.15.164:0/3728062375 wait complete. 2024-03-27T08:39:36.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.086+0000 7fa7751f6740 20 client.16293 trim_cache size 0 max 16384 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 Processor -- start 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 -- start start 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a9773a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9758690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a9760 con 0x55f8a9759980 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a6fd0 con 0x55f8a975f4e0 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.104+0000 7fa7751f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a4e20 con 0x55f8a975a370 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.096 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60506/0 (socket says 172.21.15.164:60506) 2024-03-27T08:39:36.097 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 -- 172.21.15.164:0/1483859574 learned_addr learned my addr 172.21.15.164:0/1483859574 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76b400640 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a9773a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9758690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 -- 172.21.15.164:0/1483859574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 msgr2=0x55f8a9773a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a9773a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 -- 172.21.15.164:0/1483859574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 msgr2=0x55f8a9758690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9758690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.098 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 -- 172.21.15.164:0/1483859574 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f8a949f620 con 0x55f8a9759980 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.105+0000 7fa76aa00640 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa75800ca40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390c7ce1e1847d25 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.106+0000 7fa757e00640 1 -- 172.21.15.164:0/1483859574 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75801d070 con 0x55f8a9759980 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.106+0000 7fa757e00640 1 -- 172.21.15.164:0/1483859574 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa75800a030 con 0x55f8a9759980 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.106+0000 7fa757e00640 1 -- 172.21.15.164:0/1483859574 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa758016c40 con 0x55f8a9759980 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.106+0000 7fa7751f6740 1 -- 172.21.15.164:0/1483859574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 msgr2=0x55f8a9758150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.106+0000 7fa7751f6740 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7fa758000c00 tx=0x7fa75800ca40 comp rx=0 tx=0).stop 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 -- 172.21.15.164:0/1483859574 shutdown_connections 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a975f4e0 0x55f8a9758690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975a370 0x55f8a9773a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 --2- 172.21.15.164:0/1483859574 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a9759980 0x55f8a9758150 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 -- 172.21.15.164:0/1483859574 >> 172.21.15.164:0/1483859574 conn(0x55f8a9754ef0 msgr2=0x55f8a97552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 -- 172.21.15.164:0/1483859574 shutdown_connections 2024-03-27T08:39:36.099 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 -- 172.21.15.164:0/1483859574 wait complete. 2024-03-27T08:39:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 -- start start 2024-03-27T08:39:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.107+0000 7fa7751f6740 1 Processor -- start 2024-03-27T08:39:36.102 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975f4e0 0x55f8a9772030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a5490 con 0x55f8a975a370 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a6900 con 0x55f8a9759980 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fa76c1a5b60 con 0x55f8a975f4e0 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa7751f6740 10 client.0 _ll_register_callbacks cb 0x7fa75801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa76b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa76aa00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:59716/0 (socket says 172.21.15.164:59716) 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa76b400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60516/0 (socket says 172.21.15.164:60516) 2024-03-27T08:39:36.103 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.108+0000 7fa76aa00640 1 -- 172.21.15.164:0/4136011078 learned_addr learned my addr 172.21.15.164:0/4136011078 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76aa00640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975f4e0 0x55f8a9772030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 -- 172.21.15.164:0/4136011078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975f4e0 msgr2=0x55f8a9772030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975f4e0 0x55f8a9772030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 -- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 msgr2=0x55f8a9770ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 -- 172.21.15.164:0/4136011078 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f8a9772620 con 0x55f8a975a370 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76aa00640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa76b400640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa75c036040 tx=0x7fa75c02cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c31170fa513f4f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.109+0000 7fa755600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa75c0042d0 con 0x55f8a975a370 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fa75c03a040 con 0x55f8a975a370 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa75800a030 con 0x55f8a975a370 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa75c004470 con 0x55f8a975a370 2024-03-27T08:39:36.104 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa7751f6740 10 client.16299 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f8a97739a0 con 0x55f8a975a370 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa75800a030 con 0x55f8a975a370 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7fa75c0035f0 con 0x55f8a975a370 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa7751f6740 10 client.16299 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.110+0000 7fa7751f6740 10 client.16299 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa7751f6740 20 client.16299 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a97de6c0 0x55f8a97e0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa7751f6740 4 client.16299 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f8a96c65a0 con 0x55f8a97de6c0 2024-03-27T08:39:36.105 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa76aa00640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a97de6c0 0x55f8a97e0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa76aa00640 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a97de6c0 0x55f8a97e0ae0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a915ceb3092d27c server_cookie=8c9c2c1e0fba7672 in_seq=0 out_seq=0 2024-03-27T08:39:36.106 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.111+0000 7fa755600640 10 client.16299 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa755600640 1 -- 172.21.15.164:0/4136011078 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f8a96c65a0 con 0x55f8a97de6c0 2024-03-27T08:39:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa755600640 10 client.16299 handle_command_reply: tid=0 2024-03-27T08:39:36.135 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 client.16299 shutdown 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 msgr2=0x55f8a9771020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fa75c036040 tx=0x7fa75c02cda0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 shutdown_connections 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f8a97de6c0 0x55f8a97e0ae0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f8a975f4e0 0x55f8a9772030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa755600640 0 client.16299 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:36.136 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f8a975a370 0x55f8a9771020 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 --2- 172.21.15.164:0/4136011078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f8a9759980 0x55f8a9770ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 >> 172.21.15.164:0/4136011078 conn(0x55f8a9754ef0 msgr2=0x55f8a9758150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 shutdown_connections 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.142+0000 7fa7751f6740 1 -- 172.21.15.164:0/4136011078 wait complete. 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.143+0000 7fa7751f6740 20 client.16299 trim_cache size 0 max 16384 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:39:36.137 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.143+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 msgr2=0x7fa7500a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.143+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 0x7fa7500a5bf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fa7640a4b10 tx=0x7fa764098040 comp rx=0 tx=0).stop 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.143+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 msgr2=0x7fa76c1a1640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.143+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7fa76400eaa0 tx=0x7fa76400ef60 comp rx=0 tx=0).stop 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 shutdown_connections 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fa7500a3730 0x7fa7500a5bf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.138 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fa76c1078b0 0x7fa76c1a1640 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fa76c104f80 0x7fa76c19a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 --2- 172.21.15.164:0/3347999738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa76c102650 0x7fa76c19a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 >> 172.21.15.164:0/3347999738 conn(0x7fa76c0fbfe0 msgr2=0x7fa76c101d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 shutdown_connections 2024-03-27T08:39:36.139 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:36.144+0000 7fa772400640 1 -- 172.21.15.164:0/3347999738 wait complete. 2024-03-27T08:39:36.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:36 smithi167 ceph-mon[34903]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 789 KiB/s wr, 153 op/s 2024-03-27T08:39:36.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:36 smithi173 ceph-mon[35397]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 789 KiB/s wr, 153 op/s 2024-03-27T08:39:37.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:36 smithi164 ceph-mon[31788]: pgmap v569: 97 pgs: 97 active+clean; 153 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 387 KiB/s rd, 789 KiB/s wr, 153 op/s 2024-03-27T08:39:38.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:38 smithi167 ceph-mon[34903]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 612 KiB/s wr, 120 op/s 2024-03-27T08:39:38.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:38 smithi173 ceph-mon[35397]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 612 KiB/s wr, 120 op/s 2024-03-27T08:39:39.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:38 smithi164 ceph-mon[31788]: pgmap v570: 97 pgs: 97 active+clean; 153 MiB data, 898 MiB used, 1.0 TiB / 1.0 TiB avail; 273 KiB/s rd, 612 KiB/s wr, 120 op/s 2024-03-27T08:39:40.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:40 smithi167 ceph-mon[34903]: pgmap v571: 97 pgs: 97 active+clean; 155 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 791 KiB/s wr, 124 op/s 2024-03-27T08:39:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:40 smithi173 ceph-mon[35397]: pgmap v571: 97 pgs: 97 active+clean; 155 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 791 KiB/s wr, 124 op/s 2024-03-27T08:39:41.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:40 smithi164 ceph-mon[31788]: pgmap v571: 97 pgs: 97 active+clean; 155 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 479 KiB/s rd, 791 KiB/s wr, 124 op/s 2024-03-27T08:39:41.193 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-03-27T08:39:41.461 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar c linux-4.0.5 2024-03-27T08:39:42.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:42 smithi167 ceph-mon[34903]: pgmap v572: 97 pgs: 97 active+clean; 155 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 604 KiB/s wr, 111 op/s 2024-03-27T08:39:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:42 smithi173 ceph-mon[35397]: pgmap v572: 97 pgs: 97 active+clean; 155 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 604 KiB/s wr, 111 op/s 2024-03-27T08:39:43.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:42 smithi164 ceph-mon[31788]: pgmap v572: 97 pgs: 97 active+clean; 155 MiB data, 909 MiB used, 1.0 TiB / 1.0 TiB avail; 339 KiB/s rd, 604 KiB/s wr, 111 op/s 2024-03-27T08:39:44.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:44 smithi167 ceph-mon[34903]: pgmap v573: 97 pgs: 97 active+clean; 155 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 626 KiB/s wr, 117 op/s 2024-03-27T08:39:44.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:44 smithi173 ceph-mon[35397]: pgmap v573: 97 pgs: 97 active+clean; 155 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 626 KiB/s wr, 117 op/s 2024-03-27T08:39:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:44 smithi164 ceph-mon[31788]: pgmap v573: 97 pgs: 97 active+clean; 155 MiB data, 908 MiB used, 1.0 TiB / 1.0 TiB avail; 344 KiB/s rd, 626 KiB/s wr, 117 op/s 2024-03-27T08:39:46.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:46 smithi167 ceph-mon[34903]: pgmap v574: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 670 KiB/s wr, 114 op/s 2024-03-27T08:39:46.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:46 smithi173 ceph-mon[35397]: pgmap v574: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 670 KiB/s wr, 114 op/s 2024-03-27T08:39:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:46 smithi164 ceph-mon[31788]: pgmap v574: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 670 KiB/s wr, 114 op/s 2024-03-27T08:39:48.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:48 smithi173 ceph-mon[35397]: pgmap v575: 97 pgs: 97 active+clean; 155 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 492 KiB/s wr, 96 op/s 2024-03-27T08:39:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:48 smithi164 ceph-mon[31788]: pgmap v575: 97 pgs: 97 active+clean; 155 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 492 KiB/s wr, 96 op/s 2024-03-27T08:39:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:48 smithi167 ceph-mon[34903]: pgmap v575: 97 pgs: 97 active+clean; 155 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 319 KiB/s rd, 492 KiB/s wr, 96 op/s 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 -- 172.21.15.164:0/3760262594 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 msgr2=0x7f96bc10c1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 --2- 172.21.15.164:0/3760262594 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc10c1e0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f96b4009ca0 tx=0x7f96b402c100 comp rx=0 tx=0).stop 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 -- 172.21.15.164:0/3760262594 shutdown_connections 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 --2- 172.21.15.164:0/3760262594 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc10c1e0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 --2- 172.21.15.164:0/3760262594 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc104f90 0x7f96bc105410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 --2- 172.21.15.164:0/3760262594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc103da0 0x7f96bc1041c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.288 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 -- 172.21.15.164:0/3760262594 >> 172.21.15.164:0/3760262594 conn(0x7f96bc0ff310 msgr2=0x7f96bc101750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 -- 172.21.15.164:0/3760262594 shutdown_connections 2024-03-27T08:39:49.289 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.291+0000 7f96c2e00640 1 -- 172.21.15.164:0/3760262594 wait complete. 2024-03-27T08:39:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.292+0000 7f96c2e00640 1 Processor -- start 2024-03-27T08:39:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 -- start start 2024-03-27T08:39:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc103da0 0x7f96bc199f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 0x7f96bc19a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.290 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc10f9f0 con 0x7f96bc105950 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc10f870 con 0x7f96bc104f90 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c2e00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc10fb70 con 0x7f96bc103da0 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c0e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96bb400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 0x7f96bc19a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c0e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39608/0 (socket says 172.21.15.164:39608) 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96c0e00640 1 -- 172.21.15.164:0/1906019267 learned_addr learned my addr 172.21.15.164:0/1906019267 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.293+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc103da0 0x7f96bc199f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 -- 172.21.15.164:0/1906019267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc103da0 msgr2=0x7f96bc199f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc103da0 0x7f96bc199f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.291 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 -- 172.21.15.164:0/1906019267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 msgr2=0x7f96bc19a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.292 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 0x7f96bc19a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.294 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 -- 172.21.15.164:0/1906019267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96bc1a1b90 con 0x7f96bc105950 2024-03-27T08:39:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96bb400640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 0x7f96bc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.294+0000 7f96c0e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f96b4037040 tx=0x7f96b4034d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.295+0000 7f96b8c00640 1 -- 172.21.15.164:0/1906019267 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4045070 con 0x7f96bc105950 2024-03-27T08:39:49.295 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.295+0000 7f96b8c00640 1 -- 172.21.15.164:0/1906019267 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96b403a040 con 0x7f96bc105950 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.295+0000 7f96b8c00640 1 -- 172.21.15.164:0/1906019267 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96b4039050 con 0x7f96bc105950 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.295+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96bc1a1e20 con 0x7f96bc105950 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.295+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96bc1a2230 con 0x7f96bc105950 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.298+0000 7f96b8c00640 1 -- 172.21.15.164:0/1906019267 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f96b4048070 con 0x7f96bc105950 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.298+0000 7f96c5bc7740 1 Processor -- start 2024-03-27T08:39:49.296 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 -- start start 2024-03-27T08:39:49.331 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce26da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce2be70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.332 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56405cd8bd10 con 0x56405ce2c4e0 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56405cd34260 con 0x56405ce26980 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56405cd87cc0 con 0x56405ce27370 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96bb400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce26da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.299+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.333 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39612/0 (socket says 172.21.15.164:39612) 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 -- 172.21.15.164:0/833027195 learned_addr learned my addr 172.21.15.164:0/833027195 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bbe00640 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce2be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 -- 172.21.15.164:0/833027195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 msgr2=0x56405ce2be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce2be70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 -- 172.21.15.164:0/833027195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 msgr2=0x56405ce26da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.334 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce26da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 -- 172.21.15.164:0/833027195 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405cd2baa0 con 0x56405ce2c4e0 2024-03-27T08:39:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96b8c00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 0x7f96a00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96bb400640 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f96a8012b30 tx=0x7f96a800b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2a8b2c53863bf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.300+0000 7f96b8c00640 1 -- 172.21.15.164:0/1906019267 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96b40f1ae0 con 0x7f96bc105950 2024-03-27T08:39:49.335 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.301+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 0x7f96a00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.301+0000 7f96b1600640 1 -- 172.21.15.164:0/833027195 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8004020 con 0x56405ce2c4e0 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.301+0000 7f96b1600640 1 -- 172.21.15.164:0/833027195 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a800fdb0 con 0x56405ce2c4e0 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.301+0000 7f96b1600640 1 -- 172.21.15.164:0/833027195 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a8005450 con 0x56405ce2c4e0 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- 172.21.15.164:0/833027195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 msgr2=0x56405ce2e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 0x7f96a00a5bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x56405ce27770 tx=0x7f96ac005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f96a8012b30 tx=0x7f96a800b390 comp rx=0 tx=0).stop 2024-03-27T08:39:49.336 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- 172.21.15.164:0/833027195 shutdown_connections 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce2c4e0 0x56405ce2e970 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce2be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/833027195 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce26da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- 172.21.15.164:0/833027195 >> 172.21.15.164:0/833027195 conn(0x56405ce21ef0 msgr2=0x56405ce222f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- 172.21.15.164:0/833027195 shutdown_connections 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- 172.21.15.164:0/833027195 wait complete. 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.302+0000 7f96c5bc7740 1 -- start start 2024-03-27T08:39:49.337 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 Processor -- start 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce311d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 0x56405ce38210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56405ce2f490 con 0x56405ce26980 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56405cd47630 con 0x56405ce2c4e0 2024-03-27T08:39:49.338 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56405ce2f610 con 0x56405ce27370 2024-03-27T08:39:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c5bc7740 10 client.0 _ll_register_callbacks cb 0x56405cd4cc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96bbe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39624/0 (socket says 172.21.15.164:39624) 2024-03-27T08:39:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96bbe00640 1 -- 172.21.15.164:0/952160544 learned_addr learned my addr 172.21.15.164:0/952160544 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:49.339 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.303+0000 7f96c0e00640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 0x56405ce38210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bb400640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce311d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 -- 172.21.15.164:0/952160544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 msgr2=0x56405ce311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce311d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 -- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 msgr2=0x56405ce38210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 0x56405ce38210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 -- 172.21.15.164:0/952160544 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56405cd535f0 con 0x56405ce26980 2024-03-27T08:39:49.340 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96c0e00640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 0x56405ce38210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96bbe00640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f96ac004600 tx=0x7f96ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ee740f4851d114 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.304+0000 7f96a6000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96ac01f630 con 0x56405ce26980 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a800fdb0 con 0x56405ce26980 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96ac01f7d0 con 0x56405ce26980 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96ac01f9d0 con 0x56405ce26980 2024-03-27T08:39:49.341 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96c5bc7740 10 client.16311 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56405caa0210 con 0x56405ce26980 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a800fdb0 con 0x56405ce26980 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f96ac027070 con 0x56405ce26980 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96c5bc7740 10 client.16311 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.305+0000 7f96c5bc7740 10 client.16311 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.306+0000 7f96c5bc7740 20 client.16311 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:49.342 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.306+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405ce3cb70 0x56405ce3f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.306+0000 7f96c5bc7740 4 client.16311 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.306+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56405cd99250 con 0x56405ce3cb70 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.306+0000 7f96bb400640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405ce3cb70 0x56405ce3f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.307+0000 7f96bb400640 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405ce3cb70 0x56405ce3f010 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f060ca070382625 server_cookie=643950a3ccd6a8cf in_seq=0 out_seq=0 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.307+0000 7f96a6000640 10 client.16311 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96a6000640 1 -- 172.21.15.164:0/952160544 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56405cd99250 con 0x56405ce3cb70 2024-03-27T08:39:49.343 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96a6000640 10 client.16311 handle_command_reply: tid=0 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 client.16311 shutdown 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 msgr2=0x56405ce30c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f96ac004600 tx=0x7f96ac004730 comp rx=0 tx=0).stop 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 shutdown_connections 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405ce3cb70 0x56405ce3f010 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce2c4e0 0x56405ce38210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.344 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce27370 0x56405ce311d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/952160544 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce26980 0x56405ce30c90 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 >> 172.21.15.164:0/952160544 conn(0x56405ce21ef0 msgr2=0x56405ce210f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.308+0000 7f96a6000640 0 client.16311 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.309+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 shutdown_connections 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.309+0000 7f96c5bc7740 1 -- 172.21.15.164:0/952160544 wait complete. 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.309+0000 7f96c5bc7740 20 client.16311 trim_cache size 0 max 16384 2024-03-27T08:39:49.345 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 Processor -- start 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 -- start start 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce25150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce25690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1ada70 con 0x56405ce27370 2024-03-27T08:39:49.346 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1ab2e0 con 0x56405ce26980 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1a9130 con 0x56405ce2c4e0 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.330+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bbe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce25150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39628/0 (socket says 172.21.15.164:39628) 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 -- 172.21.15.164:0/111762791 learned_addr learned my addr 172.21.15.164:0/111762791 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96c0e00640 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce25690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.347 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 -- 172.21.15.164:0/111762791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 msgr2=0x56405ce25690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce25690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 -- 172.21.15.164:0/111762791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 msgr2=0x56405ce25150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce25150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 -- 172.21.15.164:0/111762791 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56405cb6c620 con 0x56405ce27370 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.331+0000 7f96bb400640 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f96a8005d00 tx=0x7f96a8004500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63e4b2e6e7d3ea8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96b0c00640 1 -- 172.21.15.164:0/111762791 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a800fae0 con 0x56405ce27370 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96b0c00640 1 -- 172.21.15.164:0/111762791 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a8005510 con 0x56405ce27370 2024-03-27T08:39:49.348 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96b0c00640 1 -- 172.21.15.164:0/111762791 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a802c470 con 0x56405ce27370 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 -- 172.21.15.164:0/111762791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 msgr2=0x56405ce381d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f96a8005d00 tx=0x7f96a8004500 comp rx=0 tx=0).stop 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 -- 172.21.15.164:0/111762791 shutdown_connections 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce25690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce381d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/111762791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce25150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.349 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 -- 172.21.15.164:0/111762791 >> 172.21.15.164:0/111762791 conn(0x56405ce21ef0 msgr2=0x56405ce28650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.332+0000 7f96c5bc7740 1 -- 172.21.15.164:0/111762791 shutdown_connections 2024-03-27T08:39:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 -- 172.21.15.164:0/111762791 wait complete. 2024-03-27T08:39:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 -- start start 2024-03-27T08:39:49.350 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 Processor -- start 2024-03-27T08:39:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce351d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce36720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1a97a0 con 0x56405ce27370 2024-03-27T08:39:49.351 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1aac10 con 0x56405ce26980 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f96bc1a9e70 con 0x56405ce2c4e0 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.333+0000 7f96c5bc7740 10 client.0 _ll_register_callbacks cb 0x7f96ac009ad0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:39634/0 (socket says 172.21.15.164:39634) 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 -- 172.21.15.164:0/1938153949 learned_addr learned my addr 172.21.15.164:0/1938153949 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:39:49.352 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce351d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96c0e00640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce36720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 -- 172.21.15.164:0/1938153949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 msgr2=0x56405ce36720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce36720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 -- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 msgr2=0x56405ce351d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce351d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.353 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 -- 172.21.15.164:0/1938153949 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56405ce36d10 con 0x56405ce27370 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96bb400640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f96a8005cd0 tx=0x7f96a800b410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b358e3c05758d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.334+0000 7f96a6000640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96a803a060 con 0x56405ce27370 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f96a800f8e0 con 0x56405ce27370 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96a8005510 con 0x56405ce27370 2024-03-27T08:39:49.354 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f96a800fb60 con 0x56405ce27370 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96c5bc7740 10 client.16317 fetch_fsmap learned FSMap version 29 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x56405ce38020 con 0x56405ce27370 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.335+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96a8005510 con 0x56405ce27370 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 29) ==== 8354+0+0 (secure 0 0 0) 0x7f96a8029070 con 0x56405ce27370 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 10 client.16317 fetch_fsmap finished waiting for FSMap version 29 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 10 client.16317 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:39:49.355 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 20 client.16317 populate_metadata read hostname 'smithi164' 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405cea2fa0 0x56405cea5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 4 client.16317 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56405cd935a0 con 0x56405cea2fa0 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.336+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405cea2fa0 0x56405cea5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.337+0000 7f96bbe00640 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405cea2fa0 0x56405cea5390 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5ddd871f7e2f947c server_cookie=e929b2743c62b2d5 in_seq=0 out_seq=0 2024-03-27T08:39:49.356 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.337+0000 7f96a6000640 10 client.16317 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96a6000640 1 -- 172.21.15.164:0/1938153949 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56405cd935a0 con 0x56405cea2fa0 2024-03-27T08:39:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96a6000640 10 client.16317 handle_command_reply: tid=0 2024-03-27T08:39:49.363 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 client.16317 shutdown 2024-03-27T08:39:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 msgr2=0x56405ce35710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f96a8005cd0 tx=0x7f96a800b410 comp rx=0 tx=0).stop 2024-03-27T08:39:49.366 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 shutdown_connections 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56405cea2fa0 0x56405cea5390 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56405ce2c4e0 0x56405ce36720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56405ce27370 0x56405ce35710 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 --2- 172.21.15.164:0/1938153949 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56405ce26980 0x56405ce351d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96a6000640 0 client.16317 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 >> 172.21.15.164:0/1938153949 conn(0x56405ce21ef0 msgr2=0x56405ce25150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.367 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 shutdown_connections 2024-03-27T08:39:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.370+0000 7f96c5bc7740 1 -- 172.21.15.164:0/1938153949 wait complete. 2024-03-27T08:39:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.371+0000 7f96c5bc7740 20 client.16317 trim_cache size 0 max 16384 2024-03-27T08:39:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:39:49.368 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:39:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:39:49.369 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:39:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 msgr2=0x7f96a00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 0x7f96a00a5bf0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x56405ce27770 tx=0x7f96ac005f90 comp rx=0 tx=0).stop 2024-03-27T08:39:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 msgr2=0x7f96bc1a1520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:39:49.370 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f96b4037040 tx=0x7f96b4034d70 comp rx=0 tx=0).stop 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 shutdown_connections 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f96a00a3730 0x7f96a00a5bf0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f96bc105950 0x7f96bc1a1520 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96bc104f90 0x7f96bc19a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 --2- 172.21.15.164:0/1906019267 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f96bc103da0 0x7f96bc199f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:39:49.371 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 >> 172.21.15.164:0/1906019267 conn(0x7f96bc0ff310 msgr2=0x7f96bc1081c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:39:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 shutdown_connections 2024-03-27T08:39:49.372 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:39:49.372+0000 7f96c2e00640 1 -- 172.21.15.164:0/1906019267 wait complete. 2024-03-27T08:39:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:50 smithi164 ceph-mon[31788]: pgmap v576: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 438 KiB/s wr, 84 op/s 2024-03-27T08:39:51.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:50 smithi167 ceph-mon[34903]: pgmap v576: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 438 KiB/s wr, 84 op/s 2024-03-27T08:39:51.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:50 smithi173 ceph-mon[35397]: pgmap v576: 97 pgs: 97 active+clean; 155 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 312 KiB/s rd, 438 KiB/s wr, 84 op/s 2024-03-27T08:39:52.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:51 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:52.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:51 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:52.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:51 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:52.398 INFO:tasks.workunit.client.0.smithi164.stderr:+ rm -rf linux-4.0.5 2024-03-27T08:39:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:52 smithi164 ceph-mon[31788]: pgmap v577: 97 pgs: 97 active+clean; 156 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 322 KiB/s wr, 64 op/s 2024-03-27T08:39:53.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:52 smithi167 ceph-mon[34903]: pgmap v577: 97 pgs: 97 active+clean; 156 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 322 KiB/s wr, 64 op/s 2024-03-27T08:39:53.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:52 smithi173 ceph-mon[35397]: pgmap v577: 97 pgs: 97 active+clean; 156 MiB data, 914 MiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 322 KiB/s wr, 64 op/s 2024-03-27T08:39:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:54 smithi164 ceph-mon[31788]: pgmap v578: 97 pgs: 97 active+clean; 156 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 261 KiB/s wr, 49 op/s 2024-03-27T08:39:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:54 smithi167 ceph-mon[34903]: pgmap v578: 97 pgs: 97 active+clean; 156 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 261 KiB/s wr, 49 op/s 2024-03-27T08:39:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:54 smithi173 ceph-mon[35397]: pgmap v578: 97 pgs: 97 active+clean; 156 MiB data, 915 MiB used, 1.0 TiB / 1.0 TiB avail; 185 KiB/s rd, 261 KiB/s wr, 49 op/s 2024-03-27T08:39:57.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:56 smithi164 ceph-mon[31788]: pgmap v579: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-03-27T08:39:57.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:56 smithi164 ceph-mon[31788]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:56 smithi167 ceph-mon[34903]: pgmap v579: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-03-27T08:39:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:56 smithi167 ceph-mon[34903]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:56 smithi173 ceph-mon[35397]: pgmap v579: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 201 KiB/s rd, 235 KiB/s wr, 39 op/s 2024-03-27T08:39:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:56 smithi173 ceph-mon[35397]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 3 up:standby-replay 6 up:standby 2024-03-27T08:39:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:39:58 smithi164 ceph-mon[31788]: pgmap v580: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 159 KiB/s wr, 31 op/s 2024-03-27T08:39:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:39:58 smithi167 ceph-mon[34903]: pgmap v580: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 159 KiB/s wr, 31 op/s 2024-03-27T08:39:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:39:58 smithi173 ceph-mon[35397]: pgmap v580: 97 pgs: 97 active+clean; 156 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 159 KiB/s wr, 31 op/s 2024-03-27T08:40:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:39:59.999+0000 7fdaf9800700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-03-27T08:40:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:39:59.999+0000 7fdaf9800700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-03-27T08:40:00.254 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:39:59.999+0000 7fdaf9800700 -1 log_channel(cluster) log [ERR] : mds.h(mds.1): Metadata damage detected 2024-03-27T08:40:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-mon[31788]: pgmap v581: 97 pgs: 97 active+clean; 157 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 51 op/s 2024-03-27T08:40:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-mon[31788]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-03-27T08:40:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-mon[31788]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-03-27T08:40:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:00 smithi164 ceph-mon[31788]: mds.h(mds.1): Metadata damage detected 2024-03-27T08:40:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:00 smithi167 ceph-mon[34903]: pgmap v581: 97 pgs: 97 active+clean; 157 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 51 op/s 2024-03-27T08:40:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:00 smithi167 ceph-mon[34903]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-03-27T08:40:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:00 smithi167 ceph-mon[34903]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-03-27T08:40:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:00 smithi167 ceph-mon[34903]: mds.h(mds.1): Metadata damage detected 2024-03-27T08:40:01.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:00 smithi173 ceph-mon[35397]: pgmap v581: 97 pgs: 97 active+clean; 157 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 236 KiB/s rd, 248 KiB/s wr, 51 op/s 2024-03-27T08:40:01.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:00 smithi173 ceph-mon[35397]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-03-27T08:40:01.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:00 smithi173 ceph-mon[35397]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-03-27T08:40:01.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:00 smithi173 ceph-mon[35397]: mds.h(mds.1): Metadata damage detected 2024-03-27T08:40:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 -- 172.21.15.164:0/2487872100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec103db0 msgr2=0x7f2cec1041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 --2- 172.21.15.164:0/2487872100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec103db0 0x7f2cec1041d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009900 tx=0x7f2cdc02bc30 comp rx=0 tx=0).stop 2024-03-27T08:40:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 -- 172.21.15.164:0/2487872100 shutdown_connections 2024-03-27T08:40:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 --2- 172.21.15.164:0/2487872100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec105960 0x7f2cec10c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 --2- 172.21.15.164:0/2487872100 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec104fa0 0x7f2cec105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 --2- 172.21.15.164:0/2487872100 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec103db0 0x7f2cec1041d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 -- 172.21.15.164:0/2487872100 >> 172.21.15.164:0/2487872100 conn(0x7f2cec0ff340 msgr2=0x7f2cec101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 -- 172.21.15.164:0/2487872100 shutdown_connections 2024-03-27T08:40:02.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.521+0000 7f2cf1400640 1 -- 172.21.15.164:0/2487872100 wait complete. 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.522+0000 7f2cf1400640 1 Processor -- start 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.522+0000 7f2cf1400640 1 -- start start 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec103db0 0x7f2cec19a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec104fa0 0x7f2cec19a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f9f0 con 0x7f2cec105960 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10f870 con 0x7f2cec104fa0 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cf1400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec10fb70 con 0x7f2cec103db0 2024-03-27T08:40:02.516 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec104fa0 0x7f2cec19a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32850/0 (socket says 172.21.15.164:32850) 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 -- 172.21.15.164:0/883252881 learned_addr learned my addr 172.21.15.164:0/883252881 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2cea800640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec103db0 0x7f2cec19a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 -- 172.21.15.164:0/883252881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec103db0 msgr2=0x7f2cec19a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec103db0 0x7f2cec19a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 -- 172.21.15.164:0/883252881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec104fa0 msgr2=0x7f2cec19a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec104fa0 0x7f2cec19a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.523+0000 7f2ceb200640 1 -- 172.21.15.164:0/883252881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cec1a1c20 con 0x7f2cec105960 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2ceb200640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400eaa0 tx=0x7f2ce400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2ce3400640 1 -- 172.21.15.164:0/883252881 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce400cdb0 con 0x7f2cec105960 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2ce3400640 1 -- 172.21.15.164:0/883252881 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2ce4005020 con 0x7f2cec105960 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2ce3400640 1 -- 172.21.15.164:0/883252881 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ce40116b0 con 0x7f2cec105960 2024-03-27T08:40:02.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cec1a1f10 con 0x7f2cec105960 2024-03-27T08:40:02.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.524+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cec1a2380 con 0x7f2cec105960 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.527+0000 7f2cf41d1740 1 Processor -- start 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2ce3400640 1 -- 172.21.15.164:0/883252881 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f2ce40051d0 con 0x7f2cec105960 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 -- start start 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abbbda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abc14e0 0x55de9abc3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55de9ab20d10 con 0x55de9abbc370 2024-03-27T08:40:02.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55de9aac9260 con 0x55de9abc14e0 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.528+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de9ab1ccc0 con 0x55de9abbb980 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32854/0 (socket says 172.21.15.164:32854) 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abc14e0 0x55de9abc3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 -- 172.21.15.164:0/3520779351 learned_addr learned my addr 172.21.15.164:0/3520779351 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:02.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abbbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2ce3400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 0x7f2cd00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 -- 172.21.15.164:0/3520779351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 msgr2=0x55de9abbbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abbbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 -- 172.21.15.164:0/3520779351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abc14e0 msgr2=0x55de9abc3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abc14e0 0x55de9abc3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2cea800640 1 -- 172.21.15.164:0/3520779351 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9aac0aa0 con 0x55de9abbc370 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2ce3400640 1 -- 172.21.15.164:0/883252881 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2ce40cff50 con 0x7f2cec105960 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.529+0000 7f2ceb200640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 0x7f2cd00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.523 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.530+0000 7f2cea800640 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009900 tx=0x7f2cdc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5ebb0e091a7c05f server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.530+0000 7f2cdb400640 1 -- 172.21.15.164:0/3520779351 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc02cb20 con 0x55de9abbc370 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.530+0000 7f2cdb400640 1 -- 172.21.15.164:0/3520779351 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2cdc005040 con 0x55de9abbc370 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.530+0000 7f2cdb400640 1 -- 172.21.15.164:0/3520779351 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc004920 con 0x55de9abbc370 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 -- 172.21.15.164:0/3520779351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 msgr2=0x55de9abc0e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc009900 tx=0x7f2cdc009560 comp rx=0 tx=0).stop 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2ceb200640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 0x7f2cd00a5bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40a4b10 tx=0x7f2ce4098040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 -- 172.21.15.164:0/3520779351 shutdown_connections 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abc14e0 0x55de9abc3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbc370 0x55de9abc0e70 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/3520779351 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abbbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 -- 172.21.15.164:0/3520779351 >> 172.21.15.164:0/3520779351 conn(0x55de9abb6ef0 msgr2=0x55de9abb72f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 -- 172.21.15.164:0/3520779351 shutdown_connections 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.531+0000 7f2cf41d1740 1 -- 172.21.15.164:0/3520779351 wait complete. 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 -- start start 2024-03-27T08:40:02.524 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 Processor -- start 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abc6170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abcd1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55de9abc4430 con 0x55de9abbb980 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55de9aadc630 con 0x55de9abbc370 2024-03-27T08:40:02.527 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55de9abc45b0 con 0x55de9abc14e0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2cf41d1740 10 client.0 _ll_register_callbacks cb 0x55de9aae1c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.532+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2cea800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abc6170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32862/0 (socket says 172.21.15.164:32862) 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 -- 172.21.15.164:0/4245302914 learned_addr learned my addr 172.21.15.164:0/4245302914 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 -- 172.21.15.164:0/4245302914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 msgr2=0x55de9abcd1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abcd1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 -- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 msgr2=0x55de9abc6170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abc6170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 -- 172.21.15.164:0/4245302914 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9aae85f0 con 0x55de9abbb980 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400bfe0 tx=0x7f2cd40039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6d01b07d5ffb106 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:02.528 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4005220 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2cd40053c0 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.533+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cdc005040 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2cd40055c0 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 10 client.16329 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55de9a835210 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2cdc005040 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2cd401c030 con 0x55de9abbb980 2024-03-27T08:40:02.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 10 client.16329 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 10 client.16329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 20 client.16329 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9abd1b10 0x55de9abd3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 4 client.16329 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.534+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55de9ab2e250 con 0x55de9abd1b10 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.535+0000 7f2cea800640 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9abd1b10 0x55de9abd3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.535+0000 7f2cea800640 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9abd1b10 0x55de9abd3fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86e55ea8ddbfec1e server_cookie=bd4a454cb8f13e9d in_seq=0 out_seq=0 2024-03-27T08:40:02.530 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.535+0000 7f2ccfe00640 10 client.16329 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.536+0000 7f2ccfe00640 1 -- 172.21.15.164:0/4245302914 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55de9ab2e250 con 0x55de9abd1b10 2024-03-27T08:40:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.536+0000 7f2ccfe00640 10 client.16329 handle_command_reply: tid=0 2024-03-27T08:40:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.536+0000 7f2cf41d1740 1 client.16329 shutdown 2024-03-27T08:40:02.531 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 msgr2=0x55de9abc5c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f2cd400bfe0 tx=0x7f2cd40039c0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 shutdown_connections 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9abd1b10 0x55de9abd3fb0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abcd1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abc6170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2ccfe00640 0 client.16329 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/4245302914 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5c30 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 >> 172.21.15.164:0/4245302914 conn(0x55de9abb6ef0 msgr2=0x55de9abb60f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 shutdown_connections 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 1 -- 172.21.15.164:0/4245302914 wait complete. 2024-03-27T08:40:02.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.537+0000 7f2cf41d1740 20 client.16329 trim_cache size 0 max 16384 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.553+0000 7f2cf41d1740 1 Processor -- start 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 -- start start 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abd8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1adb80 con 0x55de9abbb980 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1ab390 con 0x55de9abbc370 2024-03-27T08:40:02.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1a91e0 con 0x55de9abc14e0 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32876/0 (socket says 172.21.15.164:32876) 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 -- 172.21.15.164:0/2418200057 learned_addr learned my addr 172.21.15.164:0/2418200057 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2cea800640 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 -- 172.21.15.164:0/2418200057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 msgr2=0x55de9abd8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abd8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 -- 172.21.15.164:0/2418200057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 msgr2=0x55de9abcd170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.554+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcd170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2ce3e00640 1 -- 172.21.15.164:0/2418200057 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55de9a901620 con 0x55de9abbb980 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2cea800640 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40057c0 tx=0x7f2cd40104c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=294532a9d6ee0f20 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2cdaa00640 1 -- 172.21.15.164:0/2418200057 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd4012870 con 0x55de9abbb980 2024-03-27T08:40:02.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2cdaa00640 1 -- 172.21.15.164:0/2418200057 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2cd4010af0 con 0x55de9abbb980 2024-03-27T08:40:02.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.555+0000 7f2cdaa00640 1 -- 172.21.15.164:0/2418200057 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cd401d920 con 0x55de9abbb980 2024-03-27T08:40:02.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2418200057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 msgr2=0x55de9abc5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f2cd40057c0 tx=0x7f2cd40104c0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2418200057 shutdown_connections 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abc14e0 0x55de9abd8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2418200057 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abbb980 0x55de9abc5eb0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2418200057 >> 172.21.15.164:0/2418200057 conn(0x55de9abb6ef0 msgr2=0x55de9abba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2418200057 shutdown_connections 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2418200057 wait complete. 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.556+0000 7f2cf41d1740 1 -- start start 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 Processor -- start 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abcab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abc14e0 0x55de9abcbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1a9850 con 0x55de9abc14e0 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1aacc0 con 0x55de9abbc370 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2cec1a9f20 con 0x55de9abbb980 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.557+0000 7f2cf41d1740 10 client.0 _ll_register_callbacks cb 0x7f2cd400bd40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2ce3e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abc14e0 0x55de9abcbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:38152/0 (socket says 172.21.15.164:38152) 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 -- 172.21.15.164:0/2184851003 learned_addr learned my addr 172.21.15.164:0/2184851003 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abcab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 -- 172.21.15.164:0/2184851003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 msgr2=0x55de9abcab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abcab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 -- 172.21.15.164:0/2184851003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abc14e0 msgr2=0x55de9abcbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abc14e0 0x55de9abcbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.551 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 -- 172.21.15.164:0/2184851003 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55de9abcc5b0 con 0x55de9abbc370 2024-03-27T08:40:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2cea800640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005c40 tx=0x7f2cdc02c680 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b61d464f9f87887 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:02.552 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.558+0000 7f2ccfe00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:40:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.559+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cdc04f070 con 0x55de9abbc370 2024-03-27T08:40:02.553 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.559+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f2cdc004240 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.559+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2cd4010af0 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.560+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2cdc005d50 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.560+0000 7f2cf41d1740 10 client.36011 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.560+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55de9ac38000 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.560+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2cd4010af0 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.560+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f2cdc004ae0 con 0x55de9abbc370 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 10 client.36011 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 10 client.36011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 20 client.36011 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9ac385d0 0x55de9ac3a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 4 client.36011 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55de9ab285a0 con 0x55de9ac385d0 2024-03-27T08:40:02.554 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.561+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9ac385d0 0x55de9ac3a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.562+0000 7f2ce3e00640 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9ac385d0 0x55de9ac3a9c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6f91ab49caf82ac server_cookie=9675816e1f3519ac in_seq=0 out_seq=0 2024-03-27T08:40:02.555 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.562+0000 7f2ccfe00640 10 client.36011 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2ccfe00640 1 -- 172.21.15.164:0/2184851003 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55de9ab285a0 con 0x55de9ac385d0 2024-03-27T08:40:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2ccfe00640 10 client.36011 handle_command_reply: tid=0 2024-03-27T08:40:02.853 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 client.36011 shutdown 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 msgr2=0x55de9abcb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f2cdc005c40 tx=0x7f2cdc02c680 comp rx=0 tx=0).stop 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 shutdown_connections 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55de9ac385d0 0x55de9ac3a9c0 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55de9abc14e0 0x55de9abcbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55de9abbc370 0x55de9abcb050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2ccfe00640 0 client.36011 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 --2- 172.21.15.164:0/2184851003 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55de9abbb980 0x55de9abcab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.860+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 >> 172.21.15.164:0/2184851003 conn(0x55de9abb6ef0 msgr2=0x55de9abba9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 shutdown_connections 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf41d1740 1 -- 172.21.15.164:0/2184851003 wait complete. 2024-03-27T08:40:02.854 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf41d1740 20 client.36011 trim_cache size 0 max 16384 2024-03-27T08:40:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:40:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:40:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:40:02.855 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:40:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 msgr2=0x7f2cd00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 0x7f2cd00a5bf0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f2ce40a4b10 tx=0x7f2ce4098040 comp rx=0 tx=0).stop 2024-03-27T08:40:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 msgr2=0x7f2cec1a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.861+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f2ce400eaa0 tx=0x7f2ce400ef60 comp rx=0 tx=0).stop 2024-03-27T08:40:02.856 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 shutdown_connections 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f2cd00a3730 0x7f2cd00a5bf0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2cec105960 0x7f2cec1a15b0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2cec104fa0 0x7f2cec19a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 --2- 172.21.15.164:0/883252881 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2cec103db0 0x7f2cec19a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 >> 172.21.15.164:0/883252881 conn(0x7f2cec0ff340 msgr2=0x7f2cec1082a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 shutdown_connections 2024-03-27T08:40:02.857 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:02.862+0000 7f2cf1400640 1 -- 172.21.15.164:0/883252881 wait complete. 2024-03-27T08:40:03.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:02 smithi164 ceph-mon[31788]: pgmap v582: 97 pgs: 97 active+clean; 157 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 274 KiB/s wr, 72 op/s 2024-03-27T08:40:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:02 smithi167 ceph-mon[34903]: pgmap v582: 97 pgs: 97 active+clean; 157 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 274 KiB/s wr, 72 op/s 2024-03-27T08:40:03.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:02 smithi173 ceph-mon[35397]: pgmap v582: 97 pgs: 97 active+clean; 157 MiB data, 926 MiB used, 1.0 TiB / 1.0 TiB avail; 265 KiB/s rd, 274 KiB/s wr, 72 op/s 2024-03-27T08:40:04.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:03 smithi164 ceph-mon[31788]: pgmap v583: 97 pgs: 97 active+clean; 158 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 314 KiB/s wr, 110 op/s 2024-03-27T08:40:04.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:03 smithi167 ceph-mon[34903]: pgmap v583: 97 pgs: 97 active+clean; 158 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 314 KiB/s wr, 110 op/s 2024-03-27T08:40:04.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:03 smithi173 ceph-mon[35397]: pgmap v583: 97 pgs: 97 active+clean; 158 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 314 KiB/s wr, 110 op/s 2024-03-27T08:40:06.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:06 smithi167 ceph-mon[34903]: pgmap v584: 97 pgs: 97 active+clean; 159 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 371 KiB/s wr, 243 op/s 2024-03-27T08:40:06.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:06 smithi173 ceph-mon[35397]: pgmap v584: 97 pgs: 97 active+clean; 159 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 371 KiB/s wr, 243 op/s 2024-03-27T08:40:07.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:06 smithi164 ceph-mon[31788]: pgmap v584: 97 pgs: 97 active+clean; 159 MiB data, 917 MiB used, 1.0 TiB / 1.0 TiB avail; 315 KiB/s rd, 371 KiB/s wr, 243 op/s 2024-03-27T08:40:08.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:08 smithi167 ceph-mon[34903]: pgmap v585: 97 pgs: 97 active+clean; 154 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 363 KiB/s wr, 295 op/s 2024-03-27T08:40:08.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:08 smithi173 ceph-mon[35397]: pgmap v585: 97 pgs: 97 active+clean; 154 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 363 KiB/s wr, 295 op/s 2024-03-27T08:40:09.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:08 smithi164 ceph-mon[31788]: pgmap v585: 97 pgs: 97 active+clean; 154 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 295 KiB/s rd, 363 KiB/s wr, 295 op/s 2024-03-27T08:40:10.818 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:10 smithi167 ceph-mon[34903]: pgmap v586: 97 pgs: 97 active+clean; 156 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 525 KiB/s wr, 346 op/s 2024-03-27T08:40:10.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:10 smithi173 ceph-mon[35397]: pgmap v586: 97 pgs: 97 active+clean; 156 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 525 KiB/s wr, 346 op/s 2024-03-27T08:40:11.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:10 smithi164 ceph-mon[31788]: pgmap v586: 97 pgs: 97 active+clean; 156 MiB data, 893 MiB used, 1.0 TiB / 1.0 TiB avail; 453 KiB/s rd, 525 KiB/s wr, 346 op/s 2024-03-27T08:40:12.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:12 smithi173 ceph-mon[35397]: pgmap v587: 97 pgs: 97 active+clean; 157 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 529 KiB/s wr, 351 op/s 2024-03-27T08:40:13.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:12 smithi164 ceph-mon[31788]: pgmap v587: 97 pgs: 97 active+clean; 157 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 529 KiB/s wr, 351 op/s 2024-03-27T08:40:13.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:12 smithi167 ceph-mon[34903]: pgmap v587: 97 pgs: 97 active+clean; 157 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 421 KiB/s rd, 529 KiB/s wr, 351 op/s 2024-03-27T08:40:15.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:14 smithi164 ceph-mon[31788]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 563 KiB/s wr, 344 op/s 2024-03-27T08:40:15.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:14 smithi167 ceph-mon[34903]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 563 KiB/s wr, 344 op/s 2024-03-27T08:40:15.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:14 smithi173 ceph-mon[35397]: pgmap v588: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 464 KiB/s rd, 563 KiB/s wr, 344 op/s 2024-03-27T08:40:16.013 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 -- 172.21.15.164:0/3283370329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684075b90 msgr2=0x7f7684073fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 --2- 172.21.15.164:0/3283370329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684075b90 0x7f7684073fe0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7674009900 tx=0x7f767402bc50 comp rx=0 tx=0).stop 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 -- 172.21.15.164:0/3283370329 shutdown_connections 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 --2- 172.21.15.164:0/3283370329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684109a50 0x7f768410bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 --2- 172.21.15.164:0/3283370329 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 0x7f7684074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 --2- 172.21.15.164:0/3283370329 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684075b90 0x7f7684073fe0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 -- 172.21.15.164:0/3283370329 >> 172.21.15.164:0/3283370329 conn(0x7f76840fd0e0 msgr2=0x7f76840ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 -- 172.21.15.164:0/3283370329 shutdown_connections 2024-03-27T08:40:16.014 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.022+0000 7f7688c00640 1 -- 172.21.15.164:0/3283370329 wait complete. 2024-03-27T08:40:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 Processor -- start 2024-03-27T08:40:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 -- start start 2024-03-27T08:40:16.015 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 0x7f768419a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.016 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684075b90 0x7f768419a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f768410fa90 con 0x7f7684109a50 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f768410f910 con 0x7f7684075b90 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.024+0000 7f7688c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f768410fc10 con 0x7f76840745b0 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.025+0000 7f7682800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.025+0000 7f7682800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54872/0 (socket says 172.21.15.164:54872) 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.025+0000 7f7682800640 1 -- 172.21.15.164:0/3905084363 learned_addr learned my addr 172.21.15.164:0/3905084363 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.025+0000 7f7681e00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 0x7f768419a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.017 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.025+0000 7f7681400640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684075b90 0x7f768419a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.026+0000 7f7682800640 1 -- 172.21.15.164:0/3905084363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 msgr2=0x7f768419a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.026+0000 7f7682800640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 0x7f768419a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.026+0000 7f7682800640 1 -- 172.21.15.164:0/3905084363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684075b90 msgr2=0x7f768419a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.026+0000 7f7682800640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684075b90 0x7f768419a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.026+0000 7f7682800640 1 -- 172.21.15.164:0/3905084363 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76841a1c60 con 0x7f7684109a50 2024-03-27T08:40:16.018 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.027+0000 7f7682800640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f767c00eaa0 tx=0x7f767c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.027+0000 7f767aa00640 1 -- 172.21.15.164:0/3905084363 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c004d20 con 0x7f7684109a50 2024-03-27T08:40:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.028+0000 7f767aa00640 1 -- 172.21.15.164:0/3905084363 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f767c005020 con 0x7f7684109a50 2024-03-27T08:40:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.028+0000 7f767aa00640 1 -- 172.21.15.164:0/3905084363 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767c0116d0 con 0x7f7684109a50 2024-03-27T08:40:16.019 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.028+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76841a1f50 con 0x7f7684109a50 2024-03-27T08:40:16.020 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.028+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76841a2440 con 0x7f7684109a50 2024-03-27T08:40:16.024 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.033+0000 7f768b880740 1 Processor -- start 2024-03-27T08:40:16.025 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.034+0000 7f767aa00640 1 -- 172.21.15.164:0/3905084363 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f767c0051d0 con 0x7f7684109a50 2024-03-27T08:40:16.026 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.034+0000 7f768b880740 1 -- start start 2024-03-27T08:40:16.027 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e12da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e184e0 0x563226e1a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563226d77d10 con 0x563226e12980 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563226d20260 con 0x563226e184e0 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f768b880740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563226d73cc0 con 0x563226e13370 2024-03-27T08:40:16.028 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f7681e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.035+0000 7f7681e00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.173:3300/0 says I am v2:172.21.15.164:59802/0 (socket says 172.21.15.164:59802) 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f7681e00640 1 -- 172.21.15.164:0/2879319353 learned_addr learned my addr 172.21.15.164:0/2879319353 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f7681400640 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e184e0 0x563226e1a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f7681400640 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e12da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f7681e00640 1 -- 172.21.15.164:0/2879319353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e184e0 msgr2=0x563226e1a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f7681e00640 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e184e0 0x563226e1a970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.036+0000 7f767aa00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 0x7f76680a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.037+0000 7f767aa00640 1 -- 172.21.15.164:0/3905084363 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f767c0cfe60 con 0x7f7684109a50 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.037+0000 7f7681e00640 1 -- 172.21.15.164:0/2879319353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 msgr2=0x563226e12da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.029 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.037+0000 7f7681e00640 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e12da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.037+0000 7f7681e00640 1 -- 172.21.15.164:0/2879319353 --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563226d17aa0 con 0x563226e13370 2024-03-27T08:40:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.038+0000 7f7681e00640 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f767402c260 tx=0x7f7674005dd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e69b415c1b56b746 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.038+0000 7f7682800640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 0x7f76680a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.038+0000 7f766f000640 1 -- 172.21.15.164:0/2879319353 <== mon.1 v2:172.21.15.173:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674045020 con 0x563226e13370 2024-03-27T08:40:16.030 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.039+0000 7f766f000640 1 -- 172.21.15.164:0/2879319353 <== mon.1 v2:172.21.15.173:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f767402cb00 con 0x563226e13370 2024-03-27T08:40:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.039+0000 7f7682800640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 0x7f76680a5c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f767c098740 tx=0x7f767c004f50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.031 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.039+0000 7f766f000640 1 -- 172.21.15.164:0/2879319353 <== mon.1 v2:172.21.15.173:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76740046c0 con 0x563226e13370 2024-03-27T08:40:16.032 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 -- 172.21.15.164:0/2879319353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 msgr2=0x563226e17e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.033 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f767402c260 tx=0x7f7674005dd0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 -- 172.21.15.164:0/2879319353 shutdown_connections 2024-03-27T08:40:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e184e0 0x563226e1a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e13370 0x563226e17e70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.041+0000 7f768b880740 1 --2- 172.21.15.164:0/2879319353 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e12da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.034 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.042+0000 7f768b880740 1 -- 172.21.15.164:0/2879319353 >> 172.21.15.164:0/2879319353 conn(0x563226e0def0 msgr2=0x563226e0e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.042+0000 7f768b880740 1 -- 172.21.15.164:0/2879319353 shutdown_connections 2024-03-27T08:40:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.042+0000 7f768b880740 1 -- 172.21.15.164:0/2879319353 wait complete. 2024-03-27T08:40:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.042+0000 7f768b880740 1 -- start start 2024-03-27T08:40:16.035 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.043+0000 7f768b880740 1 Processor -- start 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e254d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e184e0 0x563226e2ca50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x563226e1b480 con 0x563226e12980 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563226d33630 con 0x563226e13370 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x563226e1b600 con 0x563226e184e0 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f768b880740 10 client.0 _ll_register_callbacks cb 0x563226d38c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:16.036 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.044+0000 7f7681e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:43060/0 (socket says 172.21.15.164:43060) 2024-03-27T08:40:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681e00640 1 -- 172.21.15.164:0/197310323 learned_addr learned my addr 172.21.15.164:0/197310323 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681400640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e184e0 0x563226e2ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.037 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681400640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e254d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681e00640 1 -- 172.21.15.164:0/197310323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e184e0 msgr2=0x563226e2ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681e00640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e184e0 0x563226e2ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.045+0000 7f7681e00640 1 -- 172.21.15.164:0/197310323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 msgr2=0x563226e254d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.046+0000 7f7681e00640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e254d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.038 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.046+0000 7f7681e00640 1 -- 172.21.15.164:0/197310323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563226d3f5f0 con 0x563226e13370 2024-03-27T08:40:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.046+0000 7f7681e00640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7674036040 tx=0x7f7674004610 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d1bbfee1d3ce5f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.039 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.046+0000 7f7663400640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.047+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674045040 con 0x563226e13370 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.047+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f76740037f0 con 0x563226e13370 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.047+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f767402cb00 con 0x563226e13370 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.047+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f76740039f0 con 0x563226e13370 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.048+0000 7f768b880740 10 client.36023 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.048+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563226a8c210 con 0x563226e13370 2024-03-27T08:40:16.040 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.048+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f767402cb00 con 0x563226e13370 2024-03-27T08:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f767404c460 con 0x563226e13370 2024-03-27T08:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 10 client.36023 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 10 client.36023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:16.041 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 20 client.36023 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e30f40 0x563226e33330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 4 client.36023 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:40:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.049+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563226d85250 con 0x563226e30f40 2024-03-27T08:40:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.050+0000 7f7681400640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e30f40 0x563226e33330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.042 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.051+0000 7f7681400640 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e30f40 0x563226e33330 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=302f909444bc7d27 server_cookie=866583734b9e2da4 in_seq=0 out_seq=0 2024-03-27T08:40:16.043 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.051+0000 7f7663400640 10 client.36023 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:16.045 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.052+0000 7f7663400640 1 -- 172.21.15.164:0/197310323 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x563226d85250 con 0x563226e30f40 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.052+0000 7f7663400640 10 client.36023 handle_command_reply: tid=0 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.052+0000 7f768b880740 1 client.36023 shutdown 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 msgr2=0x563226e25a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7674036040 tx=0x7f7674004610 comp rx=0 tx=0).stop 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 shutdown_connections 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e30f40 0x563226e33330 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e184e0 0x563226e2ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e25a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 --2- 172.21.15.164:0/197310323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e254d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 >> 172.21.15.164:0/197310323 conn(0x563226e0def0 msgr2=0x563226e0d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.046 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.053+0000 7f7663400640 0 client.36023 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.054+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 shutdown_connections 2024-03-27T08:40:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.054+0000 7f768b880740 1 -- 172.21.15.164:0/197310323 wait complete. 2024-03-27T08:40:16.047 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.054+0000 7f768b880740 20 client.36023 trim_cache size 0 max 16384 2024-03-27T08:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.078+0000 7f768b880740 1 Processor -- start 2024-03-27T08:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.078+0000 7f768b880740 1 -- start start 2024-03-27T08:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e11860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.070 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e12980 0x563226e2ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a9720 con 0x563226e13370 2024-03-27T08:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a6f30 con 0x563226e12980 2024-03-27T08:40:16.071 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f768b880740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a4d80 con 0x563226e0def0 2024-03-27T08:40:16.072 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f7681400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f7681400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54896/0 (socket says 172.21.15.164:54896) 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f7681400640 1 -- 172.21.15.164:0/3064922496 learned_addr learned my addr 172.21.15.164:0/3064922496 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e11860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.079+0000 7f7681e00640 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e12980 0x563226e2ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 -- 172.21.15.164:0/3064922496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 msgr2=0x563226e11860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e11860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 -- 172.21.15.164:0/3064922496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e12980 msgr2=0x563226e2ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e12980 0x563226e2ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 -- 172.21.15.164:0/3064922496 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563226b58620 con 0x563226e13370 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.080+0000 7f7681400640 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f768419b550 tx=0x7f76700047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ea53ba48955f0a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.073 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.081+0000 7f766e600640 1 -- 172.21.15.164:0/3064922496 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767002c070 con 0x563226e13370 2024-03-27T08:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.081+0000 7f766e600640 1 -- 172.21.15.164:0/3064922496 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7670025760 con 0x563226e13370 2024-03-27T08:40:16.074 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.081+0000 7f766e600640 1 -- 172.21.15.164:0/3064922496 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7670017cf0 con 0x563226e13370 2024-03-27T08:40:16.075 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 -- 172.21.15.164:0/3064922496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 msgr2=0x563226e37b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f768419b550 tx=0x7f76700047d0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 -- 172.21.15.164:0/3064922496 shutdown_connections 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e13370 0x563226e37b70 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e12980 0x563226e2ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 --2- 172.21.15.164:0/3064922496 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e11860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 -- 172.21.15.164:0/3064922496 >> 172.21.15.164:0/3064922496 conn(0x563226e17fe0 msgr2=0x563226e11150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 -- 172.21.15.164:0/3064922496 shutdown_connections 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.082+0000 7f768b880740 1 -- 172.21.15.164:0/3064922496 wait complete. 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.083+0000 7f768b880740 1 -- start start 2024-03-27T08:40:16.076 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.083+0000 7f768b880740 1 Processor -- start 2024-03-27T08:40:16.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e2a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.077 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e2b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a53f0 con 0x563226e12980 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a6860 con 0x563226e13370 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f76841a5ac0 con 0x563226e0def0 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f768b880740 10 client.0 _ll_register_callbacks cb 0x7f76700097b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f7681400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e2a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f7681e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f7681e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:54898/0 (socket says 172.21.15.164:54898) 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.085+0000 7f7681e00640 1 -- 172.21.15.164:0/3348471409 learned_addr learned my addr 172.21.15.164:0/3348471409 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.086+0000 7f7681e00640 1 -- 172.21.15.164:0/3348471409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 msgr2=0x563226e2a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.086+0000 7f7681e00640 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e2a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.086+0000 7f7681e00640 1 -- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 msgr2=0x563226e2b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:16.078 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.086+0000 7f7681e00640 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e2b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.079 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.086+0000 7f7681e00640 1 -- 172.21.15.164:0/3348471409 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563226e2be70 con 0x563226e12980 2024-03-27T08:40:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.087+0000 7f7681e00640 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f767402bc90 tx=0x7f767402c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4230ee922c6e407 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.087+0000 7f7663400640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:16.080 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.087+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674045040 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.087+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f7674003d90 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.087+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7670025760 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f7674003800 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 10 client.16353 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x563226e97420 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7670025760 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f767405f030 con 0x563226e12980 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 10 client.16353 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 10 client.16353 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 20 client.16353 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e184e0 0x563226e99e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 4 client.16353 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.088+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563226d7f5a0 con 0x563226e184e0 2024-03-27T08:40:16.081 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.089+0000 7f7681400640 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e184e0 0x563226e99e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:16.083 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.092+0000 7f7681400640 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e184e0 0x563226e99e90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=76ca48a259a5e891 server_cookie=afa28aa4f1f1440b in_seq=0 out_seq=0 2024-03-27T08:40:16.084 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.092+0000 7f7663400640 10 client.16353 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f7663400640 1 -- 172.21.15.164:0/3348471409 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563226d7f5a0 con 0x563226e184e0 2024-03-27T08:40:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f7663400640 10 client.16353 handle_command_reply: tid=0 2024-03-27T08:40:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 client.16353 shutdown 2024-03-27T08:40:16.113 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 msgr2=0x563226e2a8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f767402bc90 tx=0x7f767402c2d0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 shutdown_connections 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x563226e184e0 0x563226e99e90 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563226e13370 0x563226e2b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x563226e12980 0x563226e2a8c0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.114 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 --2- 172.21.15.164:0/3348471409 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x563226e0def0 0x563226e2a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f7663400640 0 client.16353 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 >> 172.21.15.164:0/3348471409 conn(0x563226e17fe0 msgr2=0x563226e119e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 shutdown_connections 2024-03-27T08:40:16.115 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 1 -- 172.21.15.164:0/3348471409 wait complete. 2024-03-27T08:40:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.120+0000 7f768b880740 20 client.16353 trim_cache size 0 max 16384 2024-03-27T08:40:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:40:16.116 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:40:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:40:16.117 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:40:16.118 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 msgr2=0x7f76680a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 0x7f76680a5c70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f767c098740 tx=0x7f767c004f50 comp rx=0 tx=0).stop 2024-03-27T08:40:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 msgr2=0x7f76841a15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f767c00eaa0 tx=0x7f767c00eea0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 shutdown_connections 2024-03-27T08:40:16.119 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f76680a37b0 0x7f76680a5c70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7684109a50 0x7f76841a15f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7684075b90 0x7f768419a5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 --2- 172.21.15.164:0/3905084363 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f76840745b0 0x7f768419a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 >> 172.21.15.164:0/3905084363 conn(0x7f76840fd0e0 msgr2=0x7f7684105950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.121+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 shutdown_connections 2024-03-27T08:40:16.120 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:16.122+0000 7f7688c00640 1 -- 172.21.15.164:0/3905084363 wait complete. 2024-03-27T08:40:17.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:16 smithi164 ceph-mon[31788]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 423 KiB/s wr, 325 op/s 2024-03-27T08:40:17.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:16 smithi167 ceph-mon[34903]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 423 KiB/s wr, 325 op/s 2024-03-27T08:40:17.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:16 smithi173 ceph-mon[35397]: pgmap v589: 97 pgs: 97 active+clean; 156 MiB data, 897 MiB used, 1.0 TiB / 1.0 TiB avail; 351 KiB/s rd, 423 KiB/s wr, 325 op/s 2024-03-27T08:40:19.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:18 smithi164 ceph-mon[31788]: pgmap v590: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 212 op/s 2024-03-27T08:40:19.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:18 smithi167 ceph-mon[34903]: pgmap v590: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 212 op/s 2024-03-27T08:40:19.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:18 smithi173 ceph-mon[35397]: pgmap v590: 97 pgs: 97 active+clean; 157 MiB data, 882 MiB used, 1.0 TiB / 1.0 TiB avail; 506 KiB/s rd, 544 KiB/s wr, 212 op/s 2024-03-27T08:40:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:20 smithi164 ceph-mon[31788]: pgmap v591: 97 pgs: 97 active+clean; 155 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 525 KiB/s wr, 182 op/s 2024-03-27T08:40:21.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:20 smithi167 ceph-mon[34903]: pgmap v591: 97 pgs: 97 active+clean; 155 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 525 KiB/s wr, 182 op/s 2024-03-27T08:40:21.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:20 smithi173 ceph-mon[35397]: pgmap v591: 97 pgs: 97 active+clean; 155 MiB data, 876 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 525 KiB/s wr, 182 op/s 2024-03-27T08:40:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:22 smithi164 ceph-mon[31788]: pgmap v592: 97 pgs: 97 active+clean; 155 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 430 KiB/s wr, 144 op/s 2024-03-27T08:40:23.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:22 smithi167 ceph-mon[34903]: pgmap v592: 97 pgs: 97 active+clean; 155 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 430 KiB/s wr, 144 op/s 2024-03-27T08:40:23.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:22 smithi173 ceph-mon[35397]: pgmap v592: 97 pgs: 97 active+clean; 155 MiB data, 878 MiB used, 1.0 TiB / 1.0 TiB avail; 437 KiB/s rd, 430 KiB/s wr, 144 op/s 2024-03-27T08:40:25.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:24 smithi164 ceph-mon[31788]: pgmap v593: 97 pgs: 97 active+clean; 154 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 337 KiB/s wr, 133 op/s 2024-03-27T08:40:25.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:24 smithi167 ceph-mon[34903]: pgmap v593: 97 pgs: 97 active+clean; 154 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 337 KiB/s wr, 133 op/s 2024-03-27T08:40:25.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:24 smithi173 ceph-mon[35397]: pgmap v593: 97 pgs: 97 active+clean; 154 MiB data, 875 MiB used, 1.0 TiB / 1.0 TiB avail; 382 KiB/s rd, 337 KiB/s wr, 133 op/s 2024-03-27T08:40:27.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:26 smithi164 ceph-mon[31788]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 411 KiB/s wr, 151 op/s 2024-03-27T08:40:27.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:26 smithi167 ceph-mon[34903]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 411 KiB/s wr, 151 op/s 2024-03-27T08:40:27.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:26 smithi173 ceph-mon[35397]: pgmap v594: 97 pgs: 97 active+clean; 153 MiB data, 870 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 411 KiB/s wr, 151 op/s 2024-03-27T08:40:28.906 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:28 smithi164 ceph-mon[31788]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 412 KiB/s wr, 134 op/s 2024-03-27T08:40:29.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:28 smithi167 ceph-mon[34903]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 412 KiB/s wr, 134 op/s 2024-03-27T08:40:29.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:28 smithi173 ceph-mon[35397]: pgmap v595: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 441 KiB/s rd, 412 KiB/s wr, 134 op/s 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 -- 172.21.15.164:0/3047595446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950102420 msgr2=0x7fe950104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 --2- 172.21.15.164:0/3047595446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950102420 0x7fe950104810 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fe940009900 tx=0x7fe94002bc30 comp rx=0 tx=0).stop 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 -- 172.21.15.164:0/3047595446 shutdown_connections 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 --2- 172.21.15.164:0/3047595446 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950107680 0x7fe950109ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 --2- 172.21.15.164:0/3047595446 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 0x7fe950107140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 --2- 172.21.15.164:0/3047595446 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950102420 0x7fe950104810 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 -- 172.21.15.164:0/3047595446 >> 172.21.15.164:0/3047595446 conn(0x7fe9500fbe30 msgr2=0x7fe9500fe250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 -- 172.21.15.164:0/3047595446 shutdown_connections 2024-03-27T08:40:29.255 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.263+0000 7fe94f200640 1 -- 172.21.15.164:0/3047595446 wait complete. 2024-03-27T08:40:29.256 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.264+0000 7fe94f200640 1 Processor -- start 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.264+0000 7fe94f200640 1 -- start start 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 0x7fe95019a480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 0x7fe9501a14f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe95010d670 con 0x7fe950107680 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe95010d4f0 con 0x7fe950102420 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94f200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe95010d7f0 con 0x7fe950104d50 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:53692/0 (socket says 172.21.15.164:53692) 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94de00640 1 -- 172.21.15.164:0/2827100982 learned_addr learned my addr 172.21.15.164:0/2827100982 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94e800640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 0x7fe9501a14f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.257 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.265+0000 7fe94d400640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 0x7fe95019a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.258 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 -- 172.21.15.164:0/2827100982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 msgr2=0x7fe95019a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 0x7fe95019a480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 -- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 msgr2=0x7fe9501a14f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 0x7fe9501a14f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 -- 172.21.15.164:0/2827100982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9501a1b60 con 0x7fe950102420 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94e800640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 0x7fe9501a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe94de00640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe940000c00 tx=0x7fe940004e20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.266+0000 7fe946a00640 1 -- 172.21.15.164:0/2827100982 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940043020 con 0x7fe950102420 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.267+0000 7fe946a00640 1 -- 172.21.15.164:0/2827100982 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe940005460 con 0x7fe950102420 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.267+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9501a1df0 con 0x7fe950102420 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.267+0000 7fe946a00640 1 -- 172.21.15.164:0/2827100982 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940003d00 con 0x7fe950102420 2024-03-27T08:40:29.259 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.267+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9501a2250 con 0x7fe950102420 2024-03-27T08:40:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 Processor -- start 2024-03-27T08:40:29.262 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 -- start start 2024-03-27T08:40:29.263 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7a1f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7a7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56121b706d10 con 0x56121b7a76c0 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56121b6af260 con 0x56121b7a2550 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.271+0000 7fe957b6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56121b702cc0 con 0x56121b7a1b60 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe946a00640 1 -- 172.21.15.164:0/2827100982 <== mon.2 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fe940046020 con 0x7fe950102420 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94e800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7a1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44932/0 (socket says 172.21.15.164:44932) 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 -- 172.21.15.164:0/1680009822 learned_addr learned my addr 172.21.15.164:0/1680009822 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94de00640 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7a7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 -- 172.21.15.164:0/1680009822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 msgr2=0x56121b7a1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.264 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7a1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 -- 172.21.15.164:0/1680009822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 msgr2=0x56121b7a7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7a7050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.265 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.272+0000 7fe94d400640 1 -- 172.21.15.164:0/1680009822 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121b6a6aa0 con 0x56121b7a76c0 2024-03-27T08:40:29.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.273+0000 7fe94d400640 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe938009c60 tx=0x7fe938011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a820e847f062b676 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.266 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.273+0000 7fe93f400640 1 -- 172.21.15.164:0/1680009822 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938004230 con 0x56121b7a76c0 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.273+0000 7fe93f400640 1 -- 172.21.15.164:0/1680009822 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe9380043d0 con 0x56121b7a76c0 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.273+0000 7fe93f400640 1 -- 172.21.15.164:0/1680009822 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe938019800 con 0x56121b7a76c0 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.274+0000 7fe946a00640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 0x7fe9340a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.274+0000 7fe946a00640 1 -- 172.21.15.164:0/2827100982 <== mon.2 v2:172.21.15.167:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe9400f1f60 con 0x7fe950102420 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.274+0000 7fe94e800640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 0x7fe9340a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.274+0000 7fe957b6f740 1 -- 172.21.15.164:0/1680009822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 msgr2=0x56121b7a9b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.274+0000 7fe957b6f740 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fe938009c60 tx=0x7fe938011810 comp rx=0 tx=0).stop 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 -- 172.21.15.164:0/1680009822 shutdown_connections 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a9b50 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7a7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 --2- 172.21.15.164:0/1680009822 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7a1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 -- 172.21.15.164:0/1680009822 >> 172.21.15.164:0/1680009822 conn(0x56121b79d0d0 msgr2=0x56121b79d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 -- 172.21.15.164:0/1680009822 shutdown_connections 2024-03-27T08:40:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe94e800640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 0x7fe9340a5ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56121b7a2db0 tx=0x7fe948009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 -- 172.21.15.164:0/1680009822 wait complete. 2024-03-27T08:40:29.268 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.275+0000 7fe957b6f740 1 -- start start 2024-03-27T08:40:29.270 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 Processor -- start 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7abec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7b33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x56121b7aa670 con 0x56121b7a76c0 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56121b6c2630 con 0x56121b7a2550 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x56121b7aa7f0 con 0x56121b7a1b60 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe957b6f740 10 client.0 _ll_register_callbacks cb 0x56121b6c7c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe94d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe94e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7b33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe94d400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:53710/0 (socket says 172.21.15.164:53710) 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.276+0000 7fe94d400640 1 -- 172.21.15.164:0/664642956 learned_addr learned my addr 172.21.15.164:0/664642956 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94de00640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7abec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 -- 172.21.15.164:0/664642956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 msgr2=0x56121b7abec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7abec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 -- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 msgr2=0x56121b7ac400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 -- 172.21.15.164:0/664642956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121b6ce5f0 con 0x56121b7a76c0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94d400640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94de00640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe94e800640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7b33d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe948005fd0 tx=0x7fe948004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12a3920d17053387 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.277+0000 7fe933e00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe94802b060 con 0x56121b7a76c0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe94801c670 con 0x56121b7a76c0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe9380043d0 con 0x56121b7a76c0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe94801c870 con 0x56121b7a76c0 2024-03-27T08:40:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe957b6f740 10 client.16365 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.278+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56121b41b210 con 0x56121b7a76c0 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe9380043d0 con 0x56121b7a76c0 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fe94801a040 con 0x56121b7a76c0 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 10 client.16365 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 10 client.16365 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 20 client.16365 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b7b7e40 0x56121b7ba2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 4 client.16365 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56121b714250 con 0x56121b7b7e40 2024-03-27T08:40:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.279+0000 7fe94de00640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b7b7e40 0x56121b7ba2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.280+0000 7fe94de00640 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b7b7e40 0x56121b7ba2a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=512520e0f48ffddf server_cookie=6d94ca7ed0a33e5c in_seq=0 out_seq=0 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.280+0000 7fe933e00640 10 client.16365 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.281+0000 7fe933e00640 1 -- 172.21.15.164:0/664642956 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x56121b714250 con 0x56121b7b7e40 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.281+0000 7fe933e00640 10 client.16365 handle_command_reply: tid=0 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.281+0000 7fe957b6f740 1 client.16365 shutdown 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.281+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 msgr2=0x56121b7b33d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.281+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7b33d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fe948005fd0 tx=0x7fe948004a40 comp rx=0 tx=0).stop 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 shutdown_connections 2024-03-27T08:40:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b7b7e40 0x56121b7ba2a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7b33d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7ac400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 --2- 172.21.15.164:0/664642956 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b7abec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 >> 172.21.15.164:0/664642956 conn(0x56121b79d0d0 msgr2=0x56121b79c310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe933e00640 0 client.16365 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 shutdown_connections 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 1 -- 172.21.15.164:0/664642956 wait complete. 2024-03-27T08:40:29.276 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.282+0000 7fe957b6f740 20 client.16365 trim_cache size 0 max 16384 2024-03-27T08:40:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.300+0000 7fe957b6f740 1 Processor -- start 2024-03-27T08:40:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.300+0000 7fe957b6f740 1 -- start start 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.300+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b79d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.300+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7b3390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.300+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe957b6f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501ad980 con 0x56121b7a76c0 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe957b6f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501ab190 con 0x56121b7a2550 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe957b6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501a8fe0 con 0x56121b7a1b60 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44956/0 (socket says 172.21.15.164:44956) 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 -- 172.21.15.164:0/2865956056 learned_addr learned my addr 172.21.15.164:0/2865956056 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94d400640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94de00640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b79d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 -- 172.21.15.164:0/2865956056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 msgr2=0x56121b79d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b79d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 -- 172.21.15.164:0/2865956056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 msgr2=0x56121b7b3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7b3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94e800640 1 -- 172.21.15.164:0/2865956056 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56121b4e7620 con 0x56121b7a76c0 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.301+0000 7fe94de00640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b79d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.302+0000 7fe94e800640 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe948026ce0 tx=0x7fe948011730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba28231859927ab9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.302+0000 7fe93ea00640 1 -- 172.21.15.164:0/2865956056 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948036070 con 0x56121b7a76c0 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.302+0000 7fe93ea00640 1 -- 172.21.15.164:0/2865956056 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe948004cb0 con 0x56121b7a76c0 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.302+0000 7fe93ea00640 1 -- 172.21.15.164:0/2865956056 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe948005040 con 0x56121b7a76c0 2024-03-27T08:40:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- 172.21.15.164:0/2865956056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 msgr2=0x56121b7a0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fe948026ce0 tx=0x7fe948011730 comp rx=0 tx=0).stop 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- 172.21.15.164:0/2865956056 shutdown_connections 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a76c0 0x56121b7a0330 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a2550 0x56121b7b3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 --2- 172.21.15.164:0/2865956056 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a1b60 0x56121b79d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- 172.21.15.164:0/2865956056 >> 172.21.15.164:0/2865956056 conn(0x56121b79d0d0 msgr2=0x56121b7a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- 172.21.15.164:0/2865956056 shutdown_connections 2024-03-27T08:40:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- 172.21.15.164:0/2865956056 wait complete. 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.303+0000 7fe957b6f740 1 -- start start 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 Processor -- start 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a76c0 0x56121b7b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501a9650 con 0x56121b7a2550 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501aaac0 con 0x56121b7a1b60 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fe9501a9d20 con 0x56121b7a76c0 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe957b6f740 10 client.0 _ll_register_callbacks cb 0x7fe948011520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe94d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.304+0000 7fe94de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:53736/0 (socket says 172.21.15.164:53736) 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 -- 172.21.15.164:0/3820433860 learned_addr learned my addr 172.21.15.164:0/3820433860 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94d400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:44966/0 (socket says 172.21.15.164:44966) 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94e800640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a76c0 0x56121b7b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 -- 172.21.15.164:0/3820433860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a76c0 msgr2=0x56121b7b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a76c0 0x56121b7b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 -- 172.21.15.164:0/3820433860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 msgr2=0x56121b7b0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 -- 172.21.15.164:0/3820433860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56121b7b2090 con 0x56121b7a1b60 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94d400640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe94de00640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe940005ab0 tx=0x7fe940005710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e1976f7db3dfe46 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.305+0000 7fe933e00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:40:29.305 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe940004c70 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe948004cb0 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fe9400efb20 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fe9400044d0 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe957b6f740 10 client.36044 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.306+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x56121b7b3380 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe948004cb0 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fe9400baa50 con 0x56121b7a1b60 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 10 client.36044 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:29.306 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 10 client.36044 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 20 client.36044 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b81e550 0x56121b820970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 4 client.36044 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:40:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56121b70e5a0 con 0x56121b81e550 2024-03-27T08:40:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.307+0000 7fe94d400640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b81e550 0x56121b820970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.308+0000 7fe94d400640 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b81e550 0x56121b820970 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c9a61ae949cc61ae server_cookie=408e0058533a6a40 in_seq=0 out_seq=0 2024-03-27T08:40:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.308+0000 7fe933e00640 10 client.36044 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.381+0000 7fe933e00640 1 -- 172.21.15.164:0/3820433860 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56121b70e5a0 con 0x56121b81e550 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.381+0000 7fe933e00640 10 client.36044 handle_command_reply: tid=0 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.381+0000 7fe957b6f740 1 client.36044 shutdown 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.381+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 msgr2=0x56121b7b05c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.381+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe940005ab0 tx=0x7fe940005710 comp rx=0 tx=0).stop 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 shutdown_connections 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x56121b81e550 0x56121b820970 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x56121b7a76c0 0x56121b7b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe933e00640 0 client.36044 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x56121b7a2550 0x56121b7b0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 --2- 172.21.15.164:0/3820433860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56121b7a1b60 0x56121b7b05c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 >> 172.21.15.164:0/3820433860 conn(0x56121b79d0d0 msgr2=0x56121b7a0330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 shutdown_connections 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 1 -- 172.21.15.164:0/3820433860 wait complete. 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.382+0000 7fe957b6f740 20 client.36044 trim_cache size 0 max 16384 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:40:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:40:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 msgr2=0x7fe9340a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 0x7fe9340a5ac0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x56121b7a2db0 tx=0x7fe948009600 comp rx=0 tx=0).stop 2024-03-27T08:40:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 msgr2=0x7fe950199f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe940000c00 tx=0x7fe940004e20 comp rx=0 tx=0).stop 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 shutdown_connections 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fe9340a3600 0x7fe9340a5ac0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fe950107680 0x7fe9501a14f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fe950104d50 0x7fe95019a480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 --2- 172.21.15.164:0/2827100982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe950102420 0x7fe950199f40 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 >> 172.21.15.164:0/2827100982 conn(0x7fe9500fbe30 msgr2=0x7fe950101c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:29.377 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 shutdown_connections 2024-03-27T08:40:29.378 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:29.383+0000 7fe94f200640 1 -- 172.21.15.164:0/2827100982 wait complete. 2024-03-27T08:40:30.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:29 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:40:30.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:29 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:40:30.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:29 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:40:30.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:30 smithi173 ceph-mon[35397]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 353 KiB/s wr, 127 op/s 2024-03-27T08:40:30.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:40:30.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:40:30.976 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:30 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:40:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:30 smithi164 ceph-mon[31788]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 353 KiB/s wr, 127 op/s 2024-03-27T08:40:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:40:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:40:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:30 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:40:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:30 smithi167 ceph-mon[34903]: pgmap v596: 97 pgs: 97 active+clean; 153 MiB data, 867 MiB used, 1.0 TiB / 1.0 TiB avail; 366 KiB/s rd, 353 KiB/s wr, 127 op/s 2024-03-27T08:40:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:40:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:40:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:30 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:40:32.396 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar xf doc.tar 2024-03-27T08:40:33.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:32 smithi164 ceph-mon[31788]: pgmap v597: 97 pgs: 97 active+clean; 152 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 430 KiB/s wr, 124 op/s 2024-03-27T08:40:33.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:32 smithi167 ceph-mon[34903]: pgmap v597: 97 pgs: 97 active+clean; 152 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 430 KiB/s wr, 124 op/s 2024-03-27T08:40:33.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:32 smithi173 ceph-mon[35397]: pgmap v597: 97 pgs: 97 active+clean; 152 MiB data, 865 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 430 KiB/s wr, 124 op/s 2024-03-27T08:40:35.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:34 smithi164 ceph-mon[31788]: pgmap v598: 97 pgs: 97 active+clean; 150 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 345 KiB/s wr, 127 op/s 2024-03-27T08:40:35.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:34 smithi167 ceph-mon[34903]: pgmap v598: 97 pgs: 97 active+clean; 150 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 345 KiB/s wr, 127 op/s 2024-03-27T08:40:35.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:34 smithi173 ceph-mon[35397]: pgmap v598: 97 pgs: 97 active+clean; 150 MiB data, 869 MiB used, 1.0 TiB / 1.0 TiB avail; 327 KiB/s rd, 345 KiB/s wr, 127 op/s 2024-03-27T08:40:37.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:36 smithi164 ceph-mon[31788]: pgmap v599: 97 pgs: 97 active+clean; 150 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 536 KiB/s wr, 156 op/s 2024-03-27T08:40:37.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:36 smithi167 ceph-mon[34903]: pgmap v599: 97 pgs: 97 active+clean; 150 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 536 KiB/s wr, 156 op/s 2024-03-27T08:40:37.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:36 smithi173 ceph-mon[35397]: pgmap v599: 97 pgs: 97 active+clean; 150 MiB data, 880 MiB used, 1.0 TiB / 1.0 TiB avail; 481 KiB/s rd, 536 KiB/s wr, 156 op/s 2024-03-27T08:40:38.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:37 smithi164 ceph-mon[31788]: pgmap v600: 97 pgs: 97 active+clean; 150 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 433 KiB/s wr, 138 op/s 2024-03-27T08:40:38.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:37 smithi167 ceph-mon[34903]: pgmap v600: 97 pgs: 97 active+clean; 150 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 433 KiB/s wr, 138 op/s 2024-03-27T08:40:38.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:37 smithi173 ceph-mon[35397]: pgmap v600: 97 pgs: 97 active+clean; 150 MiB data, 883 MiB used, 1.0 TiB / 1.0 TiB avail; 353 KiB/s rd, 433 KiB/s wr, 138 op/s 2024-03-27T08:40:40.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:40 smithi173 ceph-mon[35397]: pgmap v601: 97 pgs: 97 active+clean; 151 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 531 KiB/s wr, 154 op/s 2024-03-27T08:40:41.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:40 smithi164 ceph-mon[31788]: pgmap v601: 97 pgs: 97 active+clean; 151 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 531 KiB/s wr, 154 op/s 2024-03-27T08:40:41.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:40 smithi167 ceph-mon[34903]: pgmap v601: 97 pgs: 97 active+clean; 151 MiB data, 873 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 531 KiB/s wr, 154 op/s 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 -- 172.21.15.164:0/337743743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 msgr2=0x7fc7ac109fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 --2- 172.21.15.164:0/337743743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac109fc0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009ca0 tx=0x7fc7a402c100 comp rx=0 tx=0).stop 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 -- 172.21.15.164:0/337743743 shutdown_connections 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 --2- 172.21.15.164:0/337743743 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac109fc0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 --2- 172.21.15.164:0/337743743 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac102d70 0x7fc7ac1031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 --2- 172.21.15.164:0/337743743 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac101b80 0x7fc7ac101fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.536+0000 7fc7b1000640 1 -- 172.21.15.164:0/337743743 >> 172.21.15.164:0/337743743 conn(0x7fc7ac0fd110 msgr2=0x7fc7ac0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.537+0000 7fc7b1000640 1 -- 172.21.15.164:0/337743743 shutdown_connections 2024-03-27T08:40:42.529 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.537+0000 7fc7b1000640 1 -- 172.21.15.164:0/337743743 wait complete. 2024-03-27T08:40:42.531 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 Processor -- start 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 -- start start 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac101b80 0x7fc7ac199f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac102d70 0x7fc7ac19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d7e0 con 0x7fc7ac103730 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d660 con 0x7fc7ac102d70 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7b1000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac10d960 con 0x7fc7ac101b80 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac102d70 0x7fc7ac19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7aa800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48300/0 (socket says 172.21.15.164:48300) 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.538+0000 7fc7aa800640 1 -- 172.21.15.164:0/4136058467 learned_addr learned my addr 172.21.15.164:0/4136058467 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:42.532 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac101b80 0x7fc7ac199f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 -- 172.21.15.164:0/4136058467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac101b80 msgr2=0x7fc7ac199f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac101b80 0x7fc7ac199f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 -- 172.21.15.164:0/4136058467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac102d70 msgr2=0x7fc7ac19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac102d70 0x7fc7ac19a470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 -- 172.21.15.164:0/4136058467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac1a1b50 con 0x7fc7ac103730 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.539+0000 7fc7aa800640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009bf0 tx=0x7fc7a4034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.540+0000 7fc7a2a00640 1 -- 172.21.15.164:0/4136058467 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a4039050 con 0x7fc7ac103730 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.540+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac1a1de0 con 0x7fc7ac103730 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.540+0000 7fc7a2a00640 1 -- 172.21.15.164:0/4136058467 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc7a403a040 con 0x7fc7ac103730 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.540+0000 7fc7a2a00640 1 -- 172.21.15.164:0/4136058467 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40046a0 con 0x7fc7ac103730 2024-03-27T08:40:42.533 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.540+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac1a2250 con 0x7fc7ac103730 2024-03-27T08:40:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7a2a00640 1 -- 172.21.15.164:0/4136058467 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc7a4003970 con 0x7fc7ac103730 2024-03-27T08:40:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 Processor -- start 2024-03-27T08:40:42.535 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 -- start start 2024-03-27T08:40:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d682f980 0x55f9d682fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.537 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6837970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6794d10 con 0x55f9d682f980 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f9d673d260 con 0x55f9d6830370 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.544+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6790cc0 con 0x55f9d68354e0 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36756/0 (socket says 172.21.15.164:36756) 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 -- 172.21.15.164:0/1360498110 learned_addr learned my addr 172.21.15.164:0/1360498110 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9400640 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d682f980 0x55f9d682fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 -- 172.21.15.164:0/1360498110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 msgr2=0x55f9d6837970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6837970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 -- 172.21.15.164:0/1360498110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d682f980 msgr2=0x55f9d682fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d682f980 0x55f9d682fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a9e00640 1 -- 172.21.15.164:0/1360498110 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6734aa0 con 0x55f9d6830370 2024-03-27T08:40:42.538 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.545+0000 7fc7a2a00640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 0x7fc7900a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc7a2a00640 1 -- 172.21.15.164:0/4136058467 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc7a40f2650 con 0x7fc7ac103730 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009c20 tx=0x7fc79c0117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1f50f7637c28d6d server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc7a9400640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 0x7fc7900a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc797400640 1 -- 172.21.15.164:0/1360498110 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c012450 con 0x55f9d6830370 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc797400640 1 -- 172.21.15.164:0/1360498110 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc79c012ac0 con 0x55f9d6830370 2024-03-27T08:40:42.539 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.546+0000 7fc797400640 1 -- 172.21.15.164:0/1360498110 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c00fae0 con 0x55f9d6830370 2024-03-27T08:40:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1360498110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 msgr2=0x55f9d6834e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7a9400640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 0x7fc7900a5b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55f9d6830bd0 tx=0x7fc7980041d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009c20 tx=0x7fc79c0117b0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.545 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1360498110 shutdown_connections 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6837970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d6830370 0x55f9d6834e70 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1360498110 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d682f980 0x55f9d682fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1360498110 >> 172.21.15.164:0/1360498110 conn(0x55f9d682aef0 msgr2=0x55f9d682b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1360498110 shutdown_connections 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.547+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1360498110 wait complete. 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.548+0000 7fc7b3de7740 1 -- start start 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.548+0000 7fc7b3de7740 1 Processor -- start 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.548+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d6839c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.546 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6838490 con 0x55f9d6830370 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6750630 con 0x55f9d68354e0 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55f9d6838610 con 0x55f9d682f980 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7b3de7740 10 client.0 _ll_register_callbacks cb 0x55f9d6755c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36758/0 (socket says 172.21.15.164:36758) 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 -- 172.21.15.164:0/421401870 learned_addr learned my addr 172.21.15.164:0/421401870 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d6839c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 -- 172.21.15.164:0/421401870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 msgr2=0x55f9d6839c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d6839c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 -- 172.21.15.164:0/421401870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 msgr2=0x55f9d683a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.547 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.549+0000 7fc7aa800640 1 -- 172.21.15.164:0/421401870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d675c5f0 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc7aa800640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40c7210 tx=0x7fc7a40be6d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a957f2b0f4b1688 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc78be00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7a40bf1d0 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc7a4003c60 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79c012ac0 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc7a4003e60 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc7b3de7740 10 client.36056 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.550+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f9d64a9210 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc79c012ac0 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fc7a4004b40 con 0x55f9d68354e0 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 10 client.36056 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 10 client.36056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:42.548 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 20 client.36056 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d6845b40 0x55f9d6847fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 4 client.36056 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f9d67a2250 con 0x55f9d6845b40 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.551+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d6845b40 0x55f9d6847fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.552+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d6845b40 0x55f9d6847fa0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9b64910f6179d99 server_cookie=91b7e6b9ba3c40c8 in_seq=0 out_seq=0 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.552+0000 7fc78be00640 10 client.36056 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.553+0000 7fc78be00640 1 -- 172.21.15.164:0/421401870 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55f9d67a2250 con 0x55f9d6845b40 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.553+0000 7fc78be00640 10 client.36056 handle_command_reply: tid=0 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.553+0000 7fc7b3de7740 1 client.36056 shutdown 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 msgr2=0x55f9d6841210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc7a40c7210 tx=0x7fc7a40be6d0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 shutdown_connections 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d6845b40 0x55f9d6847fa0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.549 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d6841210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/421401870 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d6839c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc78be00640 0 client.36056 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 >> 172.21.15.164:0/421401870 conn(0x55f9d682aef0 msgr2=0x55f9d682a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 shutdown_connections 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 1 -- 172.21.15.164:0/421401870 wait complete. 2024-03-27T08:40:42.550 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.554+0000 7fc7b3de7740 20 client.36056 trim_cache size 0 max 16384 2024-03-27T08:40:42.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.574+0000 7fc7b3de7740 1 Processor -- start 2024-03-27T08:40:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.574+0000 7fc7b3de7740 1 -- start start 2024-03-27T08:40:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6831bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.609 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1ada30 con 0x55f9d6830370 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1ab240 con 0x55f9d682f980 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1a9090 con 0x55f9d68354e0 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7a9e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7a9e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:36766/0 (socket says 172.21.15.164:36766) 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48324/0 (socket says 172.21.15.164:48324) 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7a9e00640 1 -- 172.21.15.164:0/4245388130 learned_addr learned my addr 172.21.15.164:0/4245388130 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.575+0000 7fc7aa800640 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6831bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 -- 172.21.15.164:0/4245388130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 msgr2=0x55f9d6831bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.610 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6831bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 -- 172.21.15.164:0/4245388130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 msgr2=0x55f9d68411d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 -- 172.21.15.164:0/4245388130 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9d6575620 con 0x55f9d682f980 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9400640 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009b70 tx=0x7fc79c009900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bcccc5915c6a59b server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc796a00640 1 -- 172.21.15.164:0/4245388130 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c014e70 con 0x55f9d682f980 2024-03-27T08:40:42.611 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc796a00640 1 -- 172.21.15.164:0/4245388130 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc79c005580 con 0x55f9d682f980 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.576+0000 7fc796a00640 1 -- 172.21.15.164:0/4245388130 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79c003db0 con 0x55f9d682f980 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 -- 172.21.15.164:0/4245388130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 msgr2=0x55f9d6831690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc79c009b70 tx=0x7fc79c009900 comp rx=0 tx=0).stop 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 -- 172.21.15.164:0/4245388130 shutdown_connections 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d68354e0 0x55f9d6831bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.614 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d68411d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/4245388130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d682f980 0x55f9d6831690 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 -- 172.21.15.164:0/4245388130 >> 172.21.15.164:0/4245388130 conn(0x55f9d682aef0 msgr2=0x55f9d682b2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 -- 172.21.15.164:0/4245388130 shutdown_connections 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.577+0000 7fc7b3de7740 1 -- 172.21.15.164:0/4245388130 wait complete. 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 -- start start 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 Processor -- start 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d683e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.615 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d683fab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1a9700 con 0x55f9d6830370 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.578+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1aab70 con 0x55f9d68354e0 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7b3de7740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac1a9dd0 con 0x55f9d682f980 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7b3de7740 10 client.0 _ll_register_callbacks cb 0x7fc7a4005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:48328/0 (socket says 172.21.15.164:48328) 2024-03-27T08:40:42.618 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 -- 172.21.15.164:0/1184800436 learned_addr learned my addr 172.21.15.164:0/1184800436 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7aa800640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d683fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d683e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 -- 172.21.15.164:0/1184800436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 msgr2=0x55f9d683e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d683e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 -- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 msgr2=0x55f9d683fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d683fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.579+0000 7fc7a9400640 1 -- 172.21.15.164:0/1184800436 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9d68400a0 con 0x55f9d6830370 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.580+0000 7fc7a9400640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc798004010 tx=0x7fc7980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4364ba02068266a server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:42.619 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.580+0000 7fc78be00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.580+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79802c060 con 0x55f9d6830370 2024-03-27T08:40:42.620 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.580+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc798010870 con 0x55f9d6830370 2024-03-27T08:40:42.621 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.580+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc79c005580 con 0x55f9d6830370 2024-03-27T08:40:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc798010a70 con 0x55f9d6830370 2024-03-27T08:40:42.622 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 10 client.16389 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55f9d68414b0 con 0x55f9d6830370 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc79c005580 con 0x55f9d6830370 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fc798019040 con 0x55f9d6830370 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 10 client.16389 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 10 client.16389 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 20 client.16389 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:42.623 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.584+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d68ac6d0 0x55f9d68aeaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:42.625 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.585+0000 7fc7b3de7740 4 client.16389 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:40:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.585+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9d679c5a0 con 0x55f9d68ac6d0 2024-03-27T08:40:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.585+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d68ac6d0 0x55f9d68aeaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.586+0000 7fc7a9e00640 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d68ac6d0 0x55f9d68aeaf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d364937792a5939 server_cookie=837b6f5e2bad9d95 in_seq=0 out_seq=0 2024-03-27T08:40:42.626 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:42.586+0000 7fc78be00640 10 client.16389 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:42.824 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:42 smithi173 ceph-mon[35397]: pgmap v602: 97 pgs: 97 active+clean; 151 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 440 KiB/s wr, 157 op/s 2024-03-27T08:40:42.901 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:42 smithi167 ceph-mon[34903]: pgmap v602: 97 pgs: 97 active+clean; 151 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 440 KiB/s wr, 157 op/s 2024-03-27T08:40:43.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:42 smithi164 ceph-mon[31788]: pgmap v602: 97 pgs: 97 active+clean; 151 MiB data, 881 MiB used, 1.0 TiB / 1.0 TiB avail; 309 KiB/s rd, 440 KiB/s wr, 157 op/s 2024-03-27T08:40:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.333+0000 7fc78be00640 1 -- 172.21.15.164:0/1184800436 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9d679c5a0 con 0x55f9d68ac6d0 2024-03-27T08:40:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.333+0000 7fc78be00640 10 client.16389 handle_command_reply: tid=0 2024-03-27T08:40:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.333+0000 7fc7b3de7740 1 client.16389 shutdown 2024-03-27T08:40:43.325 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 msgr2=0x55f9d683eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc798004010 tx=0x7fc7980046c0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 shutdown_connections 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55f9d68ac6d0 0x55f9d68aeaf0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f9d68354e0 0x55f9d683fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55f9d6830370 0x55f9d683eaa0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 --2- 172.21.15.164:0/1184800436 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55f9d682f980 0x55f9d683e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc78be00640 0 client.16389 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:43.326 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 >> 172.21.15.164:0/1184800436 conn(0x55f9d682aef0 msgr2=0x55f9d6834880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 shutdown_connections 2024-03-27T08:40:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.334+0000 7fc7b3de7740 1 -- 172.21.15.164:0/1184800436 wait complete. 2024-03-27T08:40:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.335+0000 7fc7b3de7740 20 client.16389 trim_cache size 0 max 16384 2024-03-27T08:40:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:40:43.327 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:40:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:40:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:40:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.335+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 msgr2=0x7fc7900a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.335+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 0x7fc7900a5b70 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x55f9d6830bd0 tx=0x7fc7980041d0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.328 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.335+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 msgr2=0x7fc7ac1a14e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.335+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fc7a4009bf0 tx=0x7fc7a4034cd0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 shutdown_connections 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7900a36b0 0x7fc7900a5b70 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc7ac103730 0x7fc7ac1a14e0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc7ac102d70 0x7fc7ac19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 --2- 172.21.15.164:0/4136058467 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc7ac101b80 0x7fc7ac199f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 >> 172.21.15.164:0/4136058467 conn(0x7fc7ac0fd110 msgr2=0x7fc7ac073d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 shutdown_connections 2024-03-27T08:40:43.329 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:43.336+0000 7fc7b1000640 1 -- 172.21.15.164:0/4136058467 wait complete. 2024-03-27T08:40:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:44 smithi164 ceph-mon[31788]: pgmap v603: 97 pgs: 97 active+clean; 153 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 549 KiB/s wr, 147 op/s 2024-03-27T08:40:45.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:44 smithi167 ceph-mon[34903]: pgmap v603: 97 pgs: 97 active+clean; 153 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 549 KiB/s wr, 147 op/s 2024-03-27T08:40:45.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:44 smithi173 ceph-mon[35397]: pgmap v603: 97 pgs: 97 active+clean; 153 MiB data, 889 MiB used, 1.0 TiB / 1.0 TiB avail; 384 KiB/s rd, 549 KiB/s wr, 147 op/s 2024-03-27T08:40:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:46 smithi164 ceph-mon[31788]: pgmap v604: 97 pgs: 97 active+clean; 150 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 628 KiB/s wr, 209 op/s 2024-03-27T08:40:47.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:46 smithi167 ceph-mon[34903]: pgmap v604: 97 pgs: 97 active+clean; 150 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 628 KiB/s wr, 209 op/s 2024-03-27T08:40:47.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:46 smithi173 ceph-mon[35397]: pgmap v604: 97 pgs: 97 active+clean; 150 MiB data, 894 MiB used, 1.0 TiB / 1.0 TiB avail; 392 KiB/s rd, 628 KiB/s wr, 209 op/s 2024-03-27T08:40:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:48 smithi164 ceph-mon[31788]: pgmap v605: 97 pgs: 97 active+clean; 150 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 468 KiB/s wr, 205 op/s 2024-03-27T08:40:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:48 smithi167 ceph-mon[34903]: pgmap v605: 97 pgs: 97 active+clean; 150 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 468 KiB/s wr, 205 op/s 2024-03-27T08:40:49.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:48 smithi173 ceph-mon[35397]: pgmap v605: 97 pgs: 97 active+clean; 150 MiB data, 902 MiB used, 1.0 TiB / 1.0 TiB avail; 247 KiB/s rd, 468 KiB/s wr, 205 op/s 2024-03-27T08:40:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:50 smithi164 ceph-mon[31788]: pgmap v606: 97 pgs: 97 active+clean; 152 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 640 KiB/s wr, 250 op/s 2024-03-27T08:40:51.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:50 smithi167 ceph-mon[34903]: pgmap v606: 97 pgs: 97 active+clean; 152 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 640 KiB/s wr, 250 op/s 2024-03-27T08:40:51.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:50 smithi173 ceph-mon[35397]: pgmap v606: 97 pgs: 97 active+clean; 152 MiB data, 895 MiB used, 1.0 TiB / 1.0 TiB avail; 402 KiB/s rd, 640 KiB/s wr, 250 op/s 2024-03-27T08:40:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:52 smithi164 ceph-mon[31788]: pgmap v607: 97 pgs: 97 active+clean; 152 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 572 KiB/s wr, 243 op/s 2024-03-27T08:40:53.007 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:52 smithi167 ceph-mon[34903]: pgmap v607: 97 pgs: 97 active+clean; 152 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 572 KiB/s wr, 243 op/s 2024-03-27T08:40:53.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:52 smithi173 ceph-mon[35397]: pgmap v607: 97 pgs: 97 active+clean; 152 MiB data, 900 MiB used, 1.0 TiB / 1.0 TiB avail; 326 KiB/s rd, 572 KiB/s wr, 243 op/s 2024-03-27T08:40:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:54 smithi164 ceph-mon[31788]: pgmap v608: 97 pgs: 97 active+clean; 155 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 811 KiB/s wr, 246 op/s 2024-03-27T08:40:55.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:54 smithi167 ceph-mon[34903]: pgmap v608: 97 pgs: 97 active+clean; 155 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 811 KiB/s wr, 246 op/s 2024-03-27T08:40:55.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:54 smithi173 ceph-mon[35397]: pgmap v608: 97 pgs: 97 active+clean; 155 MiB data, 905 MiB used, 1.0 TiB / 1.0 TiB avail; 504 KiB/s rd, 811 KiB/s wr, 246 op/s 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 -- 172.21.15.164:0/2343409767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 msgr2=0x7f2540108410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 --2- 172.21.15.164:0/2343409767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f2540108410 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f2530009900 tx=0x7f253002bc30 comp rx=0 tx=0).stop 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 -- 172.21.15.164:0/2343409767 shutdown_connections 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 --2- 172.21.15.164:0/2343409767 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f2540109ba0 0x7f2540110430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 --2- 172.21.15.164:0/2343409767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f25401091e0 0x7f2540109660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 --2- 172.21.15.164:0/2343409767 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f2540108410 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 -- 172.21.15.164:0/2343409767 >> 172.21.15.164:0/2343409767 conn(0x7f2540076f90 msgr2=0x7f25400793d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 -- 172.21.15.164:0/2343409767 shutdown_connections 2024-03-27T08:40:56.473 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.480+0000 7f2545800640 1 -- 172.21.15.164:0/2343409767 wait complete. 2024-03-27T08:40:56.475 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.481+0000 7f2545800640 1 Processor -- start 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.481+0000 7f2545800640 1 -- start start 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.481+0000 7f2545800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.481+0000 7f2545800640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25401091e0 0x7f254019e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f2545800640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2540109ba0 0x7f25401a58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f2545800640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f2540113c40 con 0x7f2540107ff0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f2545800640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2540113ac0 con 0x7f2540109ba0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f2545800640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f2540113dc0 con 0x7f25401091e0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58848/0 (socket says 172.21.15.164:58848) 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 -- 172.21.15.164:0/1779932259 learned_addr learned my addr 172.21.15.164:0/1779932259 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253f400640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2540109ba0 0x7f25401a58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253e000640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25401091e0 0x7f254019e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 -- 172.21.15.164:0/1779932259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25401091e0 msgr2=0x7f254019e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.476 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25401091e0 0x7f254019e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 -- 172.21.15.164:0/1779932259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2540109ba0 msgr2=0x7f25401a58d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2540109ba0 0x7f25401a58d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.482+0000 7f253ea00640 1 -- 172.21.15.164:0/1779932259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25401a5f40 con 0x7f2540107ff0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f253ea00640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f253002c880 tx=0x7f2530004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f2537400640 1 -- 172.21.15.164:0/1779932259 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530043020 con 0x7f2540107ff0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f2537400640 1 -- 172.21.15.164:0/1779932259 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f25300054f0 con 0x7f2540107ff0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25401a61d0 con 0x7f2540107ff0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f2537400640 1 -- 172.21.15.164:0/1779932259 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530003cd0 con 0x7f2540107ff0 2024-03-27T08:40:56.477 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.483+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25401a6720 con 0x7f2540107ff0 2024-03-27T08:40:56.479 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.487+0000 7f25485b4740 1 Processor -- start 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 -- start start 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f2537400640 1 -- 172.21.15.164:0/1779932259 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f2530046020 con 0x7f2540107ff0 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c541d10 con 0x55ba6c5dd550 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c4ea260 con 0x55ba6c5e26c0 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f25485b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c53dcc0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58854/0 (socket says 172.21.15.164:58854) 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f253ea00640 1 -- 172.21.15.164:0/3811162944 learned_addr learned my addr 172.21.15.164:0/3811162944 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.488+0000 7f253e000640 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.481 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253f400640 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 -- 172.21.15.164:0/3811162944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 msgr2=0x55ba6c5dcf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5dcf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 -- 172.21.15.164:0/3811162944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 msgr2=0x55ba6c5e4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e4b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 -- 172.21.15.164:0/3811162944 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6c4e1aa0 con 0x55ba6c5dd550 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f253ea00640 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f25300f7a30 tx=0x7f25300f7b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9cca1716bc68b15 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.487 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f2537400640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 0x7f25240a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.489+0000 7f252be00640 1 -- 172.21.15.164:0/3811162944 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2530100070 con 0x55ba6c5dd550 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f252be00640 1 -- 172.21.15.164:0/3811162944 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f25300be5a0 con 0x55ba6c5dd550 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f252be00640 1 -- 172.21.15.164:0/3811162944 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300e82e0 con 0x55ba6c5dd550 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f253f400640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 0x7f25240a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f2537400640 1 -- 172.21.15.164:0/1779932259 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f25300f19c0 con 0x7f2540107ff0 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f25485b4740 1 -- 172.21.15.164:0/3811162944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 msgr2=0x55ba6c5e2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f25485b4740 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f25300f7a30 tx=0x7f25300f7b20 comp rx=0 tx=0).stop 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.490+0000 7f253f400640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 0x7f25240a5ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55ba6c5dddb0 tx=0x7f2538009600 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 -- 172.21.15.164:0/3811162944 shutdown_connections 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e2050 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 --2- 172.21.15.164:0/3811162944 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5dcf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.488 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 -- 172.21.15.164:0/3811162944 >> 172.21.15.164:0/3811162944 conn(0x55ba6c5d80d0 msgr2=0x55ba6c5d84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 -- 172.21.15.164:0/3811162944 shutdown_connections 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 -- 172.21.15.164:0/3811162944 wait complete. 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 -- start start 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.491+0000 7f25485b4740 1 Processor -- start 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5edf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c541d10 con 0x55ba6c5dcb60 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c4fd630 con 0x55ba6c5dd550 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ba6c5e5430 con 0x55ba6c5e26c0 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f25485b4740 10 client.0 _ll_register_callbacks cb 0x55ba6c502c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58868/0 (socket says 172.21.15.164:58868) 2024-03-27T08:40:56.489 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f253ea00640 1 -- 172.21.15.164:0/1589936534 learned_addr learned my addr 172.21.15.164:0/1589936534 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f253e000640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.492+0000 7f253f400640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5edf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 -- 172.21.15.164:0/1589936534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5e26c0 msgr2=0x55ba6c5edf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5edf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 -- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 msgr2=0x55ba6c5e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 -- 172.21.15.164:0/1589936534 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba6c5095f0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f253ea00640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f25300ef520 tx=0x7f253002bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4cbe9431b517d02 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f2528c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300e8a30 con 0x55ba6c5dcb60 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f25300bbf40 con 0x55ba6c5dcb60 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25300be5a0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f2530100070 con 0x55ba6c5dcb60 2024-03-27T08:40:56.490 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f25485b4740 10 client.16401 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.493+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ba6c256210 con 0x55ba6c5dcb60 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f25300be5a0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f25300e9bf0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 10 client.16401 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 10 client.16401 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 20 client.16401 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c5f2750 0x55ba6c5f4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 4 client.16401 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.494+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba6c54f250 con 0x55ba6c5f2750 2024-03-27T08:40:56.491 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.495+0000 7f253e000640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c5f2750 0x55ba6c5f4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.495+0000 7f253e000640 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c5f2750 0x55ba6c5f4b80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca25b85cbc420014 server_cookie=3482ab340b61d231 in_seq=0 out_seq=0 2024-03-27T08:40:56.492 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.495+0000 7f2528c00640 10 client.16401 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.497+0000 7f2528c00640 1 -- 172.21.15.164:0/1589936534 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ba6c54f250 con 0x55ba6c5f2750 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.497+0000 7f2528c00640 10 client.16401 handle_command_reply: tid=0 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.497+0000 7f25485b4740 1 client.16401 shutdown 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 msgr2=0x55ba6c5e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f25300ef520 tx=0x7f253002bc30 comp rx=0 tx=0).stop 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 shutdown_connections 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c5f2750 0x55ba6c5f4b80 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5edf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 --2- 172.21.15.164:0/1589936534 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5e69a0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f2528c00640 0 client.16401 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 >> 172.21.15.164:0/1589936534 conn(0x55ba6c5d80d0 msgr2=0x55ba6c5d7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 shutdown_connections 2024-03-27T08:40:56.493 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 1 -- 172.21.15.164:0/1589936534 wait complete. 2024-03-27T08:40:56.494 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.498+0000 7f25485b4740 20 client.16401 trim_cache size 0 max 16384 2024-03-27T08:40:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.518+0000 7f25485b4740 1 Processor -- start 2024-03-27T08:40:56.511 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.518+0000 7f25485b4740 1 -- start start 2024-03-27T08:40:56.512 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5fa490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5edeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f25401b1e60 con 0x55ba6c5e26c0 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25401af670 con 0x55ba6c5dd550 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f25485b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25401ad4c0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f253f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f253f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58884/0 (socket says 172.21.15.164:58884) 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f253f400640 1 -- 172.21.15.164:0/1045118405 learned_addr learned my addr 172.21.15.164:0/1045118405 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f253e000640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5edeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.519+0000 7f253ea00640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5fa490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 -- 172.21.15.164:0/1045118405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 msgr2=0x55ba6c5fa490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5fa490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 -- 172.21.15.164:0/1045118405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 msgr2=0x55ba6c5edeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.513 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5edeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 -- 172.21.15.164:0/1045118405 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6c322620 con 0x55ba6c5e26c0 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253ea00640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f253f400640 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f253801f5f0 tx=0x7f2538015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea371420e33c76ec server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f252b400640 1 -- 172.21.15.164:0/1045118405 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253801f220 con 0x55ba6c5e26c0 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f252b400640 1 -- 172.21.15.164:0/1045118405 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2538005020 con 0x55ba6c5e26c0 2024-03-27T08:40:56.514 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.520+0000 7f252b400640 1 -- 172.21.15.164:0/1045118405 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f253801e650 con 0x55ba6c5e26c0 2024-03-27T08:40:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 -- 172.21.15.164:0/1045118405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 msgr2=0x55ba6c5e65b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:56.517 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f253801f5f0 tx=0x7f2538015000 comp rx=0 tx=0).stop 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 -- 172.21.15.164:0/1045118405 shutdown_connections 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5e65b0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5dd550 0x55ba6c5edeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 --2- 172.21.15.164:0/1045118405 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5fa490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 -- 172.21.15.164:0/1045118405 >> 172.21.15.164:0/1045118405 conn(0x55ba6c5d80d0 msgr2=0x55ba6c5d84b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 -- 172.21.15.164:0/1045118405 shutdown_connections 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.521+0000 7f25485b4740 1 -- 172.21.15.164:0/1045118405 wait complete. 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 -- start start 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 Processor -- start 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dd550 0x55ba6c5ebf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5ecfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.518 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f25401adb30 con 0x55ba6c5dcb60 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f25401aefa0 con 0x55ba6c5e26c0 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f25401ae200 con 0x55ba6c5dd550 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f25485b4740 10 client.0 _ll_register_callbacks cb 0x7f252c0095b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.522+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:58886/0 (socket says 172.21.15.164:58886) 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 -- 172.21.15.164:0/1306426612 learned_addr learned my addr 172.21.15.164:0/1306426612 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253f400640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5ecfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253e000640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dd550 0x55ba6c5ebf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 -- 172.21.15.164:0/1306426612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dd550 msgr2=0x55ba6c5ebf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dd550 0x55ba6c5ebf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 -- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 msgr2=0x55ba6c5ecfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5ecfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 -- 172.21.15.164:0/1306426612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba6c5ed590 con 0x55ba6c5dcb60 2024-03-27T08:40:56.519 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f253ea00640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f25300ba1e0 tx=0x7f25300092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec477144dbd4e02 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f2528c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.523+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25300e8c20 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f25300bc1a0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2538005020 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f25300eb020 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 10 client.16407 fetch_fsmap learned FSMap version 31 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ba6c5ed590 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2538005020 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f25300de0b0 con 0x55ba6c5dcb60 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 10 client.16407 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 10 client.16407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 20 client.16407 populate_metadata read hostname 'smithi164' 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c6594c0 0x55ba6c65b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:40:56.520 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 4 client.16407 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:40:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.524+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ba6c5495a0 con 0x55ba6c6594c0 2024-03-27T08:40:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.525+0000 7f253e000640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c6594c0 0x55ba6c65b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:40:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.525+0000 7f253e000640 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c6594c0 0x55ba6c65b8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de5aed5c4dc266cf server_cookie=87dca427adca00d2 in_seq=0 out_seq=0 2024-03-27T08:40:56.521 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:56.525+0000 7f2528c00640 10 client.16407 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:57.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:56 smithi164 ceph-mon[31788]: pgmap v609: 97 pgs: 97 active+clean; 157 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 760 KiB/s wr, 250 op/s 2024-03-27T08:40:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:56 smithi167 ceph-mon[34903]: pgmap v609: 97 pgs: 97 active+clean; 157 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 760 KiB/s wr, 250 op/s 2024-03-27T08:40:57.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:56 smithi173 ceph-mon[35397]: pgmap v609: 97 pgs: 97 active+clean; 157 MiB data, 913 MiB used, 1.0 TiB / 1.0 TiB avail; 373 KiB/s rd, 760 KiB/s wr, 250 op/s 2024-03-27T08:40:57.404 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.411+0000 7f2528c00640 1 -- 172.21.15.164:0/1306426612 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ba6c5495a0 con 0x55ba6c6594c0 2024-03-27T08:40:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.412+0000 7f2528c00640 10 client.16407 handle_command_reply: tid=0 2024-03-27T08:40:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.412+0000 7f25485b4740 1 client.16407 shutdown 2024-03-27T08:40:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.412+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 msgr2=0x55ba6c5eba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:57.405 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.412+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f25300ba1e0 tx=0x7f25300092d0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.406 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 shutdown_connections 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ba6c6594c0 0x55ba6c65b8e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba6c5e26c0 0x55ba6c5ecfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ba6c5dd550 0x55ba6c5ebf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 --2- 172.21.15.164:0/1306426612 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ba6c5dcb60 0x55ba6c5eba50 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 >> 172.21.15.164:0/1306426612 conn(0x55ba6c5d80d0 msgr2=0x55ba6c5e1980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f2528c00640 0 client.16407 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 shutdown_connections 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 1 -- 172.21.15.164:0/1306426612 wait complete. 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f25485b4740 20 client.16407 trim_cache size 0 max 16384 2024-03-27T08:40:57.407 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:40:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:40:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:40:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:40:57.408 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 msgr2=0x7f25240a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 0x7f25240a5ac0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x55ba6c5dddb0 tx=0x7f2538009600 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 msgr2=0x7f254019e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.414+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f253002c880 tx=0x7f2530004e20 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 shutdown_connections 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f25240a3600 0x7f25240a5ac0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2540109ba0 0x7f25401a58d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f25401091e0 0x7f254019e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 --2- 172.21.15.164:0/1779932259 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f2540107ff0 0x7f254019e320 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 >> 172.21.15.164:0/1779932259 conn(0x7f2540076f90 msgr2=0x7f254010c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 shutdown_connections 2024-03-27T08:40:57.409 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:40:57.415+0000 7f2545800640 1 -- 172.21.15.164:0/1779932259 wait complete. 2024-03-27T08:40:59.003 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:40:58 smithi164 ceph-mon[31788]: pgmap v610: 97 pgs: 97 active+clean; 158 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 781 KiB/s wr, 171 op/s 2024-03-27T08:40:59.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:40:58 smithi167 ceph-mon[34903]: pgmap v610: 97 pgs: 97 active+clean; 158 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 781 KiB/s wr, 171 op/s 2024-03-27T08:40:59.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:40:58 smithi173 ceph-mon[35397]: pgmap v610: 97 pgs: 97 active+clean; 158 MiB data, 920 MiB used, 1.0 TiB / 1.0 TiB avail; 398 KiB/s rd, 781 KiB/s wr, 171 op/s 2024-03-27T08:41:01.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:00 smithi164 ceph-mon[31788]: pgmap v611: 97 pgs: 97 active+clean; 157 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.0 MiB/s wr, 242 op/s 2024-03-27T08:41:01.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:00 smithi167 ceph-mon[34903]: pgmap v611: 97 pgs: 97 active+clean; 157 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.0 MiB/s wr, 242 op/s 2024-03-27T08:41:01.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:00 smithi173 ceph-mon[35397]: pgmap v611: 97 pgs: 97 active+clean; 157 MiB data, 928 MiB used, 1.0 TiB / 1.0 TiB avail; 539 KiB/s rd, 1.0 MiB/s wr, 242 op/s 2024-03-27T08:41:03.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:02 smithi164 ceph-mon[31788]: pgmap v612: 97 pgs: 97 active+clean; 160 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 277 op/s 2024-03-27T08:41:03.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:02 smithi167 ceph-mon[34903]: pgmap v612: 97 pgs: 97 active+clean; 160 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 277 op/s 2024-03-27T08:41:03.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:02 smithi173 ceph-mon[35397]: pgmap v612: 97 pgs: 97 active+clean; 160 MiB data, 938 MiB used, 1.0 TiB / 1.0 TiB avail; 440 KiB/s rd, 1.1 MiB/s wr, 277 op/s 2024-03-27T08:41:05.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:04 smithi164 ceph-mon[31788]: pgmap v613: 97 pgs: 97 active+clean; 162 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 298 op/s 2024-03-27T08:41:05.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:04 smithi167 ceph-mon[34903]: pgmap v613: 97 pgs: 97 active+clean; 162 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 298 op/s 2024-03-27T08:41:05.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:04 smithi173 ceph-mon[35397]: pgmap v613: 97 pgs: 97 active+clean; 162 MiB data, 943 MiB used, 1.0 TiB / 1.0 TiB avail; 439 KiB/s rd, 1.3 MiB/s wr, 298 op/s 2024-03-27T08:41:07.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:06 smithi164 ceph-mon[31788]: pgmap v614: 97 pgs: 97 active+clean; 165 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 296 op/s 2024-03-27T08:41:07.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:06 smithi167 ceph-mon[34903]: pgmap v614: 97 pgs: 97 active+clean; 165 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 296 op/s 2024-03-27T08:41:07.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:06 smithi173 ceph-mon[35397]: pgmap v614: 97 pgs: 97 active+clean; 165 MiB data, 936 MiB used, 1.0 TiB / 1.0 TiB avail; 362 KiB/s rd, 1.2 MiB/s wr, 296 op/s 2024-03-27T08:41:09.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:08 smithi164 ceph-mon[31788]: pgmap v615: 97 pgs: 97 active+clean; 166 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-03-27T08:41:09.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:08 smithi167 ceph-mon[34903]: pgmap v615: 97 pgs: 97 active+clean; 166 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-03-27T08:41:09.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:08 smithi173 ceph-mon[35397]: pgmap v615: 97 pgs: 97 active+clean; 166 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.2 MiB/s wr, 284 op/s 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 -- 172.21.15.164:0/3663236850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc074530 msgr2=0x7fbcdc074990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 --2- 172.21.15.164:0/3663236850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc074530 0x7fbcdc074990 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009900 tx=0x7fbcc402bcd0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 -- 172.21.15.164:0/3663236850 shutdown_connections 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 --2- 172.21.15.164:0/3663236850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc109a30 0x7fbcdc10bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 --2- 172.21.15.164:0/3663236850 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc074530 0x7fbcdc074990 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 --2- 172.21.15.164:0/3663236850 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 0x7fbcdc073f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.556 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 -- 172.21.15.164:0/3663236850 >> 172.21.15.164:0/3663236850 conn(0x7fbcdc0fd110 msgr2=0x7fbcdc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 -- 172.21.15.164:0/3663236850 shutdown_connections 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.561+0000 7fbce1000640 1 -- 172.21.15.164:0/3663236850 wait complete. 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.562+0000 7fbce1000640 1 Processor -- start 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.562+0000 7fbce1000640 1 -- start start 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.562+0000 7fbce1000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc074530 0x7fbcdc199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbce1000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 0x7fbcdc19a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbce1000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbce1000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10fa40 con 0x7fbcdc109a30 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbce1000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10f8c0 con 0x7fbcdc074530 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbce1000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc10fbc0 con 0x7fbcdc075b10 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56966/0 (socket says 172.21.15.164:56966) 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 -- 172.21.15.164:0/1594493939 learned_addr learned my addr 172.21.15.164:0/1594493939 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:10.557 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc074530 0x7fbcdc199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcd9400640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 0x7fbcdc19a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 -- 172.21.15.164:0/1594493939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 msgr2=0x7fbcdc19a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 0x7fbcdc19a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 -- 172.21.15.164:0/1594493939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc074530 msgr2=0x7fbcdc199ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc074530 0x7fbcdc199ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.563+0000 7fbcda800640 1 -- 172.21.15.164:0/1594493939 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcdc1a1c10 con 0x7fbcdc109a30 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbcda800640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400e9b0 tx=0x7fbcd400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbcd2a00640 1 -- 172.21.15.164:0/1594493939 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd400cd80 con 0x7fbcdc109a30 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbcd2a00640 1 -- 172.21.15.164:0/1594493939 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbcd40035f0 con 0x7fbcdc109a30 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcdc1a1f00 con 0x7fbcdc109a30 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbcd2a00640 1 -- 172.21.15.164:0/1594493939 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcd4010690 con 0x7fbcdc109a30 2024-03-27T08:41:10.558 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.564+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcdc1a23c0 con 0x7fbcdc109a30 2024-03-27T08:41:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.567+0000 7fbce3c4c740 1 Processor -- start 2024-03-27T08:41:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbcd2a00640 1 -- 172.21.15.164:0/1594493939 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fbcd40037a0 con 0x7fbcdc109a30 2024-03-27T08:41:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 -- start start 2024-03-27T08:41:10.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b5370 0x555cf93b9e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93bc970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555cf9319d10 con 0x555cf93ba4e0 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555cf92c2260 con 0x555cf93b4980 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.568+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555cf9315cc0 con 0x555cf93b5370 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:43744/0 (socket says 172.21.15.164:43744) 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 -- 172.21.15.164:0/3284785931 learned_addr learned my addr 172.21.15.164:0/3284785931 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93bc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b5370 0x555cf93b9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd2a00640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 0x7fbcc00a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 -- 172.21.15.164:0/3284785931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b5370 msgr2=0x555cf93b9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b5370 0x555cf93b9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 -- 172.21.15.164:0/3284785931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 msgr2=0x555cf93bc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93bc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd9400640 1 -- 172.21.15.164:0/3284785931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf92b9aa0 con 0x555cf93b4980 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.569+0000 7fbcd2a00640 1 -- 172.21.15.164:0/1594493939 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbcd40cfff0 con 0x7fbcdc109a30 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbcda800640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 0x7fbcc00a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4005c20 tx=0x7fbcc4000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9031f3dcbe3cb2b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbccb400640 1 -- 172.21.15.164:0/3284785931 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4048070 con 0x555cf93b4980 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbccb400640 1 -- 172.21.15.164:0/3284785931 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbcc4004230 con 0x555cf93b4980 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbcda800640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 0x7fbcc00a5bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4003b30 tx=0x7fbcd4005bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.570+0000 7fbccb400640 1 -- 172.21.15.164:0/3284785931 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc40436b0 con 0x555cf93b4980 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3284785931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 msgr2=0x555cf93b4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4005c20 tx=0x7fbcc4000bc0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.569 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3284785931 shutdown_connections 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93bc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b5370 0x555cf93b9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3284785931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93b4da0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3284785931 >> 172.21.15.164:0/3284785931 conn(0x555cf93afef0 msgr2=0x555cf93b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3284785931 shutdown_connections 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.571+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3284785931 wait complete. 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 -- start start 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 Processor -- start 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93bece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x555cf93bd430 con 0x555cf93b5370 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555cf92d5630 con 0x555cf93b4980 2024-03-27T08:41:10.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x555cf93bd5b0 con 0x555cf93ba4e0 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.572+0000 7fbce3c4c740 10 client.0 _ll_register_callbacks cb 0x555cf92dac50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56982/0 (socket says 172.21.15.164:56982) 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 -- 172.21.15.164:0/1005347095 learned_addr learned my addr 172.21.15.164:0/1005347095 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9400640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 -- 172.21.15.164:0/1005347095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 msgr2=0x555cf93c6260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 -- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 msgr2=0x555cf93bece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93bece0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 -- 172.21.15.164:0/1005347095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf92e15f0 con 0x555cf93b5370 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9400640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:41:10.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbccc003d10 tx=0x7fbccc004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da7714d8961a40a9 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.573+0000 7fbcbfe00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc011710 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbccc0118b0 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbcc4004230 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbccc011ab0 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbce3c4c740 10 client.16419 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555cf902e210 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.574+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbcc4004230 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fbccc010430 con 0x555cf93b5370 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 10 client.16419 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 10 client.16419 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 20 client.16419 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf93cac10 0x555cf93cd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 4 client.16419 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:41:10.572 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555cf9327250 con 0x555cf93cac10 2024-03-27T08:41:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.575+0000 7fbcd9400640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf93cac10 0x555cf93cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.576+0000 7fbcd9400640 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf93cac10 0x555cf93cd050 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c785ed20b5118a0b server_cookie=89b97c793a523eca in_seq=0 out_seq=0 2024-03-27T08:41:10.573 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.576+0000 7fbcbfe00640 10 client.16419 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.578+0000 7fbcbfe00640 1 -- 172.21.15.164:0/1005347095 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x555cf9327250 con 0x555cf93cac10 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.578+0000 7fbcbfe00640 10 client.16419 handle_command_reply: tid=0 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.578+0000 7fbce3c4c740 1 client.16419 shutdown 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 msgr2=0x555cf93bf220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7fbccc003d10 tx=0x7fbccc004410 comp rx=0 tx=0).stop 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 shutdown_connections 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf93cac10 0x555cf93cd050 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b5370 0x555cf93bf220 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.574 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/1005347095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b4980 0x555cf93bece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbcbfe00640 0 client.16419 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 >> 172.21.15.164:0/1005347095 conn(0x555cf93afef0 msgr2=0x555cf93af0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 shutdown_connections 2024-03-27T08:41:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 1 -- 172.21.15.164:0/1005347095 wait complete. 2024-03-27T08:41:10.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.579+0000 7fbce3c4c740 20 client.16419 trim_cache size 0 max 16384 2024-03-27T08:41:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.596+0000 7fbce3c4c740 1 Processor -- start 2024-03-27T08:41:10.588 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 -- start start 2024-03-27T08:41:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.589 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1adae0 con 0x555cf93b4980 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1ab2f0 con 0x555cf93b5370 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a9140 con 0x555cf93ba4e0 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56986/0 (socket says 172.21.15.164:56986) 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbcd9400640 1 -- 172.21.15.164:0/122065480 learned_addr learned my addr 172.21.15.164:0/122065480 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.597+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9e00640 1 -- 172.21.15.164:0/122065480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 msgr2=0x555cf93c6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9e00640 1 -- 172.21.15.164:0/122065480 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 msgr2=0x555cf93b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.590 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9e00640 1 -- 172.21.15.164:0/122065480 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555cf90fa620 con 0x555cf93b5370 2024-03-27T08:41:10.591 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.598+0000 7fbcd9400640 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.599+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93b6c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbccc003ce0 tx=0x7fbccc0021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd3ab961bff6444 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.599+0000 7fbccaa00640 1 -- 172.21.15.164:0/122065480 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc0097d0 con 0x555cf93b5370 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.599+0000 7fbccaa00640 1 -- 172.21.15.164:0/122065480 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbccc011710 con 0x555cf93b5370 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.599+0000 7fbccaa00640 1 -- 172.21.15.164:0/122065480 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbccc026920 con 0x555cf93b5370 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- 172.21.15.164:0/122065480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 msgr2=0x555cf93b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93b6c30 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbccc003ce0 tx=0x7fbccc0021f0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- 172.21.15.164:0/122065480 shutdown_connections 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93ba4e0 0x555cf93c6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93b6c30 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/122065480 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93b4980 0x555cf93b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.592 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- 172.21.15.164:0/122065480 >> 172.21.15.164:0/122065480 conn(0x555cf93afef0 msgr2=0x555cf93b02d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- 172.21.15.164:0/122065480 shutdown_connections 2024-03-27T08:41:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- 172.21.15.164:0/122065480 wait complete. 2024-03-27T08:41:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 -- start start 2024-03-27T08:41:10.593 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.600+0000 7fbce3c4c740 1 Processor -- start 2024-03-27T08:41:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b4980 0x555cf93c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a97b0 con 0x555cf93ba4e0 2024-03-27T08:41:10.595 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1aac20 con 0x555cf93b5370 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fbcdc1a9e80 con 0x555cf93b4980 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbce3c4c740 10 client.0 _ll_register_callbacks cb 0x7fbccc009d10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbcd9400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:56990/0 (socket says 172.21.15.164:56990) 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbcd9400640 1 -- 172.21.15.164:0/3936510916 learned_addr learned my addr 172.21.15.164:0/3936510916 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.601+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b4980 0x555cf93c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 -- 172.21.15.164:0/3936510916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b4980 msgr2=0x555cf93c3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b4980 0x555cf93c3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 -- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 msgr2=0x555cf93c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 -- 172.21.15.164:0/3936510916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555cf93c55c0 con 0x555cf93ba4e0 2024-03-27T08:41:10.596 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcd9400640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009900 tx=0x7fbcc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9b8808c39202bdf server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcbfe00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcc4059020 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbccc011710 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.602+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fbcc402cbc0 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fbcc4048040 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 10 client.16425 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x555cf9431110 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbccc011710 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fbcc404e040 con 0x555cf93ba4e0 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 10 client.16425 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 10 client.16425 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 20 client.16425 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf9431680 0x555cf9433aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:10.597 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 4 client.16425 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:41:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555cf93215a0 con 0x555cf9431680 2024-03-27T08:41:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.603+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf9431680 0x555cf9433aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.604+0000 7fbcd9e00640 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf9431680 0x555cf9433aa0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=da31489cca6ac4af server_cookie=72ee6a0db931902f in_seq=0 out_seq=0 2024-03-27T08:41:10.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:10.604+0000 7fbcbfe00640 10 client.16425 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:10 smithi164 ceph-mon[31788]: pgmap v616: 97 pgs: 97 active+clean; 167 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-03-27T08:41:11.051 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbcbfe00640 1 -- 172.21.15.164:0/3936510916 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555cf93215a0 con 0x555cf9431680 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbcbfe00640 10 client.16425 handle_command_reply: tid=0 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 client.16425 shutdown 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 msgr2=0x555cf93c4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4009900 tx=0x7fbcc40057f0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 shutdown_connections 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x555cf9431680 0x555cf9433aa0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x555cf93ba4e0 0x555cf93c4fd0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.052 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555cf93b5370 0x555cf93c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbcbfe00640 0 client.16425 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 --2- 172.21.15.164:0/3936510916 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x555cf93b4980 0x555cf93c3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 >> 172.21.15.164:0/3936510916 conn(0x555cf93afef0 msgr2=0x555cf93becc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 shutdown_connections 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.055+0000 7fbce3c4c740 1 -- 172.21.15.164:0/3936510916 wait complete. 2024-03-27T08:41:11.053 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.056+0000 7fbce3c4c740 20 client.16425 trim_cache size 0 max 16384 2024-03-27T08:41:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:41:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:41:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:41:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:41:11.054 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.056+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 msgr2=0x7fbcc00a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.056+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 0x7fbcc00a5bf0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fbcd4003b30 tx=0x7fbcd4005bc0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.056+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 msgr2=0x7fbcdc1a15a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.056+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fbcd400e9b0 tx=0x7fbcd400ee70 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 shutdown_connections 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fbcc00a3730 0x7fbcc00a5bf0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fbcdc109a30 0x7fbcdc1a15a0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fbcdc075b10 0x7fbcdc19a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 --2- 172.21.15.164:0/1594493939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbcdc074530 0x7fbcdc199ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 >> 172.21.15.164:0/1594493939 conn(0x7fbcdc0fd110 msgr2=0x7fbcdc1059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 shutdown_connections 2024-03-27T08:41:11.055 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:11.057+0000 7fbce1000640 1 -- 172.21.15.164:0/1594493939 wait complete. 2024-03-27T08:41:11.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:10 smithi167 ceph-mon[34903]: pgmap v616: 97 pgs: 97 active+clean; 167 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-03-27T08:41:11.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:10 smithi173 ceph-mon[35397]: pgmap v616: 97 pgs: 97 active+clean; 167 MiB data, 962 MiB used, 1.0 TiB / 1.0 TiB avail; 314 KiB/s rd, 1.2 MiB/s wr, 289 op/s 2024-03-27T08:41:12.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:11 smithi164 ceph-mon[31788]: pgmap v617: 97 pgs: 97 active+clean; 171 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-03-27T08:41:12.071 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:11 smithi167 ceph-mon[34903]: pgmap v617: 97 pgs: 97 active+clean; 171 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-03-27T08:41:12.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:11 smithi173 ceph-mon[35397]: pgmap v617: 97 pgs: 97 active+clean; 171 MiB data, 974 MiB used, 1.0 TiB / 1.0 TiB avail; 383 KiB/s rd, 1.2 MiB/s wr, 218 op/s 2024-03-27T08:41:15.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:14 smithi164 ceph-mon[31788]: pgmap v618: 97 pgs: 97 active+clean; 169 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.2 MiB/s wr, 225 op/s 2024-03-27T08:41:15.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:14 smithi167 ceph-mon[34903]: pgmap v618: 97 pgs: 97 active+clean; 169 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.2 MiB/s wr, 225 op/s 2024-03-27T08:41:15.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:14 smithi173 ceph-mon[35397]: pgmap v618: 97 pgs: 97 active+clean; 169 MiB data, 960 MiB used, 1.0 TiB / 1.0 TiB avail; 411 KiB/s rd, 1.2 MiB/s wr, 225 op/s 2024-03-27T08:41:15.844 INFO:tasks.workunit.client.0.smithi164.stderr:+ sync 2024-03-27T08:41:16.131 INFO:tasks.workunit.client.0.smithi164.stderr:+ tar c linux-4.0.5 2024-03-27T08:41:17.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:16 smithi164 ceph-mon[31788]: pgmap v619: 97 pgs: 97 active+clean; 166 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-03-27T08:41:17.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:16 smithi167 ceph-mon[34903]: pgmap v619: 97 pgs: 97 active+clean; 166 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-03-27T08:41:17.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:16 smithi173 ceph-mon[35397]: pgmap v619: 97 pgs: 97 active+clean; 166 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 412 KiB/s rd, 1.1 MiB/s wr, 278 op/s 2024-03-27T08:41:19.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:18 smithi164 ceph-mon[31788]: pgmap v620: 97 pgs: 97 active+clean; 166 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 927 KiB/s wr, 267 op/s 2024-03-27T08:41:19.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:18 smithi167 ceph-mon[34903]: pgmap v620: 97 pgs: 97 active+clean; 166 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 927 KiB/s wr, 267 op/s 2024-03-27T08:41:19.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:18 smithi173 ceph-mon[35397]: pgmap v620: 97 pgs: 97 active+clean; 166 MiB data, 964 MiB used, 1.0 TiB / 1.0 TiB avail; 310 KiB/s rd, 927 KiB/s wr, 267 op/s 2024-03-27T08:41:21.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:20 smithi164 ceph-mon[31788]: pgmap v621: 97 pgs: 97 active+clean; 168 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 272 op/s 2024-03-27T08:41:21.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:20 smithi167 ceph-mon[34903]: pgmap v621: 97 pgs: 97 active+clean; 168 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 272 op/s 2024-03-27T08:41:21.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:20 smithi173 ceph-mon[35397]: pgmap v621: 97 pgs: 97 active+clean; 168 MiB data, 971 MiB used, 1.0 TiB / 1.0 TiB avail; 425 KiB/s rd, 1.0 MiB/s wr, 272 op/s 2024-03-27T08:41:23.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:22 smithi164 ceph-mon[31788]: pgmap v622: 97 pgs: 97 active+clean; 168 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 881 KiB/s wr, 259 op/s 2024-03-27T08:41:23.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:22 smithi167 ceph-mon[34903]: pgmap v622: 97 pgs: 97 active+clean; 168 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 881 KiB/s wr, 259 op/s 2024-03-27T08:41:23.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:22 smithi173 ceph-mon[35397]: pgmap v622: 97 pgs: 97 active+clean; 168 MiB data, 973 MiB used, 1.0 TiB / 1.0 TiB avail; 426 KiB/s rd, 881 KiB/s wr, 259 op/s 2024-03-27T08:41:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 -- 172.21.15.164:0/2559622615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c074550 msgr2=0x7fc91c0749b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.195 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 --2- 172.21.15.164:0/2559622615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c074550 0x7fc91c0749b0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fc908009900 tx=0x7fc90802bcd0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 -- 172.21.15.164:0/2559622615 shutdown_connections 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 --2- 172.21.15.164:0/2559622615 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c109860 0x7fc91c10bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 --2- 172.21.15.164:0/2559622615 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c074550 0x7fc91c0749b0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 --2- 172.21.15.164:0/2559622615 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 0x7fc91c073f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 -- 172.21.15.164:0/2559622615 >> 172.21.15.164:0/2559622615 conn(0x7fc91c0fcf60 msgr2=0x7fc91c0ff380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.203+0000 7fc922400640 1 -- 172.21.15.164:0/2559622615 shutdown_connections 2024-03-27T08:41:24.196 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.204+0000 7fc922400640 1 -- 172.21.15.164:0/2559622615 wait complete. 2024-03-27T08:41:24.197 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.204+0000 7fc922400640 1 Processor -- start 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 -- start start 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 0x7fc91c199f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 0x7fc91c19a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c10f880 con 0x7fc91c109860 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c10f700 con 0x7fc91c075b30 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc922400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c10fa00 con 0x7fc91c074550 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc921a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc921a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45240/0 (socket says 172.21.15.164:45240) 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.205+0000 7fc921a00640 1 -- 172.21.15.164:0/3087979538 learned_addr learned my addr 172.21.15.164:0/3087979538 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc91be00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 0x7fc91c19a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.198 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921000640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 0x7fc91c199f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 -- 172.21.15.164:0/3087979538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 msgr2=0x7fc91c199f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 0x7fc91c199f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 -- 172.21.15.164:0/3087979538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 msgr2=0x7fc91c19a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 0x7fc91c19a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 -- 172.21.15.164:0/3087979538 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c1a1ad0 con 0x7fc91c109860 2024-03-27T08:41:24.199 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921000640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 0x7fc91c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.206+0000 7fc921a00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc91400cad0 tx=0x7fc91400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.207+0000 7fc919600640 1 -- 172.21.15.164:0/3087979538 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91400ae20 con 0x7fc91c109860 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.207+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c1a1dc0 con 0x7fc91c109860 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.207+0000 7fc919600640 1 -- 172.21.15.164:0/3087979538 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc914005020 con 0x7fc91c109860 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.207+0000 7fc919600640 1 -- 172.21.15.164:0/3087979538 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91400f690 con 0x7fc91c109860 2024-03-27T08:41:24.200 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.207+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1a2230 con 0x7fc91c109860 2024-03-27T08:41:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.210+0000 7fc919600640 1 -- 172.21.15.164:0/3087979538 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc9140051d0 con 0x7fc91c109860 2024-03-27T08:41:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 Processor -- start 2024-03-27T08:41:24.202 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 -- start start 2024-03-27T08:41:24.204 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.204 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445b5050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.204 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445b7b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad44514d10 con 0x55ad445b56c0 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad444bd260 con 0x55ad445afb60 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.211+0000 7fc92664d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad44510cc0 con 0x55ad445b0550 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:55848/0 (socket says 172.21.15.164:55848) 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 -- 172.21.15.164:0/3528834213 learned_addr learned my addr 172.21.15.164:0/3528834213 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:24.205 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445b7b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc921000640 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 -- 172.21.15.164:0/3528834213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 msgr2=0x55ad445b5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445b5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc919600640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 0x7fc9040a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 -- 172.21.15.164:0/3528834213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 msgr2=0x55ad445b7b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445b7b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.212+0000 7fc91be00640 1 -- 172.21.15.164:0/3528834213 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad444b4aa0 con 0x55ad445afb60 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc919600640 1 -- 172.21.15.164:0/3087979538 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc9140cfdb0 con 0x7fc91c109860 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc921a00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 0x7fc9040a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.206 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc91be00640 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc90802c7b0 tx=0x7fc908005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78b7b8de68b70fe3 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.212 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc90e000640 1 -- 172.21.15.164:0/3528834213 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908004030 con 0x55ad445afb60 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc921a00640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 0x7fc9040a5ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9140a49d0 tx=0x7fc91400a890 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc90e000640 1 -- 172.21.15.164:0/3528834213 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9080041d0 con 0x55ad445afb60 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.213+0000 7fc90e000640 1 -- 172.21.15.164:0/3528834213 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9080436b0 con 0x55ad445afb60 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 -- 172.21.15.164:0/3528834213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 msgr2=0x55ad445aff80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc90802c7b0 tx=0x7fc908005fd0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 -- 172.21.15.164:0/3528834213 shutdown_connections 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445b7b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445b5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 --2- 172.21.15.164:0/3528834213 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445aff80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 -- 172.21.15.164:0/3528834213 >> 172.21.15.164:0/3528834213 conn(0x55ad445ab0d0 msgr2=0x55ad445ab4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.213 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.214+0000 7fc92664d740 1 -- 172.21.15.164:0/3528834213 shutdown_connections 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.215+0000 7fc92664d740 1 -- 172.21.15.164:0/3528834213 wait complete. 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.215+0000 7fc92664d740 1 -- start start 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.215+0000 7fc92664d740 1 Processor -- start 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445b9df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445ba330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55ad445b85b0 con 0x55ad445b56c0 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ad444d0630 con 0x55ad445afb60 2024-03-27T08:41:24.214 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55ad445b8730 con 0x55ad445b0550 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc92664d740 10 client.0 _ll_register_callbacks cb 0x55ad444d5c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc91be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc91be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45262/0 (socket says 172.21.15.164:45262) 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc91be00640 1 -- 172.21.15.164:0/424094218 learned_addr learned my addr 172.21.15.164:0/424094218 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc91be00640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445b9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.216+0000 7fc921000640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445ba330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 -- 172.21.15.164:0/424094218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 msgr2=0x55ad445ba330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445ba330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 -- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 msgr2=0x55ad445b9df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445b9df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 -- 172.21.15.164:0/424094218 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad444dc5f0 con 0x55ad445b56c0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc91be00640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc908005ab0 tx=0x7fc90802c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=389a7b74e9d54c2e server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.215 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc902a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908057060 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc9080038b0 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.217+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9080041d0 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc908043890 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 10 client.16437 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ad44229210 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9080041d0 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fc908034870 con 0x55ad445b56c0 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 10 client.16437 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:24.216 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 10 client.16437 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 20 client.16437 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad445c5840 0x55ad445c7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 4 client.16437 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.218+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ad44522250 con 0x55ad445c5840 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.219+0000 7fc921000640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad445c5840 0x55ad445c7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.220+0000 7fc921000640 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad445c5840 0x55ad445c7c30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e444f4c8c53517bd server_cookie=a09ad41d274ed950 in_seq=0 out_seq=0 2024-03-27T08:41:24.217 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.220+0000 7fc902a00640 10 client.16437 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc902a00640 1 -- 172.21.15.164:0/424094218 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55ad44522250 con 0x55ad445c5840 2024-03-27T08:41:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc902a00640 10 client.16437 handle_command_reply: tid=0 2024-03-27T08:41:24.218 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc92664d740 1 client.16437 shutdown 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 msgr2=0x55ad445c1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fc908005ab0 tx=0x7fc90802c9c0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.221+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 shutdown_connections 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad445c5840 0x55ad445c7c30 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b56c0 0x55ad445c1370 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b0550 0x55ad445ba330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 --2- 172.21.15.164:0/424094218 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445b9df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 >> 172.21.15.164:0/424094218 conn(0x55ad445ab0d0 msgr2=0x55ad445aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc902a00640 0 client.16437 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:24.219 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 shutdown_connections 2024-03-27T08:41:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 1 -- 172.21.15.164:0/424094218 wait complete. 2024-03-27T08:41:24.220 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.222+0000 7fc92664d740 20 client.16437 trim_cache size 0 max 16384 2024-03-27T08:41:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.238+0000 7fc92664d740 1 Processor -- start 2024-03-27T08:41:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.238+0000 7fc92664d740 1 -- start start 2024-03-27T08:41:24.230 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 0x55ad445c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445a9a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1ad910 con 0x55ad445afb60 2024-03-27T08:41:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1ab120 con 0x55ad445b0550 2024-03-27T08:41:24.231 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc92664d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1a8f70 con 0x55ad445b56c0 2024-03-27T08:41:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.233 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45264/0 (socket says 172.21.15.164:45264) 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 -- 172.21.15.164:0/2429725527 learned_addr learned my addr 172.21.15.164:0/2429725527 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc921000640 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 0x55ad445c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 -- 172.21.15.164:0/2429725527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 msgr2=0x55ad445a9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445a9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 -- 172.21.15.164:0/2429725527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 msgr2=0x55ad445c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 0x55ad445c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc91be00640 1 -- 172.21.15.164:0/2429725527 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ad442f5620 con 0x55ad445afb60 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.239+0000 7fc921000640 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 0x55ad445c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.240+0000 7fc91be00640 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc90802c7b0 tx=0x7fc90802cea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1efbc32e49a79860 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.240+0000 7fc90d600640 1 -- 172.21.15.164:0/2429725527 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908062070 con 0x55ad445afb60 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.240+0000 7fc90d600640 1 -- 172.21.15.164:0/2429725527 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9080041d0 con 0x55ad445afb60 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.240+0000 7fc90d600640 1 -- 172.21.15.164:0/2429725527 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908034440 con 0x55ad445afb60 2024-03-27T08:41:24.234 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- 172.21.15.164:0/2429725527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 msgr2=0x55ad445b8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fc90802c7b0 tx=0x7fc90802cea0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- 172.21.15.164:0/2429725527 shutdown_connections 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445a9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445b0550 0x55ad445c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 --2- 172.21.15.164:0/2429725527 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445afb60 0x55ad445b8b00 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- 172.21.15.164:0/2429725527 >> 172.21.15.164:0/2429725527 conn(0x55ad445ab0d0 msgr2=0x55ad445b9df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- 172.21.15.164:0/2429725527 shutdown_connections 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- 172.21.15.164:0/2429725527 wait complete. 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.241+0000 7fc92664d740 1 -- start start 2024-03-27T08:41:24.235 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 Processor -- start 2024-03-27T08:41:24.237 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445bedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445c02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1a95e0 con 0x55ad445b0550 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1aaa50 con 0x55ad445afb60 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c1a9cb0 con 0x55ad445b56c0 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc92664d740 10 client.0 _ll_register_callbacks cb 0x7fc90802cf50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.242+0000 7fc921000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:45280/0 (socket says 172.21.15.164:45280) 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 -- 172.21.15.164:0/2401485191 learned_addr learned my addr 172.21.15.164:0/2401485191 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc91be00640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445bedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 -- 172.21.15.164:0/2401485191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 msgr2=0x55ad445c02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.238 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445c02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 -- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 msgr2=0x55ad445bedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445bedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 -- 172.21.15.164:0/2401485191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ad445c08a0 con 0x55ad445b0550 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc91be00640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc921000640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc910004700 tx=0x7fc9100045f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=525fbe26cdffde8 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.243+0000 7fc902a00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc91001ee60 con 0x55ad445b0550 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9080041d0 con 0x55ad445b0550 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc910003cc0 con 0x55ad445b0550 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fc91001e420 con 0x55ad445b0550 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc92664d740 10 client.16443 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:24.239 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55ad4462bf00 con 0x55ad445b0550 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9080041d0 con 0x55ad445b0550 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.244+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fc910027cb0 con 0x55ad445b0550 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 10 client.16443 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 10 client.16443 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 20 client.16443 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad4462c990 0x55ad4462edb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 4 client.16443 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ad4451c5a0 con 0x55ad4462c990 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.245+0000 7fc91be00640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad4462c990 0x55ad4462edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.246+0000 7fc91be00640 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad4462c990 0x55ad4462edb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=688e4eff0b910634 server_cookie=b024f1f45280d00c in_seq=0 out_seq=0 2024-03-27T08:41:24.240 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.246+0000 7fc902a00640 10 client.16443 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.419+0000 7fc902a00640 1 -- 172.21.15.164:0/2401485191 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ad4451c5a0 con 0x55ad4462c990 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.419+0000 7fc902a00640 10 client.16443 handle_command_reply: tid=0 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.419+0000 7fc92664d740 1 client.16443 shutdown 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.419+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 msgr2=0x55ad445bf2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fc910004700 tx=0x7fc9100045f0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.412 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 shutdown_connections 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55ad4462c990 0x55ad4462edb0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55ad445b56c0 0x55ad445c02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55ad445b0550 0x55ad445bf2f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 --2- 172.21.15.164:0/2401485191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ad445afb60 0x55ad445bedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc902a00640 0 client.16443 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 >> 172.21.15.164:0/2401485191 conn(0x55ad445ab0d0 msgr2=0x55ad445ae330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 shutdown_connections 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 1 -- 172.21.15.164:0/2401485191 wait complete. 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.420+0000 7fc92664d740 20 client.16443 trim_cache size 0 max 16384 2024-03-27T08:41:24.413 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:41:24.414 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:41:24.414 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:41:24.414 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 msgr2=0x7fc9040a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 0x7fc9040a5ac0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc9140a49d0 tx=0x7fc91400a890 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 msgr2=0x7fc91c1a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc91400cad0 tx=0x7fc91400cf90 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 shutdown_connections 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc9040a3600 0x7fc9040a5ac0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc91c109860 0x7fc91c1a1460 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc91c075b30 0x7fc91c19a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 --2- 172.21.15.164:0/3087979538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc91c074550 0x7fc91c199f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 >> 172.21.15.164:0/3087979538 conn(0x7fc91c0fcf60 msgr2=0x7fc91c1057f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:24.415 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 shutdown_connections 2024-03-27T08:41:24.416 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:24.421+0000 7fc922400640 1 -- 172.21.15.164:0/3087979538 wait complete. 2024-03-27T08:41:25.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:24 smithi164 ceph-mon[31788]: pgmap v623: 97 pgs: 97 active+clean; 169 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 646 KiB/s wr, 221 op/s 2024-03-27T08:41:25.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:24 smithi167 ceph-mon[34903]: pgmap v623: 97 pgs: 97 active+clean; 169 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 646 KiB/s wr, 221 op/s 2024-03-27T08:41:25.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:24 smithi173 ceph-mon[35397]: pgmap v623: 97 pgs: 97 active+clean; 169 MiB data, 975 MiB used, 1.0 TiB / 1.0 TiB avail; 282 KiB/s rd, 646 KiB/s wr, 221 op/s 2024-03-27T08:41:27.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:26 smithi164 ceph-mon[31788]: pgmap v624: 97 pgs: 97 active+clean; 170 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 543 KiB/s wr, 147 op/s 2024-03-27T08:41:27.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:26 smithi167 ceph-mon[34903]: pgmap v624: 97 pgs: 97 active+clean; 170 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 543 KiB/s wr, 147 op/s 2024-03-27T08:41:27.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:26 smithi173 ceph-mon[35397]: pgmap v624: 97 pgs: 97 active+clean; 170 MiB data, 977 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 543 KiB/s wr, 147 op/s 2024-03-27T08:41:27.863 INFO:tasks.workunit.client.0.smithi164.stdout:Ok 2024-03-27T08:41:27.865 INFO:tasks.workunit.client.0.smithi164.stderr:+ echo Ok 2024-03-27T08:41:27.866 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-27T08:41:27.866 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-27T08:41:29.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:28 smithi164 ceph-mon[31788]: pgmap v625: 97 pgs: 97 active+clean; 170 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 433 KiB/s wr, 78 op/s 2024-03-27T08:41:29.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:28 smithi167 ceph-mon[34903]: pgmap v625: 97 pgs: 97 active+clean; 170 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 433 KiB/s wr, 78 op/s 2024-03-27T08:41:29.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:28 smithi173 ceph-mon[35397]: pgmap v625: 97 pgs: 97 active+clean; 170 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 276 KiB/s rd, 433 KiB/s wr, 78 op/s 2024-03-27T08:41:31.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:30 smithi164 ceph-mon[31788]: pgmap v626: 97 pgs: 97 active+clean; 171 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 415 KiB/s wr, 118 op/s 2024-03-27T08:41:31.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:30 smithi167 ceph-mon[34903]: pgmap v626: 97 pgs: 97 active+clean; 171 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 415 KiB/s wr, 118 op/s 2024-03-27T08:41:31.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:30 smithi173 ceph-mon[35397]: pgmap v626: 97 pgs: 97 active+clean; 171 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 287 KiB/s rd, 415 KiB/s wr, 118 op/s 2024-03-27T08:41:32.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:31 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:41:32.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:31 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:41:32.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:31 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: pgmap v627: 97 pgs: 97 active+clean; 170 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 234 KiB/s wr, 113 op/s 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:41:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:32 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:41:33.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: pgmap v627: 97 pgs: 97 active+clean; 170 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 234 KiB/s wr, 113 op/s 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:41:33.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:32 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:41:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: pgmap v627: 97 pgs: 97 active+clean; 170 MiB data, 1000 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 234 KiB/s wr, 113 op/s 2024-03-27T08:41:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:41:33.077 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:32 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:41:34.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:33 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi164 to 176.8M 2024-03-27T08:41:34.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:33 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi167 to 176.8M 2024-03-27T08:41:34.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:33 smithi164 ceph-mon[31788]: Unable to set osd_memory_target on smithi164 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:34.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:33 smithi164 ceph-mon[31788]: Unable to set osd_memory_target on smithi167 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:34.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:33 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi164 to 176.8M 2024-03-27T08:41:34.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:33 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi167 to 176.8M 2024-03-27T08:41:34.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:33 smithi167 ceph-mon[34903]: Unable to set osd_memory_target on smithi164 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:34.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:33 smithi167 ceph-mon[34903]: Unable to set osd_memory_target on smithi167 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:34.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:33 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi164 to 176.8M 2024-03-27T08:41:34.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:33 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi167 to 176.8M 2024-03-27T08:41:34.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:33 smithi173 ceph-mon[35397]: Unable to set osd_memory_target on smithi164 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:34.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:33 smithi173 ceph-mon[35397]: Unable to set osd_memory_target on smithi167 to 185389568: error parsing value: Value '185389568' is below minimum 939524096 2024-03-27T08:41:35.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:34 smithi164 ceph-mon[31788]: pgmap v628: 97 pgs: 97 active+clean; 170 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 232 KiB/s wr, 124 op/s 2024-03-27T08:41:35.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:34 smithi167 ceph-mon[34903]: pgmap v628: 97 pgs: 97 active+clean; 170 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 232 KiB/s wr, 124 op/s 2024-03-27T08:41:35.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:34 smithi173 ceph-mon[35397]: pgmap v628: 97 pgs: 97 active+clean; 170 MiB data, 981 MiB used, 1.0 TiB / 1.0 TiB avail; 176 KiB/s rd, 232 KiB/s wr, 124 op/s 2024-03-27T08:41:36.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:35 smithi164 ceph-mon[31788]: pgmap v629: 97 pgs: 97 active+clean; 117 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 338 KiB/s wr, 148 op/s 2024-03-27T08:41:36.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:35 smithi167 ceph-mon[34903]: pgmap v629: 97 pgs: 97 active+clean; 117 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 338 KiB/s wr, 148 op/s 2024-03-27T08:41:36.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:35 smithi173 ceph-mon[35397]: pgmap v629: 97 pgs: 97 active+clean; 117 MiB data, 812 MiB used, 1.0 TiB / 1.0 TiB avail; 283 KiB/s rd, 338 KiB/s wr, 148 op/s 2024-03-27T08:41:37.562 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.569+0000 7fb822a00640 1 -- 172.21.15.164:0/1735953226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 msgr2=0x7fb81c073f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.562 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.569+0000 7fb822a00640 1 --2- 172.21.15.164:0/1735953226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c073f60 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fb80c009ca0 tx=0x7fb80c02c180 comp rx=0 tx=0).stop 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 -- 172.21.15.164:0/1735953226 shutdown_connections 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 --2- 172.21.15.164:0/1735953226 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c10bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 --2- 172.21.15.164:0/1735953226 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 0x7fb81c074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 --2- 172.21.15.164:0/1735953226 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c073f60 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 -- 172.21.15.164:0/1735953226 >> 172.21.15.164:0/1735953226 conn(0x7fb81c0fd110 msgr2=0x7fb81c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 -- 172.21.15.164:0/1735953226 shutdown_connections 2024-03-27T08:41:37.563 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.570+0000 7fb822a00640 1 -- 172.21.15.164:0/1735953226 wait complete. 2024-03-27T08:41:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 Processor -- start 2024-03-27T08:41:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 -- start start 2024-03-27T08:41:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 0x7fb81c199fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.565 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c1a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10f9f0 con 0x7fb81c075b10 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10f870 con 0x7fb81c109a30 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.571+0000 7fb822a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c10fb70 con 0x7fb81c074530 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35558/0 (socket says 172.21.15.164:35558) 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 -- 172.21.15.164:0/2964432323 learned_addr learned my addr 172.21.15.164:0/2964432323 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb820a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c1a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb81be00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 0x7fb81c199fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 -- 172.21.15.164:0/2964432323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 msgr2=0x7fb81c199fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 0x7fb81c199fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 -- 172.21.15.164:0/2964432323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 msgr2=0x7fb81c1a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.566 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c1a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb813400640 1 -- 172.21.15.164:0/2964432323 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb81c1a1be0 con 0x7fb81c075b10 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.572+0000 7fb820a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb813400640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c890 tx=0x7fb80400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb819600640 1 -- 172.21.15.164:0/2964432323 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804004220 con 0x7fb81c075b10 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb819600640 1 -- 172.21.15.164:0/2964432323 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb8040043c0 con 0x7fb81c075b10 2024-03-27T08:41:37.567 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb81c1a1ed0 con 0x7fb81c075b10 2024-03-27T08:41:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb819600640 1 -- 172.21.15.164:0/2964432323 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb804004a00 con 0x7fb81c075b10 2024-03-27T08:41:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.573+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb81c1a23e0 con 0x7fb81c075b10 2024-03-27T08:41:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.576+0000 7fb819600640 1 -- 172.21.15.164:0/2964432323 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb804004ba0 con 0x7fb81c075b10 2024-03-27T08:41:37.568 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.576+0000 7fb825787740 1 Processor -- start 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 -- start start 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1816370 0x5608d181ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d181b4e0 0x5608d181d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5608d177ad10 con 0x5608d1815980 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608d1723260 con 0x5608d1816370 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb825787740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5608d1776cc0 con 0x5608d181b4e0 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb820a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.570 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb820a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35562/0 (socket says 172.21.15.164:35562) 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb820a00640 1 -- 172.21.15.164:0/485968463 learned_addr learned my addr 172.21.15.164:0/485968463 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.577+0000 7fb81be00640 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1816370 0x5608d181ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb813400640 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d181b4e0 0x5608d181d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 -- 172.21.15.164:0/485968463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d181b4e0 msgr2=0x5608d181d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d181b4e0 0x5608d181d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 -- 172.21.15.164:0/485968463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1816370 msgr2=0x5608d181ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1816370 0x5608d181ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.571 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 -- 172.21.15.164:0/485968463 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608d171aaa0 con 0x5608d1815980 2024-03-27T08:41:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb819600640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 0x7fb8000a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb820a00640 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb814010480 tx=0x7fb814010940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff25331349e795fd server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.578+0000 7fb819600640 1 -- 172.21.15.164:0/2964432323 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb8040cf900 con 0x7fb81c075b10 2024-03-27T08:41:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb811200640 1 -- 172.21.15.164:0/485968463 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb814011760 con 0x5608d1815980 2024-03-27T08:41:37.575 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb811200640 1 -- 172.21.15.164:0/485968463 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb814011dd0 con 0x5608d1815980 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb811200640 1 -- 172.21.15.164:0/485968463 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81400e430 con 0x5608d1815980 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb81be00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 0x7fb8000a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb825787740 1 -- 172.21.15.164:0/485968463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 msgr2=0x5608d1815da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb825787740 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fb814010480 tx=0x7fb814010940 comp rx=0 tx=0).stop 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.579+0000 7fb81be00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 0x7fb8000a5bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02c6c0 tx=0x7fb80c032610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 -- 172.21.15.164:0/485968463 shutdown_connections 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d181b4e0 0x5608d181d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1816370 0x5608d181ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 --2- 172.21.15.164:0/485968463 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d1815da0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 -- 172.21.15.164:0/485968463 >> 172.21.15.164:0/485968463 conn(0x5608d1810ef0 msgr2=0x5608d18112f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 -- 172.21.15.164:0/485968463 shutdown_connections 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 -- 172.21.15.164:0/485968463 wait complete. 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 -- start start 2024-03-27T08:41:37.576 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.580+0000 7fb825787740 1 Processor -- start 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1820220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x5608d181e490 con 0x5608d181b4e0 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608d1736630 con 0x5608d1815980 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x5608d181e610 con 0x5608d1816370 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb825787740 10 client.0 _ll_register_callbacks cb 0x5608d173bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb820a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb81be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb820a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35576/0 (socket says 172.21.15.164:35576) 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb820a00640 1 -- 172.21.15.164:0/1236894517 learned_addr learned my addr 172.21.15.164:0/1236894517 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.581+0000 7fb81be00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:60612/0 (socket says 172.21.15.164:60612) 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb813400640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1820220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.577 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 -- 172.21.15.164:0/1236894517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 msgr2=0x5608d1820220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1820220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 -- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 msgr2=0x5608d181fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 -- 172.21.15.164:0/1236894517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608d17425f0 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb820a00640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb814010e40 tx=0x7fb81401def0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9070288f255912c server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb809600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81402b060 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb814004240 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.582+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb814011dd0 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb81401c750 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 10 client.16455 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5608d148f210 con 0x5608d181b4e0 2024-03-27T08:41:37.578 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb814011dd0 con 0x5608d181b4e0 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fb814025070 con 0x5608d181b4e0 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 10 client.16455 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 20 client.16455 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d182b870 0x5608d182dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 4 client.16455 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:41:37.579 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.583+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608d1788250 con 0x5608d182b870 2024-03-27T08:41:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.584+0000 7fb81be00640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d182b870 0x5608d182dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.585+0000 7fb81be00640 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d182b870 0x5608d182dc60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e55c09786598fd6 server_cookie=4fa009cb69474f99 in_seq=0 out_seq=0 2024-03-27T08:41:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.585+0000 7fb809600640 10 client.16455 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:37.580 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb809600640 1 -- 172.21.15.164:0/1236894517 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x5608d1788250 con 0x5608d182b870 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb809600640 10 client.16455 handle_command_reply: tid=0 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 client.16455 shutdown 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 msgr2=0x5608d1827260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fb814010e40 tx=0x7fb81401def0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 shutdown_connections 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d182b870 0x5608d182dc60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d181b4e0 0x5608d1827260 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1820220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 --2- 172.21.15.164:0/1236894517 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb809600640 0 client.16455 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 >> 172.21.15.164:0/1236894517 conn(0x5608d1810ef0 msgr2=0x5608d18100f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 shutdown_connections 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 1 -- 172.21.15.164:0/1236894517 wait complete. 2024-03-27T08:41:37.581 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.586+0000 7fb825787740 20 client.16455 trim_cache size 0 max 16384 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.605+0000 7fb825787740 1 Processor -- start 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.605+0000 7fb825787740 1 -- start start 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1827220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1820220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.598 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1adb50 con 0x5608d1815980 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1ab360 con 0x5608d181b4e0 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb825787740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1a91b0 con 0x5608d1816370 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35582/0 (socket says 172.21.15.164:35582) 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 -- 172.21.15.164:0/512147316 learned_addr learned my addr 172.21.15.164:0/512147316 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:37.599 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb820a00640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1820220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb813400640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1827220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 -- 172.21.15.164:0/512147316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 msgr2=0x5608d1827220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1827220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 -- 172.21.15.164:0/512147316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 msgr2=0x5608d1820220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.600 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1820220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb81be00640 1 -- 172.21.15.164:0/512147316 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608d155b620 con 0x5608d1815980 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.606+0000 7fb813400640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1827220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.607+0000 7fb81be00640 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0329c0 tx=0x7fb80c045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfced880ea97fdf0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.608+0000 7fb80be00640 1 -- 172.21.15.164:0/512147316 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c039040 con 0x5608d1815980 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.608+0000 7fb80be00640 1 -- 172.21.15.164:0/512147316 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb80c048040 con 0x5608d1815980 2024-03-27T08:41:37.601 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.608+0000 7fb80be00640 1 -- 172.21.15.164:0/512147316 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80c041c10 con 0x5608d1815980 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 -- 172.21.15.164:0/512147316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 msgr2=0x5608d181fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fb80c0329c0 tx=0x7fb80c045000 comp rx=0 tx=0).stop 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 -- 172.21.15.164:0/512147316 shutdown_connections 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1820220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1816370 0x5608d1827220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 --2- 172.21.15.164:0/512147316 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1815980 0x5608d181fce0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 -- 172.21.15.164:0/512147316 >> 172.21.15.164:0/512147316 conn(0x5608d1810ef0 msgr2=0x5608d1817690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 -- 172.21.15.164:0/512147316 shutdown_connections 2024-03-27T08:41:37.602 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.609+0000 7fb825787740 1 -- 172.21.15.164:0/512147316 wait complete. 2024-03-27T08:41:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 -- start start 2024-03-27T08:41:37.603 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 Processor -- start 2024-03-27T08:41:37.605 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1815980 0x5608d1824780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1825b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1a9820 con 0x5608d1816370 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1aac90 con 0x5608d181b4e0 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb81c1a9ef0 con 0x5608d1815980 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb825787740 10 client.0 _ll_register_callbacks cb 0x7fb80c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.610+0000 7fb813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:35596/0 (socket says 172.21.15.164:35596) 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 -- 172.21.15.164:0/1941325244 learned_addr learned my addr 172.21.15.164:0/1941325244 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb820a00640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1825b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb81be00640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1815980 0x5608d1824780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.606 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 -- 172.21.15.164:0/1941325244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1815980 msgr2=0x5608d1824780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1815980 0x5608d1824780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 -- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 msgr2=0x5608d1825b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1825b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 -- 172.21.15.164:0/1941325244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608d1826140 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb813400640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb80409be20 tx=0x7fb80409b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2363ab363b9e871 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb809600640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb80401d070 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb804005140 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.611+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb80c048040 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7fb8040b5140 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 10 client.16461 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x5608d1827430 con 0x5608d1816370 2024-03-27T08:41:37.607 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb80c048040 con 0x5608d1816370 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7fb804097d70 con 0x5608d1816370 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 10 client.16461 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 10 client.16461 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 20 client.16461 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d18921c0 0x5608d18945e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 4 client.16461 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.612+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5608d17825a0 con 0x5608d18921c0 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.613+0000 7fb81be00640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d18921c0 0x5608d18945e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.613+0000 7fb81be00640 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d18921c0 0x5608d18945e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c2e582adc85e92d server_cookie=134f2adf97d31890 in_seq=0 out_seq=0 2024-03-27T08:41:37.608 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.613+0000 7fb809600640 10 client.16461 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.649+0000 7fb809600640 1 -- 172.21.15.164:0/1941325244 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5608d17825a0 con 0x5608d18921c0 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.649+0000 7fb809600640 10 client.16461 handle_command_reply: tid=0 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.649+0000 7fb825787740 1 client.16461 shutdown 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 msgr2=0x5608d1824cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb80409be20 tx=0x7fb80409b8b0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 shutdown_connections 2024-03-27T08:41:37.642 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x5608d18921c0 0x5608d18945e0 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608d181b4e0 0x5608d1825b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x5608d1816370 0x5608d1824cc0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 --2- 172.21.15.164:0/1941325244 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x5608d1815980 0x5608d1824780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 >> 172.21.15.164:0/1941325244 conn(0x5608d1810ef0 msgr2=0x5608d1817690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb809600640 0 client.16461 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 shutdown_connections 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 1 -- 172.21.15.164:0/1941325244 wait complete. 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.650+0000 7fb825787740 20 client.16461 trim_cache size 0 max 16384 2024-03-27T08:41:37.643 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 msgr2=0x7fb8000a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 0x7fb8000a5bf0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb80c02c6c0 tx=0x7fb80c032610 comp rx=0 tx=0).stop 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 msgr2=0x7fb81c19a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:37.644 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fb80400c890 tx=0x7fb80400cd50 comp rx=0 tx=0).stop 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 shutdown_connections 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb8000a3730 0x7fb8000a5bf0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb81c109a30 0x7fb81c1a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb81c075b10 0x7fb81c19a500 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 --2- 172.21.15.164:0/2964432323 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb81c074530 0x7fb81c199fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 >> 172.21.15.164:0/2964432323 conn(0x7fb81c0fd110 msgr2=0x7fb81c1059c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 shutdown_connections 2024-03-27T08:41:37.645 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:37.651+0000 7fb822a00640 1 -- 172.21.15.164:0/2964432323 wait complete. 2024-03-27T08:41:39.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:38 smithi164 ceph-mon[31788]: pgmap v630: 97 pgs: 97 active+clean; 109 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 247 KiB/s wr, 133 op/s 2024-03-27T08:41:39.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:38 smithi167 ceph-mon[34903]: pgmap v630: 97 pgs: 97 active+clean; 109 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 247 KiB/s wr, 133 op/s 2024-03-27T08:41:39.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:38 smithi173 ceph-mon[35397]: pgmap v630: 97 pgs: 97 active+clean; 109 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 202 KiB/s rd, 247 KiB/s wr, 133 op/s 2024-03-27T08:41:40.870 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:40 smithi167 ceph-mon[34903]: pgmap v631: 97 pgs: 97 active+clean; 72 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 339 KiB/s wr, 150 op/s 2024-03-27T08:41:41.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:40 smithi164 ceph-mon[31788]: pgmap v631: 97 pgs: 97 active+clean; 72 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 339 KiB/s wr, 150 op/s 2024-03-27T08:41:41.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:40 smithi173 ceph-mon[35397]: pgmap v631: 97 pgs: 97 active+clean; 72 MiB data, 699 MiB used, 1.0 TiB / 1.0 TiB avail; 306 KiB/s rd, 339 KiB/s wr, 150 op/s 2024-03-27T08:41:43.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:42 smithi164 ceph-mon[31788]: pgmap v632: 97 pgs: 97 active+clean; 73 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 440 KiB/s wr, 130 op/s 2024-03-27T08:41:43.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:42 smithi167 ceph-mon[34903]: pgmap v632: 97 pgs: 97 active+clean; 73 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 440 KiB/s wr, 130 op/s 2024-03-27T08:41:43.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:42 smithi173 ceph-mon[35397]: pgmap v632: 97 pgs: 97 active+clean; 73 MiB data, 700 MiB used, 1.0 TiB / 1.0 TiB avail; 397 KiB/s rd, 440 KiB/s wr, 130 op/s 2024-03-27T08:41:45.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:44 smithi164 ceph-mon[31788]: pgmap v633: 97 pgs: 97 active+clean; 73 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 438 KiB/s wr, 148 op/s 2024-03-27T08:41:45.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:44 smithi167 ceph-mon[34903]: pgmap v633: 97 pgs: 97 active+clean; 73 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 438 KiB/s wr, 148 op/s 2024-03-27T08:41:45.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:44 smithi173 ceph-mon[35397]: pgmap v633: 97 pgs: 97 active+clean; 73 MiB data, 743 MiB used, 1.0 TiB / 1.0 TiB avail; 396 KiB/s rd, 438 KiB/s wr, 148 op/s 2024-03-27T08:41:47.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:46 smithi164 ceph-mon[31788]: pgmap v634: 97 pgs: 97 active+clean; 74 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 612 KiB/s wr, 171 op/s 2024-03-27T08:41:47.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:46 smithi167 ceph-mon[34903]: pgmap v634: 97 pgs: 97 active+clean; 74 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 612 KiB/s wr, 171 op/s 2024-03-27T08:41:47.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:46 smithi173 ceph-mon[35397]: pgmap v634: 97 pgs: 97 active+clean; 74 MiB data, 748 MiB used, 1.0 TiB / 1.0 TiB avail; 609 KiB/s rd, 612 KiB/s wr, 171 op/s 2024-03-27T08:41:49.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:48 smithi164 ceph-mon[31788]: pgmap v635: 97 pgs: 97 active+clean; 74 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 434 KiB/s wr, 158 op/s 2024-03-27T08:41:49.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:48 smithi167 ceph-mon[34903]: pgmap v635: 97 pgs: 97 active+clean; 74 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 434 KiB/s wr, 158 op/s 2024-03-27T08:41:49.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:48 smithi173 ceph-mon[35397]: pgmap v635: 97 pgs: 97 active+clean; 74 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 430 KiB/s rd, 434 KiB/s wr, 158 op/s 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.798+0000 7f441e200640 1 -- 172.21.15.164:0/18113116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418076510 msgr2=0x7f4418076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.798+0000 7f441e200640 1 --2- 172.21.15.164:0/18113116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418076510 0x7f4418076930 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f4408009ca0 tx=0x7f440802c100 comp rx=0 tx=0).stop 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 -- 172.21.15.164:0/18113116 shutdown_connections 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 --2- 172.21.15.164:0/18113116 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 0x7f4418078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 --2- 172.21.15.164:0/18113116 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418077750 0x7f4418077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 --2- 172.21.15.164:0/18113116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418076510 0x7f4418076930 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 -- 172.21.15.164:0/18113116 >> 172.21.15.164:0/18113116 conn(0x7f44180ff340 msgr2=0x7f4418101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.791 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 -- 172.21.15.164:0/18113116 shutdown_connections 2024-03-27T08:41:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.799+0000 7f441e200640 1 -- 172.21.15.164:0/18113116 wait complete. 2024-03-27T08:41:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.800+0000 7f441e200640 1 Processor -- start 2024-03-27T08:41:50.792 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.800+0000 7f441e200640 1 -- start start 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418077750 0x7f441819e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 0x7f44181a5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113df0 con 0x7f4418076510 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113c70 con 0x7f4418077750 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f441e200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4418113f70 con 0x7f44180780f0 2024-03-27T08:41:50.793 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34906/0 (socket says 172.21.15.164:34906) 2024-03-27T08:41:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 -- 172.21.15.164:0/2877467821 learned_addr learned my addr 172.21.15.164:0/2877467821 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:50.794 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4416a00640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418077750 0x7f441819e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417e00640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 0x7f44181a5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 -- 172.21.15.164:0/2877467821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 msgr2=0x7f44181a5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 0x7f44181a5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 -- 172.21.15.164:0/2877467821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418077750 msgr2=0x7f441819e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418077750 0x7f441819e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.801+0000 7f4417400640 1 -- 172.21.15.164:0/2877467821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44181a5fb0 con 0x7f4418076510 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f4417400640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4408032600 tx=0x7f4408034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f440fe00640 1 -- 172.21.15.164:0/2877467821 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408039050 con 0x7f4418076510 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f440fe00640 1 -- 172.21.15.164:0/2877467821 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f440803a040 con 0x7f4418076510 2024-03-27T08:41:50.795 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44181a6240 con 0x7f4418076510 2024-03-27T08:41:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f440fe00640 1 -- 172.21.15.164:0/2877467821 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4408004840 con 0x7f4418076510 2024-03-27T08:41:50.796 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.802+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44181a6730 con 0x7f4418076510 2024-03-27T08:41:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 Processor -- start 2024-03-27T08:41:50.799 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f440fe00640 1 -- 172.21.15.164:0/2877467821 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4408004040 con 0x7f4418076510 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 -- start start 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad165da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dcad0cad10 con 0x55dcad166370 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dcad073260 con 0x55dcad16b4e0 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4420f9f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dcad0c6cc0 con 0x55dcad165980 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.806+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:51740/0 (socket says 172.21.15.164:51740) 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34922/0 (socket says 172.21.15.164:34922) 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 -- 172.21.15.164:0/2507672921 learned_addr learned my addr 172.21.15.164:0/2507672921 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4417e00640 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 -- 172.21.15.164:0/2507672921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 msgr2=0x55dcad165da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.800 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad165da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 -- 172.21.15.164:0/2507672921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 msgr2=0x55dcad16ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 -- 172.21.15.164:0/2507672921 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcad06aaa0 con 0x55dcad16b4e0 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4417400640 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f440fe00640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 0x7f43fc0a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.801 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.807+0000 7f4416a00640 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f440400bcb0 tx=0x7f44040107a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7fa0e4d7399e37f4 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.808+0000 7f440fe00640 1 -- 172.21.15.164:0/2877467821 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f44080f2630 con 0x7f4418076510 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.808+0000 7f4403e00640 1 -- 172.21.15.164:0/2507672921 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4404004030 con 0x55dcad16b4e0 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.808+0000 7f4417e00640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 0x7f43fc0a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.808+0000 7f4403e00640 1 -- 172.21.15.164:0/2507672921 <== mon.2 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f44040041d0 con 0x55dcad16b4e0 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.808+0000 7f4403e00640 1 -- 172.21.15.164:0/2507672921 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44040116c0 con 0x55dcad16b4e0 2024-03-27T08:41:50.804 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- 172.21.15.164:0/2507672921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 msgr2=0x55dcad16d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4417e00640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 0x7f43fc0a5b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55dcad166bd0 tx=0x7f441000c520 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f440400bcb0 tx=0x7f44040107a0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- 172.21.15.164:0/2507672921 shutdown_connections 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad16d970 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad16ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2507672921 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad165da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- 172.21.15.164:0/2507672921 >> 172.21.15.164:0/2507672921 conn(0x55dcad160ef0 msgr2=0x55dcad1612f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- 172.21.15.164:0/2507672921 shutdown_connections 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- 172.21.15.164:0/2507672921 wait complete. 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.809+0000 7f4420f9f740 1 -- start start 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 Processor -- start 2024-03-27T08:41:50.805 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad16fc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x55dcad16e490 con 0x55dcad166370 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dcad086630 con 0x55dcad16b4e0 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x55dcad16e610 con 0x55dcad165980 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4420f9f740 10 client.0 _ll_register_callbacks cb 0x55dcad08bc50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4416a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4417e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4416a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34938/0 (socket says 172.21.15.164:34938) 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4416a00640 1 -- 172.21.15.164:0/354655084 learned_addr learned my addr 172.21.15.164:0/354655084 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.810+0000 7f4417e00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.164:51752/0 (socket says 172.21.15.164:51752) 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417400640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad16fc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.806 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 -- 172.21.15.164:0/354655084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 msgr2=0x55dcad16fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad16fc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 -- 172.21.15.164:0/354655084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 msgr2=0x55dcad1701d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 -- 172.21.15.164:0/354655084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcad0925f0 con 0x55dcad16b4e0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4416a00640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4417e00640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441000c900 tx=0x7f4410004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca4b176766b21a69 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.811+0000 7f4400c00640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mon.2 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4410023070 con 0x55dcad16b4e0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mon.2 v2:172.21.15.167:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4410005220 con 0x55dcad16b4e0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f44040041d0 con 0x55dcad16b4e0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mon.2 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f441002e050 con 0x55dcad16b4e0 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4420f9f740 10 client.36146 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:50.807 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dcacddf210 con 0x55dcad16b4e0 2024-03-27T08:41:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.812+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mon.2 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f44040041d0 con 0x55dcad16b4e0 2024-03-27T08:41:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mon.2 v2:172.21.15.167:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f441000f040 con 0x55dcad16b4e0 2024-03-27T08:41:50.809 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 10 client.36146 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 10 client.36146 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 20 client.36146 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad17bc20 0x55dcad17e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 4 client.36146 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dcad0d8250 con 0x55dcad17bc20 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.813+0000 7f4417400640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad17bc20 0x55dcad17e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.814+0000 7f4417400640 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad17bc20 0x55dcad17e080 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f284fa4ba688c739 server_cookie=bdcf9a601a069ce in_seq=0 out_seq=0 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.814+0000 7f4400c00640 10 client.36146 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.815+0000 7f4400c00640 1 -- 172.21.15.164:0/354655084 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55dcad0d8250 con 0x55dcad17bc20 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.815+0000 7f4400c00640 10 client.36146 handle_command_reply: tid=0 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.815+0000 7f4420f9f740 1 client.36146 shutdown 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 msgr2=0x55dcad177210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.810 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f441000c900 tx=0x7f4410004730 comp rx=0 tx=0).stop 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 shutdown_connections 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad17bc20 0x55dcad17e080 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad177210 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad166370 0x55dcad1701d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 --2- 172.21.15.164:0/354655084 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad165980 0x55dcad16fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4400c00640 0 client.36146 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 >> 172.21.15.164:0/354655084 conn(0x55dcad160ef0 msgr2=0x55dcad1600f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 shutdown_connections 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 1 -- 172.21.15.164:0/354655084 wait complete. 2024-03-27T08:41:50.811 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.816+0000 7f4420f9f740 20 client.36146 trim_cache size 0 max 16384 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 Processor -- start 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 -- start start 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad166370 0x55dcad1771d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad16b4e0 0x55dcad164690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f44181b1e80 con 0x55dcad165980 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44181af690 con 0x55dcad166370 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4420f9f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44181ad4e0 con 0x55dcad16b4e0 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.827 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4416a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad166370 0x55dcad1771d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34952/0 (socket says 172.21.15.164:34952) 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.833+0000 7f4417400640 1 -- 172.21.15.164:0/1508109123 learned_addr learned my addr 172.21.15.164:0/1508109123 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417e00640 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad16b4e0 0x55dcad164690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 -- 172.21.15.164:0/1508109123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad16b4e0 msgr2=0x55dcad164690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad16b4e0 0x55dcad164690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 -- 172.21.15.164:0/1508109123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad166370 msgr2=0x55dcad1771d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad166370 0x55dcad1771d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 -- 172.21.15.164:0/1508109123 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dcaceab620 con 0x55dcad165980 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4417400640 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4408000f80 tx=0x7f44080f8550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a40c9cc65fe158b2 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4403400640 1 -- 172.21.15.164:0/1508109123 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080be650 con 0x55dcad165980 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.834+0000 7f4403400640 1 -- 172.21.15.164:0/1508109123 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4408009540 con 0x55dcad165980 2024-03-27T08:41:50.828 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4403400640 1 -- 172.21.15.164:0/1508109123 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080be470 con 0x55dcad165980 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 -- 172.21.15.164:0/1508109123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 msgr2=0x55dcad164150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4408000f80 tx=0x7f44080f8550 comp rx=0 tx=0).stop 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 -- 172.21.15.164:0/1508109123 shutdown_connections 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad16b4e0 0x55dcad164690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad166370 0x55dcad1771d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 --2- 172.21.15.164:0/1508109123 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad164150 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.832 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 -- 172.21.15.164:0/1508109123 >> 172.21.15.164:0/1508109123 conn(0x55dcad160ef0 msgr2=0x55dcad167690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 -- 172.21.15.164:0/1508109123 shutdown_connections 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.835+0000 7f4420f9f740 1 -- 172.21.15.164:0/1508109123 wait complete. 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.836+0000 7f4420f9f740 1 -- start start 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.836+0000 7f4420f9f740 1 Processor -- start 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.836+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.836+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad166370 0x55dcad174cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.836+0000 7f4420f9f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad175cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4420f9f740 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f44181adb50 con 0x55dcad165980 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4420f9f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f44181aefc0 con 0x55dcad16b4e0 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4420f9f740 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f44181ae220 con 0x55dcad166370 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4420f9f740 10 client.0 _ll_register_callbacks cb 0x7f4410016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:34962/0 (socket says 172.21.15.164:34962) 2024-03-27T08:41:50.833 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 -- 172.21.15.164:0/2601052564 learned_addr learned my addr 172.21.15.164:0/2601052564 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417e00640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad175cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 -- 172.21.15.164:0/2601052564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad166370 msgr2=0x55dcad174cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad166370 0x55dcad174cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 -- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 msgr2=0x55dcad175cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad175cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 -- 172.21.15.164:0/2601052564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dcad1762b0 con 0x55dcad165980 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4417400640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f44080f0190 tx=0x7f44080be6d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50060d173a73e654 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.837+0000 7f4400c00640 10 client.0 ms_handle_connect on v2:172.21.15.164:3300/0 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f44080098b0 con 0x55dcad165980 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mon.0 v2:172.21.15.164:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f44080bb180 con 0x55dcad165980 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4408009540 con 0x55dcad165980 2024-03-27T08:41:50.834 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f44080bf210 con 0x55dcad165980 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 10 client.16479 fetch_fsmap learned FSMap version 31 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x55dcad1e1fc0 con 0x55dcad165980 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mon.0 v2:172.21.15.164:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4408009540 con 0x55dcad165980 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mon.0 v2:172.21.15.164:3300/0 5 ==== fsmap(e 31) ==== 8362+0+0 (secure 0 0 0) 0x7f4408004b40 con 0x55dcad165980 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 10 client.16479 fetch_fsmap finished waiting for FSMap version 31 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 10 client.16479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 20 client.16479 populate_metadata read hostname 'smithi164' 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.838+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad1e25e0 0x55dcad1e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.839+0000 7f4420f9f740 4 client.16479 mds_command: new command op to 34502 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.839+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 --> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dcad0d25a0 con 0x55dcad1e25e0 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.839+0000 7f4416a00640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad1e25e0 0x55dcad1e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.839+0000 7f4416a00640 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad1e25e0 0x55dcad1e4a00 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec07f5fa4d4bc03 server_cookie=7507bd4dca1d62d6 in_seq=0 out_seq=0 2024-03-27T08:41:50.835 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.839+0000 7f4400c00640 10 client.16479 ms_handle_connect on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.925+0000 7f4400c00640 1 -- 172.21.15.164:0/2601052564 <== mds.0 v2:172.21.15.167:6838/2821873023 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dcad0d25a0 con 0x55dcad1e25e0 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.925+0000 7f4400c00640 10 client.16479 handle_command_reply: tid=0 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.925+0000 7f4420f9f740 1 client.16479 shutdown 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 msgr2=0x55dcad174770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f44080f0190 tx=0x7f44080be6d0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 shutdown_connections 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:6838/2821873023,v1:172.21.15.167:6839/2821873023] conn(0x55dcad1e25e0 0x55dcad1e4a00 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dcad16b4e0 0x55dcad175cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x55dcad166370 0x55dcad174cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4400c00640 0 client.16479 ms_handle_reset on v2:172.21.15.167:6838/2821873023 2024-03-27T08:41:50.919 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 --2- 172.21.15.164:0/2601052564 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x55dcad165980 0x55dcad174770 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 >> 172.21.15.164:0/2601052564 conn(0x55dcad160ef0 msgr2=0x55dcad164150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 shutdown_connections 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 1 -- 172.21.15.164:0/2601052564 wait complete. 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.926+0000 7f4420f9f740 20 client.16479 trim_cache size 0 max 16384 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:{ 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "message": "", 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout: "return_code": 0 2024-03-27T08:41:50.920 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stdout:} 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 msgr2=0x7f43fc0a5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 0x7f43fc0a5b70 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55dcad166bd0 tx=0x7f441000c520 comp rx=0 tx=0).stop 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 msgr2=0x7f441819e3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4408032600 tx=0x7f4408034cd0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 shutdown_connections 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f43fc0a36b0 0x7f43fc0a5b70 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f44180780f0 0x7f44181a5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.921 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4418077750 0x7f441819e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 --2- 172.21.15.164:0/2877467821 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4418076510 0x7f441819e3e0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:41:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 >> 172.21.15.164:0/2877467821 conn(0x7f44180ff340 msgr2=0x7f4418100e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:41:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 shutdown_connections 2024-03-27T08:41:50.922 INFO:teuthology.task.background_exec.ubuntu@smithi164.front.sepia.ceph.com.smithi164.stderr:2024-03-27T08:41:50.927+0000 7f441e200640 1 -- 172.21.15.164:0/2877467821 wait complete. 2024-03-27T08:41:51.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:50 smithi164 ceph-mon[31788]: pgmap v636: 97 pgs: 97 active+clean; 73 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 440 KiB/s wr, 166 op/s 2024-03-27T08:41:51.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:50 smithi167 ceph-mon[34903]: pgmap v636: 97 pgs: 97 active+clean; 73 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 440 KiB/s wr, 166 op/s 2024-03-27T08:41:51.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:50 smithi173 ceph-mon[35397]: pgmap v636: 97 pgs: 97 active+clean; 73 MiB data, 746 MiB used, 1.0 TiB / 1.0 TiB avail; 435 KiB/s rd, 440 KiB/s wr, 166 op/s 2024-03-27T08:41:53.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:52 smithi164 ceph-mon[31788]: pgmap v637: 97 pgs: 97 active+clean; 73 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 504 KiB/s wr, 162 op/s 2024-03-27T08:41:53.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:52 smithi167 ceph-mon[34903]: pgmap v637: 97 pgs: 97 active+clean; 73 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 504 KiB/s wr, 162 op/s 2024-03-27T08:41:53.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:52 smithi173 ceph-mon[35397]: pgmap v637: 97 pgs: 97 active+clean; 73 MiB data, 747 MiB used, 1.0 TiB / 1.0 TiB avail; 490 KiB/s rd, 504 KiB/s wr, 162 op/s 2024-03-27T08:41:55.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:54 smithi164 ceph-mon[31788]: pgmap v638: 97 pgs: 97 active+clean; 72 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 496 KiB/s wr, 178 op/s 2024-03-27T08:41:55.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:54 smithi167 ceph-mon[34903]: pgmap v638: 97 pgs: 97 active+clean; 72 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 496 KiB/s wr, 178 op/s 2024-03-27T08:41:55.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:54 smithi173 ceph-mon[35397]: pgmap v638: 97 pgs: 97 active+clean; 72 MiB data, 752 MiB used, 1.0 TiB / 1.0 TiB avail; 509 KiB/s rd, 496 KiB/s wr, 178 op/s 2024-03-27T08:41:57.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:56 smithi164 ceph-mon[31788]: pgmap v639: 97 pgs: 97 active+clean; 71 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 545 KiB/s wr, 186 op/s 2024-03-27T08:41:57.068 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:56 smithi167 ceph-mon[34903]: pgmap v639: 97 pgs: 97 active+clean; 71 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 545 KiB/s wr, 186 op/s 2024-03-27T08:41:57.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:56 smithi173 ceph-mon[35397]: pgmap v639: 97 pgs: 97 active+clean; 71 MiB data, 760 MiB used, 1.0 TiB / 1.0 TiB avail; 563 KiB/s rd, 545 KiB/s wr, 186 op/s 2024-03-27T08:41:59.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:58 smithi164 ceph-mon[31788]: pgmap v640: 97 pgs: 97 active+clean; 70 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 167 op/s 2024-03-27T08:41:59.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:58 smithi167 ceph-mon[34903]: pgmap v640: 97 pgs: 97 active+clean; 70 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 167 op/s 2024-03-27T08:41:59.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:58 smithi173 ceph-mon[35397]: pgmap v640: 97 pgs: 97 active+clean; 70 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 354 KiB/s rd, 373 KiB/s wr, 167 op/s 2024-03-27T08:42:00.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:41:59 smithi164 ceph-mon[31788]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 455 KiB/s wr, 184 op/s 2024-03-27T08:42:00.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:41:59 smithi167 ceph-mon[34903]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 455 KiB/s wr, 184 op/s 2024-03-27T08:42:00.074 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:41:59 smithi173 ceph-mon[35397]: pgmap v641: 97 pgs: 97 active+clean; 67 MiB data, 736 MiB used, 1.0 TiB / 1.0 TiB avail; 447 KiB/s rd, 455 KiB/s wr, 184 op/s 2024-03-27T08:42:01.185 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-03-27T08:42:01.185 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-27T08:42:02.261 DEBUG:teuthology.parallel:result is None 2024-03-27T08:42:02.262 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-27T08:42:02.378 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-27T08:42:02.378 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-03-27T08:42:02.389 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:42:02.414 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-03-27T08:42:02.441 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-03-27T08:42:02.441 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-27T08:42:02.442 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-03-27T08:42:02.452 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 -- 172.21.15.164:0/3733765283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 msgr2=0x7fb46410c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 --2- 172.21.15.164:0/3733765283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb46410c1b0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009ca0 tx=0x7fb45c02c0f0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 -- 172.21.15.164:0/3733765283 shutdown_connections 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 --2- 172.21.15.164:0/3733765283 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb46410c1b0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 --2- 172.21.15.164:0/3733765283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 0x7fb4641053e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 --2- 172.21.15.164:0/3733765283 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 0x7fb464104190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 -- 172.21.15.164:0/3733765283 >> 172.21.15.164:0/3733765283 conn(0x7fb4640ff300 msgr2=0x7fb464101720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 -- 172.21.15.164:0/3733765283 shutdown_connections 2024-03-27T08:42:02.677 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.684+0000 7fb468c00640 1 -- 172.21.15.164:0/3733765283 wait complete. 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 Processor -- start 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 -- start start 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 0x7fb46419a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 0x7fb46419a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410f9c0 con 0x7fb464105920 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410f840 con 0x7fb464104f60 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.685+0000 7fb468c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb46410fb40 con 0x7fb464103d70 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40552/0 (socket says 172.21.15.164:40552) 2024-03-27T08:42:02.680 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 -- 172.21.15.164:0/752018453 learned_addr learned my addr 172.21.15.164:0/752018453 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb461e00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 0x7fb46419a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb459400640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 0x7fb46419a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 -- 172.21.15.164:0/752018453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 msgr2=0x7fb46419a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 0x7fb46419a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 -- 172.21.15.164:0/752018453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 msgr2=0x7fb46419a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 0x7fb46419a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 -- 172.21.15.164:0/752018453 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4641a1c20 con 0x7fb464105920 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.686+0000 7fb462800640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb45c037040 tx=0x7fb45c032900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.687+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c039050 con 0x7fb464105920 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.687+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb45c03a040 con 0x7fb464105920 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.687+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4641a1eb0 con 0x7fb464105920 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.687+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c0406b0 con 0x7fb464105920 2024-03-27T08:42:02.681 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.687+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4641a2370 con 0x7fb464105920 2024-03-27T08:42:02.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.688+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb46410b030 con 0x7fb464105920 2024-03-27T08:42:02.682 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.690+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb45c004040 con 0x7fb464105920 2024-03-27T08:42:02.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.691+0000 7fb45b400640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 0x7fb4480a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:02.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.691+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb45c0f2b20 con 0x7fb464105920 2024-03-27T08:42:02.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.691+0000 7fb461e00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 0x7fb4480a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:02.684 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.692+0000 7fb461e00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 0x7fb4480a5b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb4540058c0 tx=0x7fb454005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:02.688 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.696+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb45c0bf6a0 con 0x7fb464105920 2024-03-27T08:42:02.877 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.884+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb4640627f0 con 0x7fb464105920 2024-03-27T08:42:02.879 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.887+0000 7fb45b400640 1 -- 172.21.15.164:0/752018453 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7fb45c0befa0 con 0x7fb464105920 2024-03-27T08:42:02.880 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:42:02.880 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:42:02.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 msgr2=0x7fb4480a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:02.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 0x7fb4480a5b50 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fb4540058c0 tx=0x7fb454005850 comp rx=0 tx=0).stop 2024-03-27T08:42:02.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 msgr2=0x7fb4641a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:02.882 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fb45c037040 tx=0x7fb45c032900 comp rx=0 tx=0).stop 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 shutdown_connections 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4480a3690 0x7fb4480a5b50 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb464105920 0x7fb4641a15b0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb464104f60 0x7fb46419a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 --2- 172.21.15.164:0/752018453 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb464103d70 0x7fb46419a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 >> 172.21.15.164:0/752018453 conn(0x7fb4640ff300 msgr2=0x7fb464108200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 shutdown_connections 2024-03-27T08:42:02.883 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:02.890+0000 7fb468c00640 1 -- 172.21.15.164:0/752018453 wait complete. 2024-03-27T08:42:02.898 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:02 smithi164 ceph-mon[31788]: pgmap v642: 97 pgs: 97 active+clean; 68 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 644 KiB/s wr, 194 op/s 2024-03-27T08:42:02.903 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:42:02.904 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:42:03.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:02 smithi167 ceph-mon[34903]: pgmap v642: 97 pgs: 97 active+clean; 68 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 644 KiB/s wr, 194 op/s 2024-03-27T08:42:03.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:02 smithi173 ceph-mon[35397]: pgmap v642: 97 pgs: 97 active+clean; 68 MiB data, 735 MiB used, 1.0 TiB / 1.0 TiB avail; 612 KiB/s rd, 644 KiB/s wr, 194 op/s 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 -- 172.21.15.164:0/744283299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 msgr2=0x7f4e7010beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 --2- 172.21.15.164:0/744283299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e7010beb0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009ca0 tx=0x7f4e6802c100 comp rx=0 tx=0).stop 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 -- 172.21.15.164:0/744283299 shutdown_connections 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 --2- 172.21.15.164:0/744283299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e7010beb0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 --2- 172.21.15.164:0/744283299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e70074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 --2- 172.21.15.164:0/744283299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e70073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 -- 172.21.15.164:0/744283299 >> 172.21.15.164:0/744283299 conn(0x7f4e700fd0f0 msgr2=0x7f4e700ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 -- 172.21.15.164:0/744283299 shutdown_connections 2024-03-27T08:42:03.107 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.114+0000 7f4e77c00640 1 -- 172.21.15.164:0/744283299 wait complete. 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.115+0000 7f4e77c00640 1 Processor -- start 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.115+0000 7f4e77c00640 1 -- start start 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.115+0000 7f4e77c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e7019a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.115+0000 7f4e77c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e7019a540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.115+0000 7f4e77c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e77c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7010f990 con 0x7f4e70109a20 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e77c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7010f810 con 0x7f4e700745b0 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e77c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7010fb10 con 0x7f4e70075b90 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.110 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40570/0 (socket says 172.21.15.164:40570) 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 -- 172.21.15.164:0/4283609376 learned_addr learned my addr 172.21.15.164:0/4283609376 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75200640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e7019a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e6fe00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e7019a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 -- 172.21.15.164:0/4283609376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 msgr2=0x7f4e7019a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e7019a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 -- 172.21.15.164:0/4283609376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 msgr2=0x7f4e7019a000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e7019a000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75c00640 1 -- 172.21.15.164:0/4283609376 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701a1c20 con 0x7f4e70109a20 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e6fe00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e7019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.116+0000 7f4e75200640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e7019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e75c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009bf0 tx=0x7f4e68034cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68039050 con 0x7f4e70109a20 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e6803a040 con 0x7f4e70109a20 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680046a0 con 0x7f4e70109a20 2024-03-27T08:42:03.111 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e701a1eb0 con 0x7f4e70109a20 2024-03-27T08:42:03.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.117+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e701a2310 con 0x7f4e70109a20 2024-03-27T08:42:03.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.118+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70108750 con 0x7f4e70109a20 2024-03-27T08:42:03.112 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.120+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f4e68003970 con 0x7f4e70109a20 2024-03-27T08:42:03.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.122+0000 7f4e6d600640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 0x7f4e580a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.122+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f4e680f31b0 con 0x7f4e70109a20 2024-03-27T08:42:03.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.122+0000 7f4e75200640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 0x7f4e580a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.114 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.122+0000 7f4e75200640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 0x7f4e580a5b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e640058c0 tx=0x7f4e64005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.116 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.124+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f4e680bfe50 con 0x7f4e70109a20 2024-03-27T08:42:03.304 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.312+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4e70062750 con 0x7f4e70109a20 2024-03-27T08:42:03.305 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.313+0000 7f4e6d600640 1 -- 172.21.15.164:0/4283609376 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7f4e680098b0 con 0x7f4e70109a20 2024-03-27T08:42:03.305 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 msgr2=0x7f4e580a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 0x7f4e580a5b50 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f4e640058c0 tx=0x7f4e64005850 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 msgr2=0x7f4e701a15b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f4e68009bf0 tx=0x7f4e68034cd0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 shutdown_connections 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f4e580a3690 0x7f4e580a5b50 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f4e70109a20 0x7f4e701a15b0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f4e70075b90 0x7f4e7019a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 --2- 172.21.15.164:0/4283609376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e700745b0 0x7f4e7019a000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.308 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.315+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 >> 172.21.15.164:0/4283609376 conn(0x7f4e700fd0f0 msgr2=0x7f4e70105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:03.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.316+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 shutdown_connections 2024-03-27T08:42:03.309 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.316+0000 7f4e77c00640 1 -- 172.21.15.164:0/4283609376 wait complete. 2024-03-27T08:42:03.325 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 -- 172.21.15.164:0/1278632307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c108070 msgr2=0x7fc71c108490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 --2- 172.21.15.164:0/1278632307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c108070 0x7fc71c108490 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc70c009900 tx=0x7fc70c02bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 -- 172.21.15.164:0/1278632307 shutdown_connections 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 --2- 172.21.15.164:0/1278632307 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 0x7fc71c1104b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 --2- 172.21.15.164:0/1278632307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c109260 0x7fc71c1096e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 --2- 172.21.15.164:0/1278632307 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c108070 0x7fc71c108490 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 -- 172.21.15.164:0/1278632307 >> 172.21.15.164:0/1278632307 conn(0x7fc71c077020 msgr2=0x7fc71c079440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 -- 172.21.15.164:0/1278632307 shutdown_connections 2024-03-27T08:42:03.538 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.545+0000 7fc720c00640 1 -- 172.21.15.164:0/1278632307 wait complete. 2024-03-27T08:42:03.540 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 Processor -- start 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 -- start start 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c108070 0x7fc71c19e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 0x7fc71c1a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c113d20 con 0x7fc71c109260 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c113ba0 con 0x7fc71c108070 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.546+0000 7fc720c00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc71c113ea0 con 0x7fc71c109c20 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40576/0 (socket says 172.21.15.164:40576) 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 -- 172.21.15.164:0/4269315814 learned_addr learned my addr 172.21.15.164:0/4269315814 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc71b400640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c108070 0x7fc71c19e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc71be00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 0x7fc71c1a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 -- 172.21.15.164:0/4269315814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 msgr2=0x7fc71c1a5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.541 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 0x7fc71c1a5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 -- 172.21.15.164:0/4269315814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c108070 msgr2=0x7fc71c19e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c108070 0x7fc71c19e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 -- 172.21.15.164:0/4269315814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc71c1a5f70 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.547+0000 7fc713e00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d950 tx=0x7fc70400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.548+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc704017070 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.548+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc704009c30 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.548+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc71c1a6260 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.548+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc70400f6b0 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.548+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc71c1a6800 con 0x7fc71c109260 2024-03-27T08:42:03.542 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.549+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc71c10f390 con 0x7fc71c109260 2024-03-27T08:42:03.543 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.551+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc704010a50 con 0x7fc71c109260 2024-03-27T08:42:03.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.552+0000 7fc718c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 0x7fc7000a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.544 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.552+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc7040cf980 con 0x7fc71c109260 2024-03-27T08:42:03.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.552+0000 7fc71b400640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 0x7fc7000a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.545 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.553+0000 7fc71b400640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 0x7fc7000a5b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02c170 tx=0x7fc70c02c820 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.549 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.557+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc704009de0 con 0x7fc71c109260 2024-03-27T08:42:03.748 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.756+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fc71c062750 con 0x7fc71c109260 2024-03-27T08:42:03.749 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.757+0000 7fc718c00640 1 -- 172.21.15.164:0/4269315814 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fc70409c500 con 0x7fc71c109260 2024-03-27T08:42:03.750 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 msgr2=0x7fc7000a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 0x7fc7000a5b50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fc70c02c170 tx=0x7fc70c02c820 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 msgr2=0x7fc71c19e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7fc70400d950 tx=0x7fc70400de10 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 shutdown_connections 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc7000a3690 0x7fc7000a5b50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc71c109c20 0x7fc71c1a5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc71c109260 0x7fc71c19e930 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 --2- 172.21.15.164:0/4269315814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc71c108070 0x7fc71c19e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.753 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.760+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 >> 172.21.15.164:0/4269315814 conn(0x7fc71c077020 msgr2=0x7fc71c10c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:03.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.761+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 shutdown_connections 2024-03-27T08:42:03.754 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.761+0000 7fc720c00640 1 -- 172.21.15.164:0/4269315814 wait complete. 2024-03-27T08:42:03.773 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:42:03.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.990+0000 7fc41cc00640 1 -- 172.21.15.164:0/3199683662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418105940 msgr2=0x7fc41810c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.990+0000 7fc41cc00640 1 --2- 172.21.15.164:0/3199683662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418105940 0x7fc41810c1d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7fc410009ca0 tx=0x7fc41002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 -- 172.21.15.164:0/3199683662 shutdown_connections 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 --2- 172.21.15.164:0/3199683662 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418105940 0x7fc41810c1d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 --2- 172.21.15.164:0/3199683662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418104f80 0x7fc418105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 --2- 172.21.15.164:0/3199683662 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418103d90 0x7fc4181041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 -- 172.21.15.164:0/3199683662 >> 172.21.15.164:0/3199683662 conn(0x7fc4180ff300 msgr2=0x7fc418101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 -- 172.21.15.164:0/3199683662 shutdown_connections 2024-03-27T08:42:03.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.991+0000 7fc41cc00640 1 -- 172.21.15.164:0/3199683662 wait complete. 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 Processor -- start 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 -- start start 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418104f80 0x7fc41819a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418105940 0x7fc4181a1620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc41810f9f0 con 0x7fc418103d90 2024-03-27T08:42:03.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc41810f870 con 0x7fc418105940 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc41cc00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc41810fb70 con 0x7fc418104f80 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc415e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc415e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40606/0 (socket says 172.21.15.164:40606) 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.992+0000 7fc415e00640 1 -- 172.21.15.164:0/1651885839 learned_addr learned my addr 172.21.15.164:0/1651885839 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc416800640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418105940 0x7fc4181a1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415400640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418104f80 0x7fc41819a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 -- 172.21.15.164:0/1651885839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418104f80 msgr2=0x7fc41819a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418104f80 0x7fc41819a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 -- 172.21.15.164:0/1651885839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418105940 msgr2=0x7fc4181a1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418105940 0x7fc4181a1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 -- 172.21.15.164:0/1651885839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4181a1c90 con 0x7fc418103d90 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc415e00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d950 tx=0x7fc40800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc408017070 con 0x7fc418103d90 2024-03-27T08:42:03.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc408009c30 con 0x7fc418103d90 2024-03-27T08:42:03.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40800f620 con 0x7fc418103d90 2024-03-27T08:42:03.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4181a1f80 con 0x7fc418103d90 2024-03-27T08:42:03.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.993+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4181a23e0 con 0x7fc418103d90 2024-03-27T08:42:03.988 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.995+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc41810b180 con 0x7fc418103d90 2024-03-27T08:42:03.989 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.997+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc40801a070 con 0x7fc418103d90 2024-03-27T08:42:03.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.998+0000 7fc40ea00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 0x7fc3fc0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:03.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.998+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc4080cf800 con 0x7fc418103d90 2024-03-27T08:42:03.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.998+0000 7fc415400640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 0x7fc3fc0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:03.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:03.999+0000 7fc415400640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 0x7fc3fc0a5b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc404005fd0 tx=0x7fc404005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:03.995 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.003+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc408009de0 con 0x7fc418103d90 2024-03-27T08:42:04.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:03 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/752018453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:04.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:03 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4283609376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:03 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/752018453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:04.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:03 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4283609376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:03 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/752018453' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:04.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:03 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4283609376' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:04.184 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.191+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc41802d620 con 0x7fc418103d90 2024-03-27T08:42:04.185 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.192+0000 7fc40ea00640 1 -- 172.21.15.164:0/1651885839 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fc40809c380 con 0x7fc418103d90 2024-03-27T08:42:04.185 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:42:04.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 msgr2=0x7fc3fc0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:04.187 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 0x7fc3fc0a5b50 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fc404005fd0 tx=0x7fc404005850 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 msgr2=0x7fc41819a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc40800d950 tx=0x7fc40800de10 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 shutdown_connections 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc3fc0a3690 0x7fc3fc0a5b50 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc418105940 0x7fc4181a1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc418104f80 0x7fc41819a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 --2- 172.21.15.164:0/1651885839 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc418103d90 0x7fc41819a070 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 >> 172.21.15.164:0/1651885839 conn(0x7fc4180ff300 msgr2=0x7fc418108350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 shutdown_connections 2024-03-27T08:42:04.188 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.195+0000 7fc41cc00640 1 -- 172.21.15.164:0/1651885839 wait complete. 2024-03-27T08:42:04.206 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 -- 172.21.15.164:0/2223938538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73240745b0 msgr2=0x7f7324074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 --2- 172.21.15.164:0/2223938538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73240745b0 0x7f7324074a30 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f7310009900 tx=0x7f731002bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 -- 172.21.15.164:0/2223938538 shutdown_connections 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 --2- 172.21.15.164:0/2223938538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324109a40 0x7f732410bed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 --2- 172.21.15.164:0/2223938538 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f73240745b0 0x7f7324074a30 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 --2- 172.21.15.164:0/2223938538 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f7324075b90 0x7f7324073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 -- 172.21.15.164:0/2223938538 >> 172.21.15.164:0/2223938538 conn(0x7f73240fd0f0 msgr2=0x7f73240ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 -- 172.21.15.164:0/2223938538 shutdown_connections 2024-03-27T08:42:04.420 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.427+0000 7f732c400640 1 -- 172.21.15.164:0/2223938538 wait complete. 2024-03-27T08:42:04.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 Processor -- start 2024-03-27T08:42:04.422 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 -- start start 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73240745b0 0x7f732419a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324075b90 0x7f732419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f732410fa20 con 0x7f7324109a40 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f732410f8a0 con 0x7f7324075b90 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.428+0000 7f732c400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f732410fba0 con 0x7f73240745b0 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:40616/0 (socket says 172.21.15.164:40616) 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 -- 172.21.15.164:0/2177138716 learned_addr learned my addr 172.21.15.164:0/2177138716 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f7329000640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324075b90 0x7f732419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f7329a00640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73240745b0 0x7f732419a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 -- 172.21.15.164:0/2177138716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73240745b0 msgr2=0x7f732419a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73240745b0 0x7f732419a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.423 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 -- 172.21.15.164:0/2177138716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324075b90 msgr2=0x7f732419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324075b90 0x7f732419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 -- 172.21.15.164:0/2177138716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73241a1cc0 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.429+0000 7f732a400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f731c00d750 tx=0x7f731c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.430+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c017070 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.430+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f731c0054f0 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.430+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73241a1fb0 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.430+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f731c004cf0 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.430+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73241a2470 con 0x7f7324109a40 2024-03-27T08:42:04.424 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.431+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7324108770 con 0x7f7324109a40 2024-03-27T08:42:04.425 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.433+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f731c004e90 con 0x7f7324109a40 2024-03-27T08:42:04.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.434+0000 7f7322000640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 0x7f730c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:04.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.435+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f731c0cf660 con 0x7f7324109a40 2024-03-27T08:42:04.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.435+0000 7f7329a00640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 0x7f730c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:04.427 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.435+0000 7f7329a00640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 0x7f730c0a5b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7318005fd0 tx=0x7f7318009870 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:04.431 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.439+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f731c09c240 con 0x7f7324109a40 2024-03-27T08:42:04.683 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.691+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7324062780 con 0x7f7324109a40 2024-03-27T08:42:04.697 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.704+0000 7f7322000640 1 -- 172.21.15.164:0/2177138716 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v18) ==== 81+0+743815 (secure 0 0 0) 0x7f731c09bb40 con 0x7f7324109a40 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "epoch": 18, 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "active_gid": 14152, 2024-03-27T08:42:04.709 INFO:teuthology.orchestra.run.smithi164.stdout: "active_name": "x", 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "active_addrs": { 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "addrvec": [ 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v2", 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:6800", 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2033158356 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v1", 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:6801", 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2033158356 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.710 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "active_addr": "172.21.15.164:6801/2033158356", 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "active_change": "2024-03-27T08:23:17.136750+0000", 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "active_mgr_features": 4540701547738038271, 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "available": true, 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "standbys": [ 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "gid": 24112, 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "z", 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "mgr_features": 4540701547738038271, 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "available_modules": [ 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "alerts", 2024-03-27T08:42:04.711 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T08:42:04.712 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.713 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.714 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.715 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.716 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.717 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_destination": { 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_destination", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.718 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email address to send alerts to", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_from_name": { 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_from_name", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "Ceph", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.719 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email From: name", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_host": { 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_host", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.720 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP server", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_password": { 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_password", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Password to authenticate with", 2024-03-27T08:42:04.721 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_port": { 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_port", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "465", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.722 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP port", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_sender": { 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_sender", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP envelope sender", 2024-03-27T08:42:04.723 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_ssl": { 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_ssl", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.724 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_user": { 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_user", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.725 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "User to authenticate as", 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "balancer", 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.726 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "active": { 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "active", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_time": { 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_time", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0000", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.728 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_weekday": { 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_weekday", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.729 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_max_iterations": { 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_max_iterations", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "25", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "250", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.730 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_metrics": { 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_metrics", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T08:42:04.731 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_step": { 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_step", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.5", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0.001", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "0.999", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "aggressiveness of optimization", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T08:42:04.732 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "end_time": { 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_time", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2359", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:04.733 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "end_weekday": { 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_weekday", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:04.734 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.735 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.736 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.737 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.738 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.739 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "min_score": { 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_score", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.740 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "upmap", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.741 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "crush-compat", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "none", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "read", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap-read" 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Balancer mode", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.742 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_ids": { 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_ids", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.743 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.744 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_deviation": { 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_deviation", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_optimizations": { 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_optimizations", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.746 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_down_multiplier": { 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_down_multiplier", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.747 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_refresh_rate": { 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_refresh_rate", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "20", 2024-03-27T08:42:04.748 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_starting_port": { 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_starting_port", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4721", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.749 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_ptrace": { 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_ptrace", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.750 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_interval": { 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_interval", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.751 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_memory_target_ratio": { 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:04.752 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.7", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm_log_destination": { 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm_log_destination", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.753 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "file", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "file,syslog", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "syslog" 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "cgroups_split": { 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cgroups_split", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.755 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "config_checks_enabled": { 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_checks_enabled", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.756 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "config_dashboard": { 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_dashboard", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.757 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_alertmanager": { 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_alertmanager", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_base": { 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_base", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Container image name, without the tag", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_elasticsearch": { 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_elasticsearch", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "elasticsearch container image", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_grafana": { 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_grafana", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_haproxy": { 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_haproxy", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "HAproxy container image", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.762 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_agent": { 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_agent", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger agent container image", 2024-03-27T08:42:04.763 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_collector": { 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_collector", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.764 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger collector container image", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_query": { 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_query", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.765 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger query container image", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_keepalived": { 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_keepalived", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T08:42:04.766 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Keepalived container image", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_loki": { 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_loki", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T08:42:04.767 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Loki container image", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_node_exporter": { 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_node_exporter", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.768 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_nvmeof": { 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_nvmeof", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T08:42:04.769 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Nvme-of container image", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_prometheus": { 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_prometheus", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T08:42:04.770 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_promtail": { 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_promtail", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T08:42:04.771 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Promtail container image", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_samba": { 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_samba", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T08:42:04.772 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Samba/SMB container image", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_snmp_gateway": { 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_snmp_gateway", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T08:42:04.773 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SNMP Gateway container image", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "container_init": { 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_init", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.774 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "daemon_cache_timeout": { 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "daemon_cache_timeout", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "default_cephadm_command_timeout": { 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.776 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "900", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "default_registry": { 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_registry", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.777 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "device_cache_timeout": { 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_cache_timeout", 2024-03-27T08:42:04.778 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1800", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache device inventory", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "device_enhanced_scan": { 2024-03-27T08:42:04.779 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_enhanced_scan", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "facts_cache_timeout": { 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "facts_cache_timeout", 2024-03-27T08:42:04.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache host facts data", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "grafana_dashboards_path": { 2024-03-27T08:42:04.781 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "grafana_dashboards_path", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "host_check_interval": { 2024-03-27T08:42:04.782 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "host_check_interval", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to perform a host check", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "hw_monitoring": { 2024-03-27T08:42:04.783 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hw_monitoring", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "inventory_list_all": { 2024-03-27T08:42:04.784 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "inventory_list_all", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.785 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.786 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "log_refresh_metadata": { 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_refresh_metadata", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.787 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.788 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.789 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.790 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.791 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.792 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.793 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.794 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "*", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T08:42:04.795 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "max_count_per_host": { 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_count_per_host", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.796 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of daemons per service per host", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "max_osd_draining_count": { 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_osd_draining_count", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.798 INFO:teuthology.orchestra.run.smithi164.stdout: "migration_current": { 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "migration_current", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "internal - do not modify", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.799 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "root", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.800 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm-package", 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "root" 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "oob_default_addr": { 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "oob_default_addr", 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.801 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "169.254.1.1", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "prometheus_alerts_path": { 2024-03-27T08:42:04.802 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus_alerts_path", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T08:42:04.803 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_insecure": { 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_insecure", 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.804 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_password": { 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_password", 2024-03-27T08:42:04.805 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.806 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_url": { 2024-03-27T08:42:04.807 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_url", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.808 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_username": { 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_username", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.809 INFO:teuthology.orchestra.run.smithi164.stdout: "secure_monitoring_stack": { 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "secure_monitoring_stack", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.810 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "service_discovery_port": { 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "service_discovery_port", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8765", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "cephadm service discovery port", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "ssh_config_file": { 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssh_config_file", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "use_agent": { 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_agent", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "use_repo_digest": { 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_repo_digest", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.814 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_failed_host_check": { 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_failed_host_check", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.815 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_daemons": { 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_daemons", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.816 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_hosts": { 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_hosts", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.817 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crash", 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.818 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.819 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.820 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.821 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.822 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.823 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "retain_interval": { 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retain_interval", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "31536000", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.824 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_recent_interval": { 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_recent_interval", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1209600", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.825 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dashboard", 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.826 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.827 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.829 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_ENABLED": { 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.830 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T08:42:04.831 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.834 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.835 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.836 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.837 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.838 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.839 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.840 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.841 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.842 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_URL": { 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_URL", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.843 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.844 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.845 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.846 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.847 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.848 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.849 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "{}", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.850 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.851 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.852 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.853 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.854 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.855 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.856 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.857 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.858 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.859 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.860 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.861 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.862 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.863 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.864 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "45", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.865 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.866 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:04.867 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.868 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.869 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.870 INFO:teuthology.orchestra.run.smithi164.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.872 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.873 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.874 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "cross_origin_url": { 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cross_origin_url", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.875 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "crt_file": { 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crt_file", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.876 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "debug": { 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "debug", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.877 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable/disable debug options", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "jwt_token_ttl": { 2024-03-27T08:42:04.878 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "jwt_token_ttl", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "28800", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.879 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.881 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.882 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.883 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.884 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.885 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "motd": { 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "motd", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.886 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "The message of the day", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect_resolve_ip_addr": { 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.887 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.888 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8080", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.889 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.890 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl_server_port": { 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl_server_port", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8443", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.891 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "redirect", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.892 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect" 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:04.893 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "url_prefix": { 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url_prefix", 2024-03-27T08:42:04.894 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.895 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "devicehealth", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_monitoring": { 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_monitoring", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.896 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "monitor device health metrics", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.897 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.898 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.899 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.900 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.901 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "mark_out_threshold": { 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mark_out_threshold", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2419200", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.902 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_name": { 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_name", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "device_health_metrics", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.903 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "retention_period": { 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retention_period", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15552000", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.904 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain device health metrics", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_frequency": { 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_frequency", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:04.905 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "self_heal": { 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "self_heal", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.906 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.907 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_threshold": { 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_threshold", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.908 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7257600", 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.909 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "diskprediction_local", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.910 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.911 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.912 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.913 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.914 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "predict_interval": { 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predict_interval", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.915 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "predictor_model": { 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predictor_model", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "prophetstor", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.916 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.917 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "influx", 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": false, 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "influxdb python module not found", 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.918 INFO:teuthology.orchestra.run.smithi164.stdout: "batch_size": { 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "batch_size", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5000", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.919 INFO:teuthology.orchestra.run.smithi164.stdout: "database": { 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "database", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "ceph", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.920 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": { 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hostname", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server hostname", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.921 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "30", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "5", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.922 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.923 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.924 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.925 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.926 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.927 INFO:teuthology.orchestra.run.smithi164.stdout: "password": { 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "password", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "password of InfluxDB server user", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.928 INFO:teuthology.orchestra.run.smithi164.stdout: "port": { 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "port", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8086", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server port", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:04.929 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "false", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "threads": { 2024-03-27T08:42:04.930 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threads", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "32", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "username": { 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "username", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "username of InfluxDB server user", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "verify_ssl": { 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "verify_ssl", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "true", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.933 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "insights", 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.935 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.936 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.937 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.938 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.939 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "iostat", 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.940 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.941 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.942 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.943 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.944 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.945 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "k8sevents", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_event_retention_days": { 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ceph_event_retention_days", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.946 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "config_check_secs": { 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_check_secs", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "10", 2024-03-27T08:42:04.947 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.948 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.949 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.950 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.951 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.951 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.951 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.951 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.952 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.953 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.953 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.953 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.953 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.953 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.954 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.954 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.954 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.954 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.955 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.955 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.955 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.956 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "localpool", 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "failure_domain": { 2024-03-27T08:42:04.957 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "failure_domain", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "host", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "failure domain for any created local pool", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.958 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.959 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.960 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.961 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.962 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "min_size": { 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_size", 2024-03-27T08:42:04.963 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default min_size for any created local pool", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "num_rep": { 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "num_rep", 2024-03-27T08:42:04.964 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default replica count for any created local pool", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_num": { 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_num", 2024-03-27T08:42:04.965 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "128", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "prefix": { 2024-03-27T08:42:04.966 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prefix", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name prefix for any created local pool", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.967 INFO:teuthology.orchestra.run.smithi164.stdout: "subtree": { 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "subtree", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "rack", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mds_autoscaler", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.969 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.970 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.971 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.972 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.973 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.974 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.974 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.974 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.974 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.974 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.975 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.975 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.975 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.975 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.975 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.976 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.977 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.977 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.977 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.977 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.977 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.978 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.979 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirroring", 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.981 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.982 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.982 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.982 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.982 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.982 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.983 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.984 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.985 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.985 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.985 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.985 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.986 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.987 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.988 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.989 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:04.990 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.991 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.992 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "nfs", 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:04.995 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:04.996 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:04.997 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:04.998 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:04.999 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.000 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.001 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.002 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "fail_fs": { 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "fail_fs", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.003 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.004 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.005 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.006 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.007 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.008 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.009 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator": { 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.010 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm", 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "rook", 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "test_orchestrator" 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Orchestrator backend", 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.011 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_perf_query", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.012 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.013 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.014 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.015 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.016 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.017 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_support", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.018 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.019 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.020 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.021 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.022 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.022 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.022 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.022 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.023 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.025 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.026 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_autoscaler", 2024-03-27T08:42:05.027 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.028 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.028 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.028 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.028 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.028 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.029 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.029 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.029 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.029 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.029 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.030 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.030 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.030 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.030 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.030 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.031 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.031 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.031 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.031 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.031 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.032 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.033 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.034 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.035 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.036 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.037 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.038 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.039 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "threshold": { 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threshold", 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:05.040 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1.0", 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "scaling threshold", 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "progress", 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_pg_recovery_event": { 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_pg_recovery_event", 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.042 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.044 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.045 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.046 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.047 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.048 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.049 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "max_completed_events": { 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_completed_events", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.050 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "50", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "number of past completed events to remember", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.051 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long the module is going to sleep", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus", 2024-03-27T08:42:05.052 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "cache": { 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cache", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.053 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "exclude_perf_counters": { 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "exclude_perf_counters", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.054 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.055 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.056 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.057 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.058 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.059 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools": { 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.061 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.062 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "300", 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_interval": { 2024-03-27T08:42:05.063 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_interval", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15.0", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.064 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.065 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.066 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "9283", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "stale_cache_strategy": { 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stale_cache_strategy", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "log", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.068 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "default", 2024-03-27T08:42:05.069 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "default", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "error" 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:05.070 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.071 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_support", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.072 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.073 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.074 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.075 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.076 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_snap_create": { 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_snap_create", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.077 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "mirror_snapshot_schedule": { 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.078 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "trash_purge_schedule": { 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "trash_purge_schedule", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.079 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.080 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "restful", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_auth": { 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_auth", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.081 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.082 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.083 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.084 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.085 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.086 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.087 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.088 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.089 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.090 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rgw", 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.091 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.092 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.093 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.094 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.095 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.096 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.097 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rook", 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.098 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.099 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.100 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.101 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.102 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.103 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "storage_class": { 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "storage_class", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "local", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.104 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "selftest", 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.105 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.106 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.107 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.108 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.109 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "roption1": { 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption1", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.110 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "roption2": { 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption2", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.111 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "xyz", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption1": { 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption1", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.112 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption2": { 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption2", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.113 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption3": { 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption3", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.114 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption4": { 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption4", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.115 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption5": { 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption5", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.116 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption6": { 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption6", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.117 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption7": { 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption7", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.118 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "42", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "testkey": { 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testkey", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.119 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "testlkey": { 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testlkey", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.120 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "testnewline": { 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testnewline", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.121 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snap_schedule", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.122 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_m_granularity": { 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_m_granularity", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.123 INFO:teuthology.orchestra.run.smithi164.stdout: "dump_on_update": { 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dump_on_update", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "dump database to debug log on update", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.124 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.125 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.126 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.127 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.128 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.129 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stats", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.130 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.131 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.132 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.133 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.134 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "status", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.135 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.136 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.137 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.138 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.139 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.140 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telegraf", 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.141 INFO:teuthology.orchestra.run.smithi164.stdout: "address": { 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "address", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.142 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.143 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.144 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.145 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.146 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.147 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.148 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telemetry", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_basic": { 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_basic", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.149 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_crash": { 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_crash", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.150 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_device": { 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_device", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.151 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_ident": { 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_ident", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.152 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_perf": { 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_perf", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.153 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "contact": { 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "contact", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.154 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "description": { 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "description", 2024-03-27T08:42:05.155 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "device_url": { 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_url", 2024-03-27T08:42:05.156 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:05.157 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.158 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "24", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "8", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.159 INFO:teuthology.orchestra.run.smithi164.stdout: "last_opt_revision": { 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "last_opt_revision", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard": { 2024-03-27T08:42:05.160 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard_description": { 2024-03-27T08:42:05.161 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard_description", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.162 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.163 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.164 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.165 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.166 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "organization": { 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "organization", 2024-03-27T08:42:05.167 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "proxy": { 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "proxy", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.168 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "url": { 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.169 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.170 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "test_orchestrator", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.171 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.172 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.173 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.174 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.175 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "volumes", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.176 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.177 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.178 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.179 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.180 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.181 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_clones": { 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_clones", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.182 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "periodic_async_work": { 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "periodic_async_work", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Periodically check for async work", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.183 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_delay": { 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_delay", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.184 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_no_wait": { 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.185 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix", 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "discovery_interval": { 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "discovery_interval", 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.186 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "100", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "identifier": { 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "identifier", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.187 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.188 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.189 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.190 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.191 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.192 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.193 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_host": { 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_host", 2024-03-27T08:42:05.194 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.195 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_port": { 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_port", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10051", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.196 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_sender": { 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_sender", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.197 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "gid": 34106, 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "y", 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "mgr_features": 4540701547738038271, 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: "available_modules": [ 2024-03-27T08:42:05.198 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "alerts", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.199 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.200 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.201 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.202 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.203 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.204 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_destination": { 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_destination", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email address to send alerts to", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.205 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_from_name": { 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_from_name", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "Ceph", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.206 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email From: name", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_host": { 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_host", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.207 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP server", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_password": { 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_password", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Password to authenticate with", 2024-03-27T08:42:05.208 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_port": { 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_port", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "465", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.209 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP port", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_sender": { 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_sender", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.210 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP envelope sender", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_ssl": { 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_ssl", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.211 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_user": { 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_user", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.212 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "User to authenticate as", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "balancer", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.213 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "active": { 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "active", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.214 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_time": { 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_time", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0000", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.215 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_weekday": { 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_weekday", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.216 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_max_iterations": { 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_max_iterations", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "25", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "250", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.217 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_metrics": { 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_metrics", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.218 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_step": { 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_step", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.5", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0.001", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "0.999", 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.219 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "aggressiveness of optimization", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "end_time": { 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_time", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2359", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T08:42:05.220 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "end_weekday": { 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_weekday", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T08:42:05.221 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.222 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.223 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.224 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.225 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.226 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "min_score": { 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_score", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.227 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "upmap", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.228 INFO:teuthology.orchestra.run.smithi164.stdout: "crush-compat", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "none", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "read", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap-read" 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Balancer mode", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_ids": { 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_ids", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.229 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.230 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_deviation": { 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_deviation", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.231 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_optimizations": { 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_optimizations", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.232 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm", 2024-03-27T08:42:05.233 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_down_multiplier": { 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_down_multiplier", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.234 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_refresh_rate": { 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_refresh_rate", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "20", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T08:42:05.235 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_starting_port": { 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_starting_port", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4721", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T08:42:05.236 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_ptrace": { 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_ptrace", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.237 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_interval": { 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_interval", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.238 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_memory_target_ratio": { 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.7", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.239 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm_log_destination": { 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm_log_destination", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.240 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "file", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "file,syslog", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "syslog" 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "cgroups_split": { 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cgroups_split", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.241 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "config_checks_enabled": { 2024-03-27T08:42:05.242 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_checks_enabled", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "config_dashboard": { 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_dashboard", 2024-03-27T08:42:05.243 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_alertmanager": { 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_alertmanager", 2024-03-27T08:42:05.244 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_base": { 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_base", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.245 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Container image name, without the tag", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_elasticsearch": { 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_elasticsearch", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.246 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "elasticsearch container image", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_grafana": { 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_grafana", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.247 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_haproxy": { 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_haproxy", 2024-03-27T08:42:05.248 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "HAproxy container image", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_agent": { 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_agent", 2024-03-27T08:42:05.249 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger agent container image", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_collector": { 2024-03-27T08:42:05.250 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_collector", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger collector container image", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_query": { 2024-03-27T08:42:05.251 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_query", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger query container image", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.252 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_keepalived": { 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_keepalived", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Keepalived container image", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.253 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_loki": { 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_loki", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Loki container image", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.254 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_node_exporter": { 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_node_exporter", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.255 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_nvmeof": { 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_nvmeof", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Nvme-of container image", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.256 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_prometheus": { 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_prometheus", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.257 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_promtail": { 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_promtail", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Promtail container image", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.258 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_samba": { 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_samba", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Samba/SMB container image", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.259 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_snmp_gateway": { 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_snmp_gateway", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SNMP Gateway container image", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.260 INFO:teuthology.orchestra.run.smithi164.stdout: "container_init": { 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_init", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.261 INFO:teuthology.orchestra.run.smithi164.stdout: "daemon_cache_timeout": { 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "daemon_cache_timeout", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.262 INFO:teuthology.orchestra.run.smithi164.stdout: "default_cephadm_command_timeout": { 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "900", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.263 INFO:teuthology.orchestra.run.smithi164.stdout: "default_registry": { 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_registry", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.264 INFO:teuthology.orchestra.run.smithi164.stdout: "device_cache_timeout": { 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_cache_timeout", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1800", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache device inventory", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.265 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "device_enhanced_scan": { 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_enhanced_scan", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.266 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "facts_cache_timeout": { 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "facts_cache_timeout", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache host facts data", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.267 INFO:teuthology.orchestra.run.smithi164.stdout: "grafana_dashboards_path": { 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "grafana_dashboards_path", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.268 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "host_check_interval": { 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "host_check_interval", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to perform a host check", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.269 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "hw_monitoring": { 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hw_monitoring", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.270 INFO:teuthology.orchestra.run.smithi164.stdout: "inventory_list_all": { 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "inventory_list_all", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.271 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.272 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "log_refresh_metadata": { 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_refresh_metadata", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.273 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.274 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.275 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.276 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.277 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.278 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "*", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.279 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "max_count_per_host": { 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_count_per_host", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of daemons per service per host", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.280 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "max_osd_draining_count": { 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_osd_draining_count", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.281 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "migration_current": { 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "migration_current", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "internal - do not modify", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.282 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "root", 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.283 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm-package", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "root" 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "oob_default_addr": { 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "oob_default_addr", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.284 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "169.254.1.1", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "prometheus_alerts_path": { 2024-03-27T08:42:05.285 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus_alerts_path", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_insecure": { 2024-03-27T08:42:05.286 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_insecure", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.287 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_password": { 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_password", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.288 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_url": { 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_url", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.289 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_username": { 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_username", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.290 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "secure_monitoring_stack": { 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "secure_monitoring_stack", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.291 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "service_discovery_port": { 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "service_discovery_port", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8765", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.292 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "cephadm service discovery port", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "ssh_config_file": { 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssh_config_file", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T08:42:05.293 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "use_agent": { 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_agent", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T08:42:05.294 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "use_repo_digest": { 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_repo_digest", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T08:42:05.295 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_failed_host_check": { 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_failed_host_check", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T08:42:05.296 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_daemons": { 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_daemons", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T08:42:05.297 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_hosts": { 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_hosts", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.298 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crash", 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.299 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.300 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.301 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.302 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.303 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.304 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "retain_interval": { 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retain_interval", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "31536000", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.305 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_recent_interval": { 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_recent_interval", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1209600", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.306 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dashboard", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.307 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.308 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.309 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_ENABLED": { 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.310 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.311 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.312 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.313 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.314 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T08:42:05.315 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.316 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.317 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.318 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.319 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.320 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.321 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.322 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.323 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_URL": { 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_URL", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.324 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.325 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.326 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.327 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.328 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.329 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "{}", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.330 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.331 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.332 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.333 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.334 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.335 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.336 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.337 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.338 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.339 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.340 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.341 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.342 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.343 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "45", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.344 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.345 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.346 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.347 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.348 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.349 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.350 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.351 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.352 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "cross_origin_url": { 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cross_origin_url", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.353 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "crt_file": { 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crt_file", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.354 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "debug": { 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "debug", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.355 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable/disable debug options", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "jwt_token_ttl": { 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "jwt_token_ttl", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.356 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "28800", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.357 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.358 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.359 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.360 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.361 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.362 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "motd": { 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "motd", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.363 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "The message of the day", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect_resolve_ip_addr": { 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.364 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.365 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.366 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8080", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.367 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.368 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl_server_port": { 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl_server_port", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8443", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.369 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "redirect", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect" 2024-03-27T08:42:05.370 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:05.371 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "url_prefix": { 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url_prefix", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.372 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "devicehealth", 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_monitoring": { 2024-03-27T08:42:05.373 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_monitoring", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "monitor device health metrics", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.374 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.375 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.376 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.377 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.378 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "mark_out_threshold": { 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mark_out_threshold", 2024-03-27T08:42:05.379 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2419200", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_name": { 2024-03-27T08:42:05.380 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_name", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "device_health_metrics", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "retention_period": { 2024-03-27T08:42:05.381 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retention_period", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15552000", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain device health metrics", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.382 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_frequency": { 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_frequency", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.383 INFO:teuthology.orchestra.run.smithi164.stdout: "self_heal": { 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "self_heal", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.384 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.385 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_threshold": { 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_threshold", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7257600", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.386 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "diskprediction_local", 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.387 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.388 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.389 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.390 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.391 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "predict_interval": { 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predict_interval", 2024-03-27T08:42:05.392 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "predictor_model": { 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predictor_model", 2024-03-27T08:42:05.393 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "prophetstor", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.394 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.395 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "influx", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": false, 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "influxdb python module not found", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "batch_size": { 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "batch_size", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5000", 2024-03-27T08:42:05.396 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "database": { 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "database", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.397 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "ceph", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": { 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hostname", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.398 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server hostname", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.399 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "30", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "5", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.400 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.401 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.402 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.403 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.404 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "password": { 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "password", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.405 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "password of InfluxDB server user", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "port": { 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "port", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.406 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8086", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server port", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.407 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "false", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "threads": { 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threads", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.408 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "32", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "username": { 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "username", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.409 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "username of InfluxDB server user", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "verify_ssl": { 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "verify_ssl", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.410 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "true", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.411 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "insights", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.412 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.413 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.414 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.415 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.416 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "iostat", 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.417 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.418 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.419 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.420 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.421 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "k8sevents", 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.422 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_event_retention_days": { 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ceph_event_retention_days", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.423 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "config_check_secs": { 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_check_secs", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "10", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.424 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.425 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.426 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.427 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.428 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.429 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "localpool", 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "failure_domain": { 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "failure_domain", 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.430 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "host", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "failure domain for any created local pool", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.431 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.432 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.433 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.434 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.435 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "min_size": { 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_size", 2024-03-27T08:42:05.436 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default min_size for any created local pool", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "num_rep": { 2024-03-27T08:42:05.437 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "num_rep", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default replica count for any created local pool", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.438 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_num": { 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_num", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "128", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.439 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "prefix": { 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prefix", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name prefix for any created local pool", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.440 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "subtree": { 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "subtree", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "rack", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.441 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mds_autoscaler", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.442 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.443 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.444 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.445 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.446 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirroring", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.447 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.448 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.449 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.450 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.451 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.452 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "nfs", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.453 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.454 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.455 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.456 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.457 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "fail_fs": { 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "fail_fs", 2024-03-27T08:42:05.458 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.459 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.460 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.461 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.462 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.463 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator": { 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.464 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "rook", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "test_orchestrator" 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Orchestrator backend", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.465 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_perf_query", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.466 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.467 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.468 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.469 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.470 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_support", 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.471 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.472 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.473 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.474 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.475 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.476 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_autoscaler", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.477 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.478 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.479 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.480 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.481 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.482 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "threshold": { 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threshold", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:05.483 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1.0", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "scaling threshold", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "progress", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.484 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_pg_recovery_event": { 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_pg_recovery_event", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.485 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.486 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.487 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.488 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.489 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.490 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.491 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "max_completed_events": { 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_completed_events", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "50", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.492 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "number of past completed events to remember", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.493 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long the module is going to sleep", 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus", 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.494 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "cache": { 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cache", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.495 INFO:teuthology.orchestra.run.smithi164.stdout: "exclude_perf_counters": { 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "exclude_perf_counters", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.496 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.497 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.498 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.499 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.500 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools": { 2024-03-27T08:42:05.501 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.502 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "300", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.503 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_interval": { 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_interval", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15.0", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.504 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.505 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "9283", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.506 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "stale_cache_strategy": { 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stale_cache_strategy", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "log", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.507 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "default", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "default", 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "error" 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.508 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.509 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_support", 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.510 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.511 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.512 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.513 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.514 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.515 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_snap_create": { 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_snap_create", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.516 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "mirror_snapshot_schedule": { 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.517 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "trash_purge_schedule": { 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "trash_purge_schedule", 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.518 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.519 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "restful", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_auth": { 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_auth", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.520 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.521 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.522 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.523 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.524 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.525 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.526 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.527 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.528 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rgw", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.529 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.530 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.531 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.532 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.533 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.534 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rook", 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.535 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.536 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.537 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.538 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.539 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "storage_class": { 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "storage_class", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "local", 2024-03-27T08:42:05.540 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "selftest", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.541 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.542 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.543 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.544 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.545 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "roption1": { 2024-03-27T08:42:05.546 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption1", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "roption2": { 2024-03-27T08:42:05.547 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption2", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "xyz", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption1": { 2024-03-27T08:42:05.548 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption1", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption2": { 2024-03-27T08:42:05.549 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption2", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption3": { 2024-03-27T08:42:05.550 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption3", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.551 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption4": { 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption4", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.552 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption5": { 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption5", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.553 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption6": { 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption6", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.554 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption7": { 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption7", 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.555 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "42", 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "testkey": { 2024-03-27T08:42:05.556 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testkey", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.557 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "testlkey": { 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testlkey", 2024-03-27T08:42:05.558 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.559 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "testnewline": { 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testnewline", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.560 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snap_schedule", 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.561 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_m_granularity": { 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_m_granularity", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.562 INFO:teuthology.orchestra.run.smithi164.stdout: "dump_on_update": { 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dump_on_update", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "dump database to debug log on update", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.563 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.564 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.565 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.566 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.567 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.568 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stats", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.569 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.570 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.571 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.572 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.573 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "status", 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.574 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.575 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.576 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.577 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.578 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.579 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telegraf", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "address": { 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "address", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.580 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.581 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.582 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.583 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.584 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.585 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.586 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telemetry", 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.587 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_basic": { 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_basic", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.588 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_crash": { 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_crash", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.589 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_device": { 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_device", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.590 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_ident": { 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_ident", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T08:42:05.591 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_perf": { 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_perf", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T08:42:05.592 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "contact": { 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "contact", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.593 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "description": { 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "description", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.594 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "device_url": { 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_url", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.595 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.596 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "24", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "8", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.597 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "last_opt_revision": { 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "last_opt_revision", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.598 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard": { 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.599 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard_description": { 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard_description", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.600 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.601 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.602 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.603 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.604 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.605 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "organization": { 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "organization", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.606 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "proxy": { 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "proxy", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.607 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "url": { 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.608 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "test_orchestrator", 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.609 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.610 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.611 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.612 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.613 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.614 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "volumes", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.615 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.616 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.617 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.618 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.619 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_clones": { 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_clones", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.620 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "periodic_async_work": { 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "periodic_async_work", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Periodically check for async work", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.621 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_delay": { 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_delay", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.622 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_no_wait": { 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.623 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix", 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "discovery_interval": { 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "discovery_interval", 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.624 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "100", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "identifier": { 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "identifier", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.625 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.626 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.627 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.628 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.629 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.630 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.631 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_host": { 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_host", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.632 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_port": { 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_port", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.633 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10051", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_sender": { 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_sender", 2024-03-27T08:42:05.634 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.635 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "modules": [ 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm", 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "dashboard", 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "iostat", 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "nfs", 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "restful" 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "available_modules": [ 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "alerts", 2024-03-27T08:42:05.636 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How frequently to reexamine health status", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.637 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.638 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.639 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.640 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.641 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.642 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_destination": { 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_destination", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email address to send alerts to", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.643 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_from_name": { 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_from_name", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "Ceph", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Email From: name", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.644 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_host": { 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_host", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP server", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.645 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_password": { 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_password", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Password to authenticate with", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.646 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_port": { 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_port", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "465", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP port", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.647 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_sender": { 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_sender", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SMTP envelope sender", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.648 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_ssl": { 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_ssl", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use SSL to connect to SMTP server", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.649 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "smtp_user": { 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "smtp_user", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "User to authenticate as", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.650 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "balancer", 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "active": { 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "active", 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.651 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically balance PGs across cluster", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_time": { 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_time", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.652 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0000", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "beginning time of day to automatically balance", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "begin_weekday": { 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "begin_weekday", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.653 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_max_iterations": { 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_max_iterations", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.654 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "25", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "250", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_metrics": { 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_metrics", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.655 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "pgs,objects,bytes", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "crush_compat_step": { 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crush_compat_step", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.656 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.5", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0.001", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "0.999", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "aggressiveness of optimization", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "end_time": { 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_time", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.657 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2359", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ending time of day to automatically balance", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "end_weekday": { 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "end_weekday", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.658 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "0", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "6", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.659 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.660 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.661 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.662 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.663 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "min_score": { 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_score", 2024-03-27T08:42:05.664 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.665 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "upmap", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "crush-compat", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "none", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "read", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap-read" 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Balancer mode", 2024-03-27T08:42:05.666 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_ids": { 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_ids", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-03-27T08:42:05.667 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.668 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_deviation": { 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_deviation", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "deviation below which no optimization is attempted", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-03-27T08:42:05.669 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "upmap_max_optimizations": { 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "upmap_max_optimizations", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.670 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm", 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_down_multiplier": { 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_down_multiplier", 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.671 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_refresh_rate": { 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_refresh_rate", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.672 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "20", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "agent_starting_port": { 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "agent_starting_port", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.673 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4721", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_ptrace": { 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_ptrace", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.674 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_interval": { 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_interval", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.675 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to autotune daemon memory", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "autotune_memory_target_ratio": { 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "autotune_memory_target_ratio", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.676 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0.7", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm_log_destination": { 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cephadm_log_destination", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.677 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "file", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "file,syslog", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "syslog" 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.678 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "cgroups_split": { 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cgroups_split", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.679 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "config_checks_enabled": { 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_checks_enabled", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.680 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "config_dashboard": { 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_dashboard", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.681 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_alertmanager": { 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_alertmanager", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.682 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_base": { 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_base", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/ceph", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.683 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Container image name, without the tag", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_elasticsearch": { 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_elasticsearch", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.684 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "elasticsearch container image", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_grafana": { 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_grafana", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.685 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_haproxy": { 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_haproxy", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.686 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "HAproxy container image", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_agent": { 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_agent", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.687 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger agent container image", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_collector": { 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_collector", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.688 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger collector container image", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_jaeger_query": { 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_jaeger_query", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.689 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Jaeger query container image", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_keepalived": { 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_keepalived", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.690 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Keepalived container image", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_loki": { 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_loki", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Loki container image", 2024-03-27T08:42:05.691 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_node_exporter": { 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_node_exporter", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.692 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_nvmeof": { 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_nvmeof", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/ceph/nvmeof:1.0.0", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.693 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Nvme-of container image", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_prometheus": { 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_prometheus", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.694 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Prometheus container image", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_promtail": { 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_promtail", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.695 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Promtail container image", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_samba": { 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_samba", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.696 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Samba/SMB container image", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "container_image_snmp_gateway": { 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_image_snmp_gateway", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.697 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "SNMP Gateway container image", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "container_init": { 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "container_init", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.698 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Run podman/docker with `--init`", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "daemon_cache_timeout": { 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "daemon_cache_timeout", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.699 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "default_cephadm_command_timeout": { 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_cephadm_command_timeout", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "900", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.700 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "default_registry": { 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "default_registry", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "docker.io", 2024-03-27T08:42:05.701 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "device_cache_timeout": { 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_cache_timeout", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1800", 2024-03-27T08:42:05.702 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache device inventory", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "device_enhanced_scan": { 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_enhanced_scan", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.703 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use libstoragemgmt during device scans", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "facts_cache_timeout": { 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "facts_cache_timeout", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.704 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "seconds to cache host facts data", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "grafana_dashboards_path": { 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "grafana_dashboards_path", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.705 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "host_check_interval": { 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "host_check_interval", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.706 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to perform a host check", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "hw_monitoring": { 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hw_monitoring", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.707 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "inventory_list_all": { 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "inventory_list_all", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.708 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.709 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.710 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "log_refresh_metadata": { 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_refresh_metadata", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.711 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.712 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.713 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.714 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf": { 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-03-27T08:42:05.715 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.716 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "*", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "max_count_per_host": { 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_count_per_host", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.717 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of daemons per service per host", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "max_osd_draining_count": { 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_osd_draining_count", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.718 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "migration_current": { 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "migration_current", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.719 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "internal - do not modify", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "mode": { 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mode", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.720 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "root", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm-package", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "root" 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "mode for remote execution of cephadm", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "oob_default_addr": { 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "oob_default_addr", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.721 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "169.254.1.1", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Default address for RedFish API (oob management).", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "prometheus_alerts_path": { 2024-03-27T08:42:05.722 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus_alerts_path", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_insecure": { 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_insecure", 2024-03-27T08:42:05.723 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.724 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_password": { 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_password", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.725 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_url": { 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_url", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.726 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "registry_username": { 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "registry_username", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-03-27T08:42:05.727 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "secure_monitoring_stack": { 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "secure_monitoring_stack", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-03-27T08:42:05.728 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "service_discovery_port": { 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "service_discovery_port", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8765", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.729 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "cephadm service discovery port", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "ssh_config_file": { 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssh_config_file", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.730 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "use_agent": { 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_agent", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.731 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "use_repo_digest": { 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "use_repo_digest", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-03-27T08:42:05.732 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_failed_host_check": { 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_failed_host_check", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if the host check fails", 2024-03-27T08:42:05.733 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_daemons": { 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_daemons", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.734 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_on_stray_hosts": { 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_on_stray_hosts", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.735 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crash", 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.736 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.737 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.738 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.739 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.740 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "retain_interval": { 2024-03-27T08:42:05.741 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retain_interval", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "31536000", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain crashes before pruning them", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_recent_interval": { 2024-03-27T08:42:05.742 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_recent_interval", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1209600", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "time interval in which to warn about recent crashes", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.743 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dashboard", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.744 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_HOST": { 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_HOST", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.745 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.746 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_ENABLED": { 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_ENABLED", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.747 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.748 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "ENABLE_BROWSABLE_API": { 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ENABLE_BROWSABLE_API", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.749 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.750 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.751 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.752 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.753 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.754 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_NFS": { 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.755 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.756 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RBD": { 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.757 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "FEATURE_TOGGLE_RGW": { 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.758 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.759 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_PASSWORD": { 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_PASSWORD", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.760 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.761 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_URL": { 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_URL", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.762 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_API_USERNAME": { 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_API_USERNAME", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.763 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.764 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.765 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.766 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "ISSUE_TRACKER_API_KEY": { 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-03-27T08:42:05.767 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "MULTICLUSTER_CONFIG": { 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "MULTICLUSTER_CONFIG", 2024-03-27T08:42:05.768 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "{}", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_HOST": { 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_HOST", 2024-03-27T08:42:05.769 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-03-27T08:42:05.770 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.771 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-03-27T08:42:05.772 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-03-27T08:42:05.773 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.774 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.775 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.776 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.777 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.778 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_ENABLED": { 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_ENABLED", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.779 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.780 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.781 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8", 2024-03-27T08:42:05.782 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "REST_REQUESTS_TIMEOUT": { 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "45", 2024-03-27T08:42:05.783 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ACCESS_KEY": { 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ACCESS_KEY", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.784 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "admin", 2024-03-27T08:42:05.785 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SECRET_KEY": { 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SECRET_KEY", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.786 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "RGW_API_SSL_VERIFY": { 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "RGW_API_SSL_VERIFY", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.787 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "UNSAFE_TLS_v1_2": { 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "UNSAFE_TLS_v1_2", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.788 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:05.789 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.790 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.791 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "cross_origin_url": { 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cross_origin_url", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.792 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "crt_file": { 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "crt_file", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.793 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "debug": { 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "debug", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.794 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Enable/disable debug options", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "jwt_token_ttl": { 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "jwt_token_ttl", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.795 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "28800", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:05.796 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.797 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.798 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.799 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.800 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.801 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.802 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "motd": { 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "motd", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "The message of the day", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.803 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect_resolve_ip_addr": { 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "redirect_resolve_ip_addr", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.804 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.805 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8080", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:05.806 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl_server_port": { 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl_server_port", 2024-03-27T08:42:05.807 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8443", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:05.808 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "redirect", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "redirect" 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.809 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.810 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "url_prefix": { 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url_prefix", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.811 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "devicehealth", 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_monitoring": { 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_monitoring", 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.812 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "monitor device health metrics", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.813 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.814 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.815 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.816 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.817 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "mark_out_threshold": { 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mark_out_threshold", 2024-03-27T08:42:05.818 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "2419200", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "pool_name": { 2024-03-27T08:42:05.819 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pool_name", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "device_health_metrics", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name of pool in which to store device health metrics", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "retention_period": { 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "retention_period", 2024-03-27T08:42:05.820 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15552000", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long to retain device health metrics", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_frequency": { 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_frequency", 2024-03-27T08:42:05.821 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to scrape device health metrics", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "self_heal": { 2024-03-27T08:42:05.822 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "self_heal", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.823 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how frequently to wake up and check device health", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.824 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "warn_threshold": { 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "warn_threshold", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7257600", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.825 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "diskprediction_local", 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.826 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.827 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.828 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.829 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.830 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "predict_interval": { 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predict_interval", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.831 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "86400", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "predictor_model": { 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "predictor_model", 2024-03-27T08:42:05.832 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "prophetstor", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.833 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "600", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.834 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "influx", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": false, 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "influxdb python module not found", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "batch_size": { 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "batch_size", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5000", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.835 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "database": { 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "database", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.836 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "ceph", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "hostname": { 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "hostname", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.837 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server hostname", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.838 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "30", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "5", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.839 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.840 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.841 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.842 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.843 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.844 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "password": { 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "password", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "password of InfluxDB server user", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.845 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "port": { 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "port", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "8086", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "InfluxDB server port", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.846 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "ssl": { 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ssl", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "false", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.847 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "threads": { 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threads", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "32", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.848 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "username": { 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "username", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "username of InfluxDB server user", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.849 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "verify_ssl": { 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "verify_ssl", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "true", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-03-27T08:42:05.850 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "insights", 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.851 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.852 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.853 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.854 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.855 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "iostat", 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.856 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.857 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.858 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.859 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.860 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.861 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "k8sevents", 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "ceph_event_retention_days": { 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "ceph_event_retention_days", 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.862 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "7", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Days to hold ceph event information within local cache", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "config_check_secs": { 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "config_check_secs", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.863 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "10", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.864 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.865 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.866 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.867 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.868 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.869 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "localpool", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "failure_domain": { 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "failure_domain", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "host", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.870 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "failure domain for any created local pool", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.871 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.872 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.873 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.874 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.875 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "min_size": { 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "min_size", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.876 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default min_size for any created local pool", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "num_rep": { 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "num_rep", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.877 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default replica count for any created local pool", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_num": { 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_num", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.878 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "128", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "default pg_num for any created local pool", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "prefix": { 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prefix", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.879 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "name prefix for any created local pool", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "subtree": { 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "subtree", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.880 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "rack", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "CRUSH level for which to create a local pool", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mds_autoscaler", 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.881 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.882 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.883 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.884 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.885 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.886 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirroring", 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.887 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.888 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.889 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.890 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.891 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.892 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "nfs", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.893 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.894 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.895 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.896 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.897 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "fail_fs": { 2024-03-27T08:42:05.898 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "fail_fs", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.899 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.900 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.901 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.902 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.903 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator": { 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "orchestrator", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.904 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "cephadm", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "rook", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "test_orchestrator" 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Orchestrator backend", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.905 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_perf_query", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.906 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.907 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.908 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.909 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.910 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "osd_support", 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.911 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.912 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.913 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.914 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.915 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.916 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "pg_autoscaler", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.917 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.918 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.919 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.920 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.921 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.922 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "threshold": { 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "threshold", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "3.0", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1.0", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "scaling threshold", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-03-27T08:42:05.923 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "progress", 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_pg_recovery_event": { 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_pg_recovery_event", 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.924 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow the module to show pg recovery progress", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.925 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.926 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.927 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.928 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.929 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.930 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "max_completed_events": { 2024-03-27T08:42:05.931 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_completed_events", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "50", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "number of past completed events to remember", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "sleep_interval": { 2024-03-27T08:42:05.932 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "sleep_interval", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "5", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "how long the module is going to sleep", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.933 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "prometheus", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "cache": { 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "cache", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.934 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "exclude_perf_counters": { 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "exclude_perf_counters", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.935 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.936 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.937 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.938 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.939 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.940 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools": { 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.941 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_stats_pools_refresh_interval": { 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "300", 2024-03-27T08:42:05.942 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "scrape_interval": { 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "scrape_interval", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15.0", 2024-03-27T08:42:05.943 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "::", 2024-03-27T08:42:05.944 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.945 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "9283", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "stale_cache_strategy": { 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stale_cache_strategy", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.946 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "log", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_behaviour": { 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_behaviour", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.947 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "default", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "default", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "error" 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "standby_error_status_code": { 2024-03-27T08:42:05.948 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "standby_error_status_code", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "500", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "400", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "599", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.949 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_support", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.950 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.951 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.952 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.953 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.954 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.955 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_snap_create": { 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_snap_create", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.956 INFO:teuthology.orchestra.run.smithi164.stdout: "mirror_snapshot_schedule": { 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "mirror_snapshot_schedule", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "trash_purge_schedule": { 2024-03-27T08:42:05.957 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "trash_purge_schedule", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.958 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "restful", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "enable_auth": { 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enable_auth", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.959 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "key_file": { 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "key_file", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.960 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.961 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.962 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.963 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.964 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.965 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "server_addr": { 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_addr", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.966 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "server_port": { 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "server_port", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.967 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rgw", 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.968 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.969 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.970 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.971 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.972 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.973 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rook", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.974 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.975 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.976 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.977 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.978 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "storage_class": { 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "storage_class", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "local", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.979 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "selftest", 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.980 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.981 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.982 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:05.983 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:05.984 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "roption1": { 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption1", 2024-03-27T08:42:05.985 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "roption2": { 2024-03-27T08:42:05.986 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "roption2", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "xyz", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption1": { 2024-03-27T08:42:05.987 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption1", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption2": { 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption2", 2024-03-27T08:42:05.988 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption3": { 2024-03-27T08:42:05.989 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption3", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "float", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption4": { 2024-03-27T08:42:05.990 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption4", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.991 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption5": { 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption5", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.992 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption6": { 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption6", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.993 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "rwoption7": { 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rwoption7", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "1", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "42", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.994 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "testkey": { 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testkey", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.995 INFO:teuthology.orchestra.run.smithi164.stdout: "testlkey": { 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testlkey", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.996 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "testnewline": { 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "testnewline", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.997 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snap_schedule", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "allow_m_granularity": { 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "allow_m_granularity", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.998 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "allow minute scheduled snapshots", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "dump_on_update": { 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "dump_on_update", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:05.999 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "dump database to debug log on update", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.000 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.001 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.002 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.003 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.004 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "stats", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.005 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.006 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.007 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.008 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.009 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.010 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "status", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.011 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.012 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.013 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.014 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.015 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telegraf", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "address": { 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "address", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.016 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.017 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "15", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.018 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.019 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.020 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.021 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.022 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "telemetry", 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.023 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_basic": { 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_basic", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share basic cluster information (size, version)", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.024 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_crash": { 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_crash", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.025 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_device": { 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_device", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.026 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_ident": { 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_ident", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.027 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "channel_perf": { 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "channel_perf", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Share various performance metrics of a cluster", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.028 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "contact": { 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "contact", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.029 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "description": { 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "description", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.030 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "device_url": { 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "device_url", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.031 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "enabled": { 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "enabled", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.032 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "24", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "8", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.033 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "last_opt_revision": { 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "last_opt_revision", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "1", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.034 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard": { 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.035 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "leaderboard_description": { 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "leaderboard_description", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.036 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.037 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.038 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.039 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.040 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.041 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "organization": { 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "organization", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.042 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "proxy": { 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "proxy", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.043 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "url": { 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "url", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.044 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "test_orchestrator", 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.045 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.046 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.047 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.048 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.049 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "volumes", 2024-03-27T08:42:06.050 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.051 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.052 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.053 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.054 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.055 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "max_concurrent_clones": { 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "max_concurrent_clones", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "4", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.056 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Number of asynchronous cloner threads", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "periodic_async_work": { 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "periodic_async_work", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.057 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Periodically check for async work", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_delay": { 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_delay", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "0", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.058 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "snapshot_clone_no_wait": { 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "snapshot_clone_no_wait", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "True", 2024-03-27T08:42:06.059 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix", 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "can_run": true, 2024-03-27T08:42:06.060 INFO:teuthology.orchestra.run.smithi164.stdout: "error_string": "", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "module_options": { 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "discovery_interval": { 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "discovery_interval", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "uint", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "100", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.061 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "identifier": { 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "identifier", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.062 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "interval": { 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "interval", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "secs", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "60", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.063 INFO:teuthology.orchestra.run.smithi164.stdout: "log_level": { 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_level", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.064 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster": { 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.065 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_cluster_level": { 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_cluster_level", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "info", 2024-03-27T08:42:06.066 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [ 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "critical", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "debug", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "error", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "info", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "warning" 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.067 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "log_to_file": { 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "log_to_file", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "bool", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 1, 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "False", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.068 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_host": { 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_host", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.069 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_port": { 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_port", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "int", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "10051", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.070 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "zabbix_sender": { 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "zabbix_sender", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "str", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "level": "advanced", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "flags": 0, 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "min": "", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "max": "", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "enum_allowed": [], 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "desc": "", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "long_desc": "", 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "tags": [], 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: "see_also": [] 2024-03-27T08:42:06.071 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "services": { 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "dashboard": "https://172.21.15.164:8443/" 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "always_on_modules": { 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "octopus": [ 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "balancer", 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "crash", 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "devicehealth", 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator", 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_autoscaler", 2024-03-27T08:42:06.072 INFO:teuthology.orchestra.run.smithi164.stdout: "progress", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_support", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "status", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "telemetry", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "volumes" 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "pacific": [ 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "balancer", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "crash", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "devicehealth", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_autoscaler", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "progress", 2024-03-27T08:42:06.073 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_support", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "status", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "telemetry", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "volumes" 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "quincy": [ 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "balancer", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "crash", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "devicehealth", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_autoscaler", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "progress", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_support", 2024-03-27T08:42:06.074 INFO:teuthology.orchestra.run.smithi164.stdout: "status", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "telemetry", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "volumes" 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "reef": [ 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "balancer", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "crash", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "devicehealth", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_autoscaler", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "progress", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_support", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "status", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "telemetry", 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: "volumes" 2024-03-27T08:42:06.075 INFO:teuthology.orchestra.run.smithi164.stdout: ], 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "squid": [ 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "balancer", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "crash", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "devicehealth", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "orchestrator", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "pg_autoscaler", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "progress", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "rbd_support", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "status", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "telemetry", 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: "volumes" 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.076 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "last_failure_osd_epoch": 3, 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "active_clients": [ 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "devicehealth", 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "addrvec": [ 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v2", 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 3102073747 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "libcephsqlite", 2024-03-27T08:42:06.077 INFO:teuthology.orchestra.run.smithi164.stdout: "addrvec": [ 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v2", 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2130653247 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "rbd_support", 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "addrvec": [ 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v2", 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-03-27T08:42:06.078 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2568457324 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: "name": "volumes", 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: "addrvec": [ 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: { 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: "type": "v2", 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: "addr": "172.21.15.164:0", 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: "nonce": 2885242958 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout: ] 2024-03-27T08:42:06.079 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:42:06.081 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:04 smithi173 ceph-mon[35397]: pgmap v643: 97 pgs: 97 active+clean; 66 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 490 KiB/s wr, 186 op/s 2024-03-27T08:42:06.081 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4269315814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:04 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1651885839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:05 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/2177138716' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:04 smithi167 ceph-mon[34903]: pgmap v643: 97 pgs: 97 active+clean; 66 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 490 KiB/s wr, 186 op/s 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4269315814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:04 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1651885839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.082 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:05 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/2177138716' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T08:42:06.082 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.713+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 msgr2=0x7f730c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.713+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 0x7f730c0a5b50 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f7318005fd0 tx=0x7f7318009870 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.713+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 msgr2=0x7f73241a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.713+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f731c00d750 tx=0x7f731c00dc10 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 shutdown_connections 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f730c0a3690 0x7f730c0a5b50 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f7324109a40 0x7f73241a1650 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7324075b90 0x7f732419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 --2- 172.21.15.164:0/2177138716 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f73240745b0 0x7f732419a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 >> 172.21.15.164:0/2177138716 conn(0x7f73240fd0f0 msgr2=0x7f7324105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 shutdown_connections 2024-03-27T08:42:06.083 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:04.714+0000 7f732c400640 1 -- 172.21.15.164:0/2177138716 wait complete. 2024-03-27T08:42:06.089 DEBUG:tasks.check_counter:Getting stats from a 2024-03-27T08:42:06.090 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.a perf dump 2024-03-27T08:42:06.090 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:04 smithi164 ceph-mon[31788]: pgmap v643: 97 pgs: 97 active+clean; 66 MiB data, 730 MiB used, 1.0 TiB / 1.0 TiB avail; 462 KiB/s rd, 490 KiB/s wr, 186 op/s 2024-03-27T08:42:06.091 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4269315814' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.091 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:04 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1651885839' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:06.091 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:05 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/2177138716' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-03-27T08:42:06.542 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:42:06.903 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:06 smithi164 ceph-mon[31788]: pgmap v644: 97 pgs: 97 active+clean; 66 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-03-27T08:42:07.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:06 smithi167 ceph-mon[34903]: pgmap v644: 97 pgs: 97 active+clean; 66 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-03-27T08:42:07.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:06 smithi173 ceph-mon[35397]: pgmap v644: 97 pgs: 97 active+clean; 66 MiB data, 727 MiB used, 1.0 TiB / 1.0 TiB avail; 406 KiB/s rd, 392 KiB/s wr, 164 op/s 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 0, 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 2, 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 0, 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 0, 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:08.816 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.004140462, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.000664778, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:08.817 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 5, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 120, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 3152, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 98896, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.024315914, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.018583696, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.003153810, 2024-03-27T08:42:08.818 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 119, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.012334808, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000103653 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 98896 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.819 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 158, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 155, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 462528, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 94768, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.063108212, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.022963537, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.043537384, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.007051403, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 154, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.014213657, 2024-03-27T08:42:08.820 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000092296 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 462528, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 94768 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 0, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-03-27T08:42:08.821 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:08.822 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:08.823 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 148967, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 29, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:08.824 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 2, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-03-27T08:42:08.825 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 159, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 440212, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 159, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 159, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 440212, 2024-03-27T08:42:08.826 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:08.827 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:42:09.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:08 smithi164 ceph-mon[31788]: pgmap v645: 97 pgs: 97 active+clean; 66 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 338 KiB/s wr, 131 op/s 2024-03-27T08:42:09.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:08 smithi167 ceph-mon[34903]: pgmap v645: 97 pgs: 97 active+clean; 66 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 338 KiB/s wr, 131 op/s 2024-03-27T08:42:09.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:08 smithi173 ceph-mon[35397]: pgmap v645: 97 pgs: 97 active+clean; 66 MiB data, 725 MiB used, 1.0 TiB / 1.0 TiB avail; 349 KiB/s rd, 338 KiB/s wr, 131 op/s 2024-03-27T08:42:09.683 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-03-27T08:42:09.683 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-03-27T08:42:09.683 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-03-27T08:42:09.683 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-03-27T08:42:09.683 DEBUG:tasks.check_counter:Getting stats from d 2024-03-27T08:42:09.684 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.d perf dump 2024-03-27T08:42:10.139 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:42:11.004 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:10 smithi164 ceph-mon[31788]: pgmap v646: 97 pgs: 97 active+clean; 65 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 118 op/s 2024-03-27T08:42:11.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:10 smithi167 ceph-mon[34903]: pgmap v646: 97 pgs: 97 active+clean; 65 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 118 op/s 2024-03-27T08:42:11.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:10 smithi173 ceph-mon[35397]: pgmap v646: 97 pgs: 97 active+clean; 65 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 343 KiB/s rd, 333 KiB/s wr, 118 op/s 2024-03-27T08:42:12.351 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:42:12.351 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 4, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 4, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 2992, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 448, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.004484528, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000081583, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.001559174, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:12.352 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.001632300, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000544100 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1, 2024-03-27T08:42:12.353 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 124, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 160, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 99504, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.024238850, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.018761429, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.002816312, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 122, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.011347736, 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000093014 2024-03-27T08:42:12.354 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 99504 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 166, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 163, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 464704, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 99888, 2024-03-27T08:42:12.355 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.064336301, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.025337895, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.037718738, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.007802036, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 162, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.014859843, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000091727 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:12.356 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 464704, 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 99888 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-03-27T08:42:12.357 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 0, 2024-03-27T08:42:12.358 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-03-27T08:42:12.358 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.358 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-03-27T08:42:12.358 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:12.358 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:12.359 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:12.360 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 149047, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 31, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:12.361 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 2, 2024-03-27T08:42:12.362 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 167, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 441252, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 167, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-03-27T08:42:12.363 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 167, 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 441252, 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:12.364 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:42:13.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:12 smithi164 ceph-mon[31788]: pgmap v647: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 259 KiB/s wr, 91 op/s 2024-03-27T08:42:13.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:12 smithi167 ceph-mon[34903]: pgmap v647: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 259 KiB/s wr, 91 op/s 2024-03-27T08:42:13.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:12 smithi173 ceph-mon[35397]: pgmap v647: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 260 KiB/s rd, 259 KiB/s wr, 91 op/s 2024-03-27T08:42:13.162 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-03-27T08:42:13.162 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-03-27T08:42:13.162 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-03-27T08:42:13.162 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-03-27T08:42:13.162 DEBUG:tasks.check_counter:Getting stats from g 2024-03-27T08:42:13.163 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.g perf dump 2024-03-27T08:42:13.609 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:42:15.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:14 smithi164 ceph-mon[31788]: pgmap v648: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-03-27T08:42:15.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:14 smithi167 ceph-mon[34903]: pgmap v648: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-03-27T08:42:15.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:14 smithi173 ceph-mon[35397]: pgmap v648: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 62 KiB/s wr, 60 op/s 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 4, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 4, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 2992, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 448, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:15.878 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.004256781, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000085748, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.001205755, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.001540696, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000513565 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:15.879 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 120, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 160, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 98800, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.021066780, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.016791210, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.001689055, 2024-03-27T08:42:15.880 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 118, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.010450044, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000088559 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 98800 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.881 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 161, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 158, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 463344, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 96688, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.061720958, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.023527959, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.037812281, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.007539311, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 157, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.015188605, 2024-03-27T08:42:15.882 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000096742 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 463344, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 96688 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 0, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.883 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:15.884 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:15.885 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 149007, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 30, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-03-27T08:42:15.886 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 2, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:15.887 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 162, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 440602, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 162, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 162, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 440602, 2024-03-27T08:42:15.888 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:15.889 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:42:16.839 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-03-27T08:42:16.839 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-03-27T08:42:16.840 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-03-27T08:42:16.840 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-03-27T08:42:16.840 DEBUG:tasks.check_counter:Getting stats from j 2024-03-27T08:42:16.840 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.j perf dump 2024-03-27T08:42:16.923 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:16 smithi164 ceph-mon[31788]: pgmap v649: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 52 KiB/s wr, 34 op/s 2024-03-27T08:42:17.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:16 smithi167 ceph-mon[34903]: pgmap v649: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 52 KiB/s wr, 34 op/s 2024-03-27T08:42:17.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:16 smithi173 ceph-mon[35397]: pgmap v649: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 52 KiB/s wr, 34 op/s 2024-03-27T08:42:17.288 INFO:teuthology.orchestra.run.smithi164.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.a/config 2024-03-27T08:42:19.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:18 smithi164 ceph-mon[31788]: pgmap v650: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-03-27T08:42:19.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:18 smithi167 ceph-mon[34903]: pgmap v650: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-03-27T08:42:19.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:18 smithi173 ceph-mon[35397]: pgmap v650: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 12 KiB/s wr, 13 op/s 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout:{ 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 4, 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 4, 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 2992, 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 448, 2024-03-27T08:42:19.598 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.004251045, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.000075110, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.001375167, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 3, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.001657259, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000552419 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:19.599 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 1, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 126, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 160, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 99856, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.023083076, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.017928041, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.002131837, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:19.600 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 124, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.011522666, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000092924 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 99856 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_messages": 169, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages": 166, 2024-03-27T08:42:19.601 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_bytes": 465520, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_bytes": 101792, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_total_time": 0.064196130, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_send_time": 0.024655317, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_recv_time": 0.038452839, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_running_fast_dispatch_time": 0.007800145, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 165, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.017502461, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000106075 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:19.602 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_recv_encrypted_bytes": 465520, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "msgr_send_encrypted_bytes": 101792 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "cct": { 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "total_workers": 0, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "unhealthy_workers": 0 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "mempool": { 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:19.603 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:19.604 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_items": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:19.605 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_bytes": 148984, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_anon_items": 30, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_items": 0, 2024-03-27T08:42:19.606 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "pgmap_items": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "mds_co_items": 2, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_1_items": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "unittest_2_items": 0 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: }, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "val": 0, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "max": 104857600, 2024-03-27T08:42:19.607 INFO:teuthology.orchestra.run.smithi164.stdout: "get_started": 0, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "get": 170, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "get_sum": 441642, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "get_or_fail_success": 170, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "take": 0, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "take_sum": 0, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "put": 170, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "put_sum": 441642, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "wait": { 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgcount": 0, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "sum": 0.000000000, 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: "avgtime": 0.000000000 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout: } 2024-03-27T08:42:19.608 INFO:teuthology.orchestra.run.smithi164.stdout:} 2024-03-27T08:42:20.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:19 smithi164 ceph-mon[31788]: pgmap v651: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-03-27T08:42:20.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:19 smithi167 ceph-mon[34903]: pgmap v651: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-03-27T08:42:20.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:19 smithi173 ceph-mon[35397]: pgmap v651: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 12 KiB/s wr, 9 op/s 2024-03-27T08:42:20.484 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-03-27T08:42:20.484 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-03-27T08:42:20.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-03-27T08:42:20.484 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-03-27T08:42:20.485 DEBUG:tasks.check_counter:Getting stats from b 2024-03-27T08:42:20.485 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.b perf dump 2024-03-27T08:42:20.974 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:42:22.900 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:22 smithi167 ceph-mon[34903]: pgmap v652: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-03-27T08:42:23.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:22 smithi164 ceph-mon[31788]: pgmap v652: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-03-27T08:42:23.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:22 smithi173 ceph-mon[35397]: pgmap v652: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 13 KiB/s wr, 8 op/s 2024-03-27T08:42:23.104 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 16055, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 14964, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 6270664, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 36340471, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 106, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.243079237, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.127562643, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.042951652, 2024-03-27T08:42:23.105 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.248288757, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 14965, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8.014215887, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000535530 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 18812, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.006451181, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000342 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:23.106 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 22275, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 19616, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 8075589, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 25212093, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 9, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.885513066, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.450543567, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.485575661, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.254350451, 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:23.107 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 19618, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 5.112975189, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000260626 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 28721, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.008310518, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000289 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 264240 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:23.108 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 31193, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 59129, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 11083999, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 34033726, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 14, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 8, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 4.771190879, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 2.163550446, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 2.647865524, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.224957849, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 59122, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8.855071501, 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000149776 2024-03-27T08:42:23.109 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 69939, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.029044333, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000415 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 595680, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 141184 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.110 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3645, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 18.200885500, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004993384 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.111 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4826, 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.641704083, 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000132968 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.112 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 15490, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 13062, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 13062, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 52.124300239, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003990529 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 2428, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 4, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 1, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 1221, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 11, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 5, 2024-03-27T08:42:23.113 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 211, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 9, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 192, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 10, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 93, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 7879, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 2, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 2, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 4, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 19970, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 15697, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 2377, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 444, 2024-03-27T08:42:23.114 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 59, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 66, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 7217, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 39, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 2653, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 1365, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-03-27T08:42:23.115 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 1365, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 160, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 5, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 155, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 1205, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 2, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 2166, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 10541, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:23.116 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 10535, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 7108, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 196, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 13267 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 512, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 1483, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 963, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 974, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 1046, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 6, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 2802, 2024-03-27T08:42:23.117 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 2796, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 5, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 68, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 16, 2024-03-27T08:42:23.118 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 21791, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 20082, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 20082, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 1709, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 67, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 52, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 49, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 49, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2024-03-27T08:42:23.119 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 1, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 1, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 45745208, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 49066642, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1309, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 36.565004138, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.027933540 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 33, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 10074, 2024-03-27T08:42:23.120 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 10041, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 34, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 1184, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 1150, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 211, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 12865, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 12654, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 2, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 9846, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 9844, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 83996, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 231800 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-03-27T08:42:23.121 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 20149, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 644, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 15490, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 63, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 2180, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7115, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 20.314269928, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002855132 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 35, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.046996052, 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001342744 2024-03-27T08:42:23.122 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2227, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 16.773306418, 2024-03-27T08:42:23.123 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.007531794 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.124 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.125 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-03-27T08:42:23.126 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 532, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.411539665, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004532969 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.127 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000513360, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000513360 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 335, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.058399418, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003159401 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003348511, 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001674255 2024-03-27T08:42:23.128 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-03-27T08:42:23.129 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 136, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 3.420093660, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.025147747 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:23.130 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.013389416, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002231569 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:23.131 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-03-27T08:42:23.132 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.036751161, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.005250165 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.133 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2666, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8.045692650, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003017889 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-03-27T08:42:23.134 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 2, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 1, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 3908, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 3908, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 432, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 360, 2024-03-27T08:42:23.135 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 360, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:23.136 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:23.137 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 282639, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 109, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-03-27T08:42:23.138 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 158, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 276550, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 3149, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-03-27T08:42:23.139 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 15745, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 56201004, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 37, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 15745, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 15745, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 733.291083801, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.046572949 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.140 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 15745, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 33443 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 15745, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 1498, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 14247, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 688, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 7759, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 123, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 1427, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 176, 2024-03-27T08:42:23.141 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 11, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 3401, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1375, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 15518, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-03-27T08:42:23.142 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-03-27T08:42:23.143 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 90, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 3, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 2771, 2024-03-27T08:42:23.144 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 10, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 184 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 20, 2024-03-27T08:42:23.145 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 10, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 2856, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 2796, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 69519, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 19152830, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 69519, 2024-03-27T08:42:23.146 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 69519, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 19152830, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:23.147 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 15745, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 56483388, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 15745, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 56483388, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.148 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 15745, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 15745, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 15745, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 15745, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.149 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2796, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 282452, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2796, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 118, 2024-03-27T08:42:23.150 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 282452, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x5604fe176500": { 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 21791, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 44872338, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 21791, 2024-03-27T08:42:23.151 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1309, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 44872338, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:23.152 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-03-27T08:42:23.994 INFO:tasks.check_counter:Daemon mds.b mds.exported=66 2024-03-27T08:42:23.994 INFO:tasks.check_counter:Daemon mds.b mds.imported=39 2024-03-27T08:42:23.994 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=512 2024-03-27T08:42:23.994 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1483 2024-03-27T08:42:23.994 DEBUG:tasks.check_counter:Getting stats from e 2024-03-27T08:42:23.994 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.e perf dump 2024-03-27T08:42:24.498 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:42:24.968 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:24 smithi167 ceph-mon[34903]: pgmap v653: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:25.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:24 smithi164 ceph-mon[31788]: pgmap v653: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:25.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:24 smithi173 ceph-mon[35397]: pgmap v653: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:26.736 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 21025, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 38629, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 7223289, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 35366320, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 16, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 3.188528515, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.487717923, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.796086176, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.097550419, 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:26.737 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 38628, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.901574488, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000075115 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 45414, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.013749963, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000302 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-27T08:42:26.738 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 15315, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 16647, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 4256864, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 14863717, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 10, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 7, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.328764927, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.187246274, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.230806542, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.140761881, 2024-03-27T08:42:26.739 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 16645, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.147544439, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000068942 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 25346, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.007522986, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000296 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 263168 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 17231, 2024-03-27T08:42:26.740 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 19995, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 9615938, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 15939044, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 14, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.757648712, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.440119606, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.403488228, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.159407576, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 19994, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.234967279, 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000111781 2024-03-27T08:42:26.741 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 27804, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.012403482, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000446 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 525552, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 108016 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-03-27T08:42:26.742 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3619, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 11.541893424, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003189249 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8321, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.189710365, 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000142976 2024-03-27T08:42:26.743 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 11000, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 10719, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10719, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 32.500068744, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003032005 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 281, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-03-27T08:42:26.744 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 20, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 1, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 18, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 1, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 7, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 10, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 14, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 2362, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 3, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 15703, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 13519, 2024-03-27T08:42:26.745 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 257, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 382, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 38, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 1625, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 43, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 3840, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 1657, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:26.746 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 1657, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 138, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 138, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 1519, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 82, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 1251, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 8191, 2024-03-27T08:42:26.747 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 7673, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 3267, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 108, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 12571 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 635, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 1212, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 789, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 822, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 1214, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 1, 2024-03-27T08:42:26.748 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 5002, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 5001, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 39, 2024-03-27T08:42:26.749 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 1, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 18440, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 18440, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 24, 2024-03-27T08:42:26.750 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 24, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 3, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 39974696, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1229, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 11.379354668, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.009259035 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-03-27T08:42:26.751 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 22, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 6694, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 6672, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 20, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 844, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 824, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 18, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 10819, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 10801, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 6303, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 6303, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 75600, 2024-03-27T08:42:26.752 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223608 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 14593, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 1342, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 11000, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 22, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 3494, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2470, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 6.413474596, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002596548 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7, 2024-03-27T08:42:26.753 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.011815318, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001687902 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2528, 2024-03-27T08:42:26.754 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.760519713, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000696408 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.755 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.756 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.757 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-03-27T08:42:26.757 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.757 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.757 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 91, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.344362861, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003784207 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-03-27T08:42:26.758 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 616, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.630265348, 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004269911 2024-03-27T08:42:26.759 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.760 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 280, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 7.865735696, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.028091913 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:26.761 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 5, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.011672458, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002334491 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:26.762 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.763 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4722, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 13.462222754, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002850957 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.764 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 1, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 0, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 3682, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 3682, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 434, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.765 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:26.766 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:26.767 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 301153, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 125, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:26.768 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 158, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 89866, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 624, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-03-27T08:42:26.769 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 8689, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 36882344, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 26, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 8689, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8689, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 39.795302856, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004579963 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8689, 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8958 2024-03-27T08:42:26.770 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 8689, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 1877, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 6812, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 220, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 1449, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 122, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-03-27T08:42:26.771 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 1, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 5053, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1657, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:26.774 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-03-27T08:42:26.775 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-03-27T08:42:26.776 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 90, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 2, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 302, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 124 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-03-27T08:42:26.777 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 18, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 10, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 5033, 2024-03-27T08:42:26.778 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 5001, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 53567, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 16261348, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 53567, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:26.779 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 53567, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 16261348, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:26.780 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 8689, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 37387477, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 8689, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 37387477, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-03-27T08:42:26.781 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 8689, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 8689, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 8689, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 8689, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.782 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 5001, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 505133, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 5001, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 220, 2024-03-27T08:42:26.783 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 505133, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x5566d48d0500": { 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 18440, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 35780392, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 18440, 2024-03-27T08:42:26.784 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1229, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 35780392, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:26.785 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-03-27T08:42:26.785 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:26 smithi167 ceph-mon[34903]: pgmap v654: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:27.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:26 smithi164 ceph-mon[31788]: pgmap v654: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:27.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:26 smithi173 ceph-mon[35397]: pgmap v654: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:27.723 INFO:tasks.check_counter:Daemon mds.e mds.exported=38 2024-03-27T08:42:27.723 INFO:tasks.check_counter:Daemon mds.e mds.imported=43 2024-03-27T08:42:27.724 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=635 2024-03-27T08:42:27.724 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=1212 2024-03-27T08:42:27.724 DEBUG:tasks.check_counter:Getting stats from h 2024-03-27T08:42:27.724 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.h perf dump 2024-03-27T08:42:28.183 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:42:29.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:28 smithi164 ceph-mon[31788]: pgmap v655: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:29.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:28 smithi167 ceph-mon[34903]: pgmap v655: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:29.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:28 smithi173 ceph-mon[35397]: pgmap v655: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-03-27T08:42:30.377 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 24943, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 24827, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 11647313, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 25162344, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 11, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 3.609622729, 2024-03-27T08:42:30.378 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.950366053, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 2.029266684, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.080004013, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 24827, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.585575171, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000104143 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 42994, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017963264, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000417 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.379 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 16089, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 29422, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 5587606, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 18240938, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 23, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 8, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 2.411883364, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.124148778, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.356770327, 2024-03-27T08:42:30.380 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.072589024, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 29419, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.853575818, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000096997 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 32806, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.009897054, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000301 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 4080, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 265648 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.381 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2346, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2333, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1548440, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 5378588, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.300700312, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.110629482, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.089395825, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.081231872, 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:30.382 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2332, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.266388684, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000114231 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 530208, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 285616 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-03-27T08:42:30.383 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2428, 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 8.107222396, 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003339053 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:30.384 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6711, 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.751850890, 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000112032 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.386 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-03-27T08:42:30.386 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 8414, 2024-03-27T08:42:30.386 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 7948, 2024-03-27T08:42:30.386 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-03-27T08:42:30.386 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 7948, 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 26.913999896, 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003386260 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 466, 2024-03-27T08:42:30.387 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-03-27T08:42:30.388 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-03-27T08:42:30.388 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 11, 2024-03-27T08:42:30.388 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-03-27T08:42:30.388 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-03-27T08:42:30.388 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 70, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 28, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 13, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 29, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 29, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 2285, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 3, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 3, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 4, 2024-03-27T08:42:30.389 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 13862, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 10594, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 450, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 514, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 19, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 1546, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 41, 2024-03-27T08:42:30.390 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 3895, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 565, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 565, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 10, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 10, 2024-03-27T08:42:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 555, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 8, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 695, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 5951, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 5561, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 1734, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 108, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 9493 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-03-27T08:42:30.392 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 351, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 1606, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 1051, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 1096, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 632, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 16, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 3957, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 3941, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:30.393 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 20, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-03-27T08:42:30.394 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 1, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 12293, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 12293, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 17, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 17, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 3, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-03-27T08:42:30.395 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 28272102, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 988, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 6.289934595, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.006366330 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 43, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 5691, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 5648, 2024-03-27T08:42:30.396 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 42, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 829, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 787, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 70, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 8610, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 8540, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 3, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 5278, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 5275, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 73756, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223608 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 12582, 2024-03-27T08:42:30.397 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 535, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 8414, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 20, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 1931, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1563, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 4.282172398, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002739713 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 4, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003624345, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000906086 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.398 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2100, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 4.911591477, 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002338853 2024-03-27T08:42:30.399 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.400 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.401 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-03-27T08:42:30.402 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.403 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 324, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.866991058, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002675898 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 201, 2024-03-27T08:42:30.405 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 5.407950136, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.026905224 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-03-27T08:42:30.406 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.407 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.408 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3756, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 11.441670482, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003046238 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.409 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 2, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 1, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 2885, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 2885, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 436, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:30.410 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:30.411 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:30.412 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 292651, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 121, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:30.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 158, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 207438, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 3396, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:30.414 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 6152, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 24727873, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 33, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 6152, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6152, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 30.237471127, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.004915063 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.415 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 6152, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 6386 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 6152, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 737, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 5415, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 172, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 1160, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 112, 2024-03-27T08:42:30.416 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 3974, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 565, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-03-27T08:42:30.417 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-03-27T08:42:30.418 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 90, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 2, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-03-27T08:42:30.419 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 270, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 103 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-03-27T08:42:30.420 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 18, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 10, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 3957, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 3941, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 43374, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 14865496, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:30.421 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 43374, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 43374, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 14865496, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:30.422 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 6152, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 25125930, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 6152, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 25125930, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 6152, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 6152, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 6152, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 6152, 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:30.424 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 3941, 2024-03-27T08:42:30.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 398057, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 3941, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 172, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 398057, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.426 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55a2eac8e500": { 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 12293, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 24077798, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 12293, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 988, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 24077798, 2024-03-27T08:42:30.427 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:30.428 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-03-27T08:42:30.908 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:30 smithi167 ceph-mon[34903]: pgmap v656: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:31.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:30 smithi164 ceph-mon[31788]: pgmap v656: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:31.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:30 smithi173 ceph-mon[35397]: pgmap v656: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 597 B/s wr, 5 op/s 2024-03-27T08:42:31.517 INFO:tasks.check_counter:Daemon mds.h mds.exported=19 2024-03-27T08:42:31.517 INFO:tasks.check_counter:Daemon mds.h mds.imported=41 2024-03-27T08:42:31.517 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=351 2024-03-27T08:42:31.518 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1606 2024-03-27T08:42:31.518 DEBUG:tasks.check_counter:Getting stats from k 2024-03-27T08:42:31.518 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.k perf dump 2024-03-27T08:42:32.093 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.b/config 2024-03-27T08:42:32.819 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:32 smithi167 ceph-mon[34903]: pgmap v657: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:42:33.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:32 smithi164 ceph-mon[31788]: pgmap v657: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:42:33.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:32 smithi173 ceph-mon[35397]: pgmap v657: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:42:33.777 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:33 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:42:34.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:33 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:42:34.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:33 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1220, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1222, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 20068434, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 387970, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.232623934, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.080630805, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.084327089, 2024-03-27T08:42:34.339 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.048971481, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1220, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.067596640, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000055407 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:34.340 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 316, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 443, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 16859739, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 398324, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.088640817, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.019182482, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.053586991, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.010846599, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 442, 2024-03-27T08:42:34.341 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.029950964, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000067762 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 299360 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 588, 2024-03-27T08:42:34.342 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 576, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 9012616, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 232599, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.129644638, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.037356823, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.064715135, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.025103563, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 575, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.037230000, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000064747 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.343 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 520320, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 106352 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-03-27T08:42:34.344 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3269, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.238897299, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000073079 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.345 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-03-27T08:42:34.346 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 3101, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 1427, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 1674, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 1062, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-03-27T08:42:34.347 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 2, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-03-27T08:42:34.348 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:34.349 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-03-27T08:42:34.350 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:34.351 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-03-27T08:42:34.352 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-03-27T08:42:34.353 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 21792, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 31, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 45745208, 2024-03-27T08:42:34.354 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 49068294, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 49066642, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 21792 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 29, 2024-03-27T08:42:34.355 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 9731, 2024-03-27T08:42:34.359 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 9702, 2024-03-27T08:42:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 26, 2024-03-27T08:42:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 792, 2024-03-27T08:42:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 766, 2024-03-27T08:42:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 3101, 2024-03-27T08:42:34.360 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 12279, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 9178, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 58764, 2024-03-27T08:42:34.361 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215416 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-03-27T08:42:34.362 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.363 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.364 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-03-27T08:42:34.365 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.366 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.366 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.366 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.366 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-03-27T08:42:34.366 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.367 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.368 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.369 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:34.370 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.371 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.372 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-03-27T08:42:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.373 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-03-27T08:42:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.374 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-03-27T08:42:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.375 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.376 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-03-27T08:42:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.377 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:34.378 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.379 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.380 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.381 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.382 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:34.382 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.382 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.382 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.383 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.383 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-03-27T08:42:34.383 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.383 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.383 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.384 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.385 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-03-27T08:42:34.386 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.387 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.388 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.389 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-03-27T08:42:34.390 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 2, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 1, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 1, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-03-27T08:42:34.391 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 1899, 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:34.392 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:34.393 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:34.394 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:34.395 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:34.396 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:34.397 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 206327, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 60, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:34.398 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:34.399 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 158, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:34.400 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 2281185, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 14219, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:34.401 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 1928, 2024-03-27T08:42:34.402 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 26, 2024-03-27T08:42:34.403 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 4, 2024-03-27T08:42:34.403 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 1928, 2024-03-27T08:42:34.403 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-03-27T08:42:34.403 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1928, 2024-03-27T08:42:34.403 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.084963133, 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001081412 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1928, 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1929 2024-03-27T08:42:34.404 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 1928, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 1928, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-03-27T08:42:34.405 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1136, 2024-03-27T08:42:34.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-03-27T08:42:34.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 789, 2024-03-27T08:42:34.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-03-27T08:42:34.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-03-27T08:42:34.406 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-03-27T08:42:34.407 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 2, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:34.408 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-03-27T08:42:34.409 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-03-27T08:42:34.410 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-03-27T08:42:34.411 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 90, 2024-03-27T08:42:34.412 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 2, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 7, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 7, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-03-27T08:42:34.413 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-03-27T08:42:34.414 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-03-27T08:42:34.415 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:34.416 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2120, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 45737198, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2120, 2024-03-27T08:42:34.417 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2120, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 45737198, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.418 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:34.419 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1928, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 44879575, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1928, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 44879575, 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:34.420 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:34.421 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:34.422 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 1928, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 1928, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 1928, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1928, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:34.423 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.424 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x555f93bc0780": { 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-03-27T08:42:34.425 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-03-27T08:42:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-03-27T08:42:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.426 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-03-27T08:42:34.426 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-03-27T08:42:35.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: pgmap v658: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:42:35.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:34 smithi164 ceph-mon[31788]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: pgmap v658: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:42:35.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:34 smithi167 ceph-mon[34903]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: pgmap v658: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 255 B/s wr, 5 op/s 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-27T08:42:35.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:34 smithi173 ceph-mon[35397]: from='mgr.14152 172.21.15.164:0/950928515' entity='mgr.x' 2024-03-27T08:42:35.269 INFO:tasks.check_counter:Daemon mds.k mds.exported=0 2024-03-27T08:42:35.270 INFO:tasks.check_counter:Daemon mds.k mds.imported=0 2024-03-27T08:42:35.270 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=0 2024-03-27T08:42:35.270 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=0 2024-03-27T08:42:35.270 DEBUG:tasks.check_counter:Getting stats from c 2024-03-27T08:42:35.270 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.c perf dump 2024-03-27T08:42:35.739 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:42:35.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:35 smithi173 ceph-mon[35397]: Adjusting osd_memory_target on smithi173 to 176.8M 2024-03-27T08:42:35.945 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:35 smithi173 ceph-mon[35397]: Unable to set osd_memory_target on smithi173 to 185393152: error parsing value: Value '185393152' is below minimum 939524096 2024-03-27T08:42:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:35 smithi164 ceph-mon[31788]: Adjusting osd_memory_target on smithi173 to 176.8M 2024-03-27T08:42:36.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:35 smithi164 ceph-mon[31788]: Unable to set osd_memory_target on smithi173 to 185393152: error parsing value: Value '185393152' is below minimum 939524096 2024-03-27T08:42:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:35 smithi167 ceph-mon[34903]: Adjusting osd_memory_target on smithi173 to 176.8M 2024-03-27T08:42:36.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:35 smithi167 ceph-mon[34903]: Unable to set osd_memory_target on smithi173 to 185393152: error parsing value: Value '185393152' is below minimum 939524096 2024-03-27T08:42:36.954 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:36 smithi173 ceph-mon[35397]: pgmap v659: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:37.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:36 smithi164 ceph-mon[31788]: pgmap v659: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:37.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:36 smithi167 ceph-mon[34903]: pgmap v659: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:37.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:37 smithi173 ceph-mon[35397]: pgmap v660: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:38.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:37 smithi164 ceph-mon[31788]: pgmap v660: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:38.049 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-03-27T08:42:38.049 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 463, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 463, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 12706883, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 146474, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 7, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.143748429, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.034355951, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.070282392, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.025848701, 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:38.050 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 462, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.050202863, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000108664 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 448 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:38.051 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 482, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 608, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 14930632, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 421091, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 5, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.164943266, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.050168227, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.072545406, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.029446925, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 606, 2024-03-27T08:42:38.052 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.064922941, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000107133 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 268128 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1011, 2024-03-27T08:42:38.053 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 999, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 9164114, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 365982, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.273538824, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.088044394, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.114777560, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.058008404, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 998, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.098924711, 2024-03-27T08:42:38.054 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000099122 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 519072, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 103632 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-03-27T08:42:38.055 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3000, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.166954878, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000055651 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.056 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-03-27T08:42:38.057 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 5028, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 5028, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 5028, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-03-27T08:42:38.058 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:38.059 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-03-27T08:42:38.060 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-03-27T08:42:38.061 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:38.062 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-03-27T08:42:38.063 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 18440, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 24, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 3, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-03-27T08:42:38.064 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 39974696, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 39973558, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 18440 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 14, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 6348, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 6334, 2024-03-27T08:42:38.065 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 12, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 495, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 483, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 5028, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 10196, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 5168, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 55936, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215416 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-03-27T08:42:38.066 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.067 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.068 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.069 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-03-27T08:42:38.070 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.071 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.071 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.071 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.072 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:37 smithi167 ceph-mon[34903]: pgmap v660: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-03-27T08:42:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-03-27T08:42:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.072 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.073 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:38.074 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.075 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.076 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.077 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.078 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.079 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 1, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 0, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1897, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:38.080 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:38.081 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:38.082 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 223271, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 70, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-03-27T08:42:38.083 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 3586829, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 20503, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-03-27T08:42:38.084 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 1765, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 1765, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1765, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 2.319944901, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001314416 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.085 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1765, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1766 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 1765, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1765, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 1027, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 736, 2024-03-27T08:42:38.086 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:38.087 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-03-27T08:42:38.088 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 90, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 9, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 9, 2024-03-27T08:42:38.089 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-03-27T08:42:38.090 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:38.091 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 1952, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 36613412, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 1952, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1952, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 36613412, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.092 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1765, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 35781923, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1765, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 35781923, 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:38.093 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:38.094 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1765, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 1765, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1765, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1765, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:38.095 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:38.096 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x5587b35e8780": { 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:38.097 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:38.098 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:38.098 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.098 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:38.098 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-03-27T08:42:39.043 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-03-27T08:42:39.043 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-03-27T08:42:39.043 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-03-27T08:42:39.043 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-03-27T08:42:39.043 DEBUG:tasks.check_counter:Getting stats from f 2024-03-27T08:42:39.043 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.f perf dump 2024-03-27T08:42:39.493 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:42:40.723 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:40 smithi173 ceph-mon[35397]: pgmap v661: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T08:42:40.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:40 smithi164 ceph-mon[31788]: pgmap v661: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T08:42:41.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:40 smithi167 ceph-mon[34903]: pgmap v661: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-03-27T08:42:41.677 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-03-27T08:42:41.677 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:41.677 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 176, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 171, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 469328, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 104176, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.069031858, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.025405648, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.038331027, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008082511, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 171, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.018912980, 2024-03-27T08:42:41.678 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000110602 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 469328, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 104176 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 128, 2024-03-27T08:42:41.679 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 160, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 68336, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.015938712, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.011538188, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001511108, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 126, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.012649939, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000100396 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:41.680 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 160, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 68336 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 0, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 0, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 0, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:41.681 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.000821252, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.000626569, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:41.682 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:41.683 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:41.684 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:41.685 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 148945, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 29, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:41.686 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:41.687 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 173, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 442032, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 173, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 173, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 442032, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:41.688 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:41.689 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:41.689 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:41.689 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-03-27T08:42:42.553 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.f 2024-03-27T08:42:42.553 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.f 2024-03-27T08:42:42.553 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.f 2024-03-27T08:42:42.553 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.f 2024-03-27T08:42:42.553 DEBUG:tasks.check_counter:Getting stats from i 2024-03-27T08:42:42.554 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.i perf dump 2024-03-27T08:42:42.825 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:42 smithi173 ceph-mon[35397]: pgmap v662: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-03-27T08:42:43.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:42 smithi164 ceph-mon[31788]: pgmap v662: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-03-27T08:42:43.006 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:42:43.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:42 smithi167 ceph-mon[34903]: pgmap v662: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-03-27T08:42:44.934 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:44 smithi173 ceph-mon[35397]: pgmap v663: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:45.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:44 smithi164 ceph-mon[31788]: pgmap v663: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:45.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:44 smithi167 ceph-mon[34903]: pgmap v663: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:45.141 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-03-27T08:42:45.141 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:45.141 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 1540, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 1542, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 17221425, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 489727, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 6, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.350031831, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.114803505, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.118023772, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.087837391, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1540, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.125276144, 2024-03-27T08:42:45.142 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000081348 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 140, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 264, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 4231594, 2024-03-27T08:42:45.143 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 313184, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 5, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 4, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.060160987, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.021071491, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.023634757, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.009661607, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 263, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.028741251, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000109282 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.144 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 270192 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 329, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 317, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3661670, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 148626, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 3, 2024-03-27T08:42:45.145 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.110119174, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.035696896, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.059256675, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.017658835, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 316, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.033011300, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000104466 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.146 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 519136, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 103152 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 1, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-MDSRank": { 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 3087, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.160138142, 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000051875 2024-03-27T08:42:45.147 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "finisher-PurgeQueue": { 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "queue_len": 0, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "complete_latency": { 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "mds": { 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "request": 0, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "reply": 0, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "reply_latency": { 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.148 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_reply": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "forward": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_complete": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_fetch_keys": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_commit": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_split": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_merge": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes": 4410, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_top": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_bottom": 4410, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pin_tail": 0, 2024-03-27T08:42:45.149 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_pinned": 4410, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_expired": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "inodes_with_caps": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "caps": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "subtrees": 1, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_hit": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_forward": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_discover": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_dir_fetch": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_remote_ino": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "traverse_lock": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "load_cent": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "q": 0, 2024-03-27T08:42:45.150 INFO:teuthology.orchestra.run.smithi173.stdout: "exported": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "exported_inodes": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "imported": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "imported_inodes": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_dir_fetch": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_backtrace_fetch": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "openino_peer_discover": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rfiles": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rbytes": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "root_rsnaps": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_fetch": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_set_tag": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_backtrace_repaired": 0, 2024-03-27T08:42:45.151 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_inotable_repaired": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_inodes": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dir_base_inodes": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_dirfrag_rstats": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "scrub_file_inodes": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_inode_file_caps": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_revoke": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_grant": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_trunc": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "ceph_cap_op_flush_ack": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps": 0, 2024-03-27T08:42:45.152 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_caps_dirty": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_cap_release": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "process_request_cap_release": 0 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_cache": { 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_update_receipt": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_try_discover": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_send_discover": 0, 2024-03-27T08:42:45.153 INFO:teuthology.orchestra.run.smithi173.stdout: "dir_handle_discover": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_delayed": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_strays_enqueuing": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_created": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_enqueued": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_reintegrated": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "strays_migrated": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_processing": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_enqueued": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "num_recovering_prioritized": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_started": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "recovery_completed": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_path": 0, 2024-03-27T08:42:45.154 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_quiesce_inode": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_enqueue_scrub": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_exportdir": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_flush": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragmentdir": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_fragstats": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ireq_inodestats": 0 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_log": { 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "evlrg": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "evadd": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "evex": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "evtrm": 0, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "ev": 12293, 2024-03-27T08:42:45.155 INFO:teuthology.orchestra.run.smithi173.stdout: "evexg": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "evexd": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segadd": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segex": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segtrm": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "seg": 17, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segmjr": 3, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segexg": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "segexd": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "expos": 4194304, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "wrpos": 28272102, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "rdpos": 28270964, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "jlat": { 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.156 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "replayed": 12293 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_mem": { 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "ino": 29, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "ino+": 5288, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "ino-": 5259, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dir": 27, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dir+": 371, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dir-": 344, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dn": 4410, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dn+": 7898, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "dn-": 3488, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "cap": 0, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "cap+": 0, 2024-03-27T08:42:45.157 INFO:teuthology.orchestra.run.smithi173.stdout: "cap-": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "rss": 55968, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "heap": 215416 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_server": { 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_client_request": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "dispatch_server_request": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_request": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_client_session": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "handle_peer_request": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "req_create_latency": { 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.158 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getattr_latency": { 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getfilelock_latency": { 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "req_link_latency": { 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.159 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookup_latency": { 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookuphash_latency": { 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupino_latency": { 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.160 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupname_latency": { 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupparent_latency": { 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lookupsnap_latency": { 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.161 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: "req_lssnap_latency": { 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.162 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mkdir_latency": { 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mknod_latency": { 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "req_mksnap_latency": { 2024-03-27T08:42:45.163 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "req_open_latency": { 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "req_readdir_latency": { 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.164 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rename_latency": { 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "req_renamesnap_latency": { 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "req_snapdiff_latency": { 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.165 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmdir_latency": { 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmsnap_latency": { 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "req_rmxattr_latency": { 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.166 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setattr_latency": { 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setdirlayout_latency": { 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setfilelock_latency": { 2024-03-27T08:42:45.167 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setlayout_latency": { 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "req_setxattr_latency": { 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "req_symlink_latency": { 2024-03-27T08:42:45.168 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "req_unlink_latency": { 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_revoke_eviction": 0, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "cap_acquisition_throttle": 0, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "req_getvxattr_latency": { 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.169 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_sessions": { 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "session_count": 1, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "session_add": 2, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "session_remove": 1, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_open": 1, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "sessions_stale": 0, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "total_load": 0, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "average_load": 0, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "avg_session_uptime": 1905, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "mdthresh_evicted": 0 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.170 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:45.171 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:45.172 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 198327, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 58, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:45.173 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 7528, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 158, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 3209098, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 23714, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-03-27T08:42:45.174 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "objecter": { 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_active": 0, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_laggy": 0, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send": 1818, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_send_bytes": 21, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_resend": 3, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_reply": 1818, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_latency": { 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1818, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1.949953671, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.001072581 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "op_inflight": 0, 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "oplen_avg": { 2024-03-27T08:42:45.175 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 1818, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 1819 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "op": 1818, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "op_r": 1818, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "op_w": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "op_rmw": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "op_pg": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_stat": 1098, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_create": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_read": 718, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_write": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writefull": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_writesame": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_append": 0, 2024-03-27T08:42:45.176 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_zero": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_truncate": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_delete": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_mapext": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_sparse_read": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_clonerange": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_getxattr": 1, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_setxattr": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_cmpxattr": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_rmxattr": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_resetxattrs": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_call": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_watch": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_notify": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_src_cmpxattr": 0, 2024-03-27T08:42:45.177 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_pgls_filter": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "osdop_other": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_active": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_send": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_resend": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "linger_ping": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_active": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_send": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolop_resend": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_active": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_send": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "poolstat_resend": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_active": 0, 2024-03-27T08:42:45.178 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_send": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "statfs_resend": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "command_active": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "command_send": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "command_resend": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "map_epoch": 90, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "map_full": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "map_inc": 2, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_sessions": 6, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_open": 6, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_session_close": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_laggy": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_wr": 0, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_rd": 2, 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_del": 0 2024-03-27T08:42:45.179 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "oft": { 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_objs": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_kv_pairs": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_updates": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "omap_total_removes": 0 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "osd-slow-ops": { 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "slow_ops_count": 0 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "purge_queue": { 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_ops_high_water": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executing_high_water": 0, 2024-03-27T08:42:45.180 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed_ops": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_executed": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "pq_item_in_journal": 0 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 2005, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 24921702, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 2005, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 2005, 2024-03-27T08:42:45.181 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 24921702, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_bytes": { 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:45.182 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1818, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 24081385, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1818, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 24081385, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-objecter_ops": { 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 1024, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:45.183 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 1818, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 1818, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 1818, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 1818, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.184 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle": { 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.185 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-write_buf_throttle-0x564abe236780": { 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 3758096384, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 0, 2024-03-27T08:42:45.186 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 0, 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:45.187 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-03-27T08:42:46.120 INFO:tasks.check_counter:Daemon mds.i mds.exported=0 2024-03-27T08:42:46.120 INFO:tasks.check_counter:Daemon mds.i mds.imported=0 2024-03-27T08:42:46.120 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=0 2024-03-27T08:42:46.120 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=0 2024-03-27T08:42:46.120 DEBUG:tasks.check_counter:Getting stats from l 2024-03-27T08:42:46.121 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0 shell --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 -- ceph daemon mds.l perf dump 2024-03-27T08:42:46.587 INFO:teuthology.orchestra.run.smithi173.stderr:Inferring config /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/mon.c/config 2024-03-27T08:42:46.935 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:46 smithi173 ceph-mon[35397]: pgmap v664: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T08:42:47.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:46 smithi164 ceph-mon[31788]: pgmap v664: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T08:42:47.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:46 smithi167 ceph-mon[34903]: pgmap v664: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 6 op/s 2024-03-27T08:42:48.791 INFO:teuthology.orchestra.run.smithi173.stdout:{ 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-0": { 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 179, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 176, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 468304, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 107728, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 4, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 0, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.068795750, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.026127389, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.036172004, 2024-03-27T08:42:48.792 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.008322899, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 175, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.018310346, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000104630 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 468304, 2024-03-27T08:42:48.793 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 107728 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-1": { 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 5, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 136, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 3152, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 69840, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 3, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 2, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.016184640, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.011642112, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.001520363, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:48.794 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 135, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.014840434, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000109929 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 3152, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 69840 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "AsyncMessenger::Worker-2": { 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_messages": 0, 2024-03-27T08:42:48.795 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages": 2, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_bytes": 0, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_bytes": 0, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_created_connections": 2, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_active_connections": 1, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_total_time": 0.000793304, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_send_time": 0.000000000, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_recv_time": 0.000653604, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_messages_queue_lat": { 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.796 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_handle_ack_lat": { 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_recv_encrypted_bytes": 0, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "msgr_send_encrypted_bytes": 0 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "cct": { 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "total_workers": 0, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "unhealthy_workers": 0 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "mempool": { 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_bytes": 0, 2024-03-27T08:42:48.797 INFO:teuthology.orchestra.run.smithi173.stdout: "bloom_filter_items": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_bytes": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_alloc_items": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_bytes": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_data_items": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_bytes": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_onode_items": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_bytes": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_meta_items": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_bytes": 0, 2024-03-27T08:42:48.798 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_other_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_cache_buffer_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_extent_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_blob_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_shared_blob_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_inline_bl_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_fsck_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_txc_items": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_bytes": 0, 2024-03-27T08:42:48.799 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_deferred_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluestore_writing_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_reader_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "bluefs_file_writer_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_bytes": 149047, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_anon_items": 31, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "buffer_meta_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_bytes": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_items": 0, 2024-03-27T08:42:48.800 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_mapbl_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osd_pglog_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "osdmap_mapping_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "pgmap_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_bytes": 928, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "mds_co_items": 2, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_1_items": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_bytes": 0, 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: "unittest_2_items": 0 2024-03-27T08:42:48.801 INFO:teuthology.orchestra.run.smithi173.stdout: }, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "val": 0, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "max": 104857600, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "get_started": 0, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "get": 180, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "get_sum": 443006, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_fail": 0, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "get_or_fail_success": 180, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "take": 0, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "take_sum": 0, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "put": 180, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "put_sum": 443006, 2024-03-27T08:42:48.802 INFO:teuthology.orchestra.run.smithi173.stdout: "wait": { 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout: "avgcount": 0, 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout: "sum": 0.000000000, 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout: "avgtime": 0.000000000 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout: } 2024-03-27T08:42:48.803 INFO:teuthology.orchestra.run.smithi173.stdout:} 2024-03-27T08:42:48.864 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:48 smithi173 ceph-mon[35397]: pgmap v665: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:42:49.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:48 smithi164 ceph-mon[31788]: pgmap v665: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:42:49.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:48 smithi167 ceph-mon[34903]: pgmap v665: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-03-27T08:42:49.598 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-03-27T08:42:49.598 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-03-27T08:42:49.598 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-03-27T08:42:49.598 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-03-27T08:42:49.598 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-27T08:42:49.653 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-27T08:42:49.653 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:42:49.653 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T08:42:49.713 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:42:49.713 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T08:42:49.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.988+0000 7fabd5000640 1 -- 172.21.15.164:0/1846326653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 msgr2=0x7fabd0101f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.988+0000 7fabd5000640 1 --2- 172.21.15.164:0/1846326653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0101f80 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fabc0009900 tx=0x7fabc002bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.988+0000 7fabd5000640 1 -- 172.21.15.164:0/1846326653 shutdown_connections 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.988+0000 7fabd5000640 1 --2- 172.21.15.164:0/1846326653 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0103710 0x7fabd0109fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.988+0000 7fabd5000640 1 --2- 172.21.15.164:0/1846326653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0102d50 0x7fabd01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.989+0000 7fabd5000640 1 --2- 172.21.15.164:0/1846326653 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0101f80 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.989+0000 7fabd5000640 1 -- 172.21.15.164:0/1846326653 >> 172.21.15.164:0/1846326653 conn(0x7fabd00fd0f0 msgr2=0x7fabd00ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:49.982 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.989+0000 7fabd5000640 1 -- 172.21.15.164:0/1846326653 shutdown_connections 2024-03-27T08:42:49.983 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.989+0000 7fabd5000640 1 -- 172.21.15.164:0/1846326653 wait complete. 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 Processor -- start 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 -- start start 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0102d50 0x7fabd0073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 0x7fabd0074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010d7b0 con 0x7fabd0101b60 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010d630 con 0x7fabd0103710 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.990+0000 7fabd5000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fabd010d930 con 0x7fabd0102d50 2024-03-27T08:42:49.984 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60858/0 (socket says 172.21.15.164:60858) 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 -- 172.21.15.164:0/393553189 learned_addr learned my addr 172.21.15.164:0/393553189 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabce800640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 0x7fabd0074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabc7e00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0102d50 0x7fabd0073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 -- 172.21.15.164:0/393553189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0102d50 msgr2=0x7fabd0073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0102d50 0x7fabd0073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 -- 172.21.15.164:0/393553189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 msgr2=0x7fabd0074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 0x7fabd0074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 -- 172.21.15.164:0/393553189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd0074d10 con 0x7fabd0101b60 2024-03-27T08:42:49.985 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabce800640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 0x7fabd0074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:49.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.991+0000 7fabcde00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005ab0 tx=0x7fabc0004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:49.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.992+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0043020 con 0x7fabd0101b60 2024-03-27T08:42:49.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.992+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fabc00054f0 con 0x7fabd0101b60 2024-03-27T08:42:49.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.992+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd01a1f70 con 0x7fabd0101b60 2024-03-27T08:42:49.986 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.992+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0003d10 con 0x7fabd0101b60 2024-03-27T08:42:49.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.992+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01a2380 con 0x7fabd0101b60 2024-03-27T08:42:49.987 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.993+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd0108e80 con 0x7fabd0101b60 2024-03-27T08:42:49.990 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.997+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fabc0046020 con 0x7fabd0101b60 2024-03-27T08:42:49.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.998+0000 7fabc6a00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 0x7fabb40a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:49.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.998+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fabc00f2220 con 0x7fabd0101b60 2024-03-27T08:42:49.991 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:49.999+0000 7fabc7e00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 0x7fabb40a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:49.992 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.000+0000 7fabc7e00640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 0x7fabb40a5ad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005fd0 tx=0x7fabb8005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:49.994 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.001+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fabc004d070 con 0x7fabd0101b60 2024-03-27T08:42:50.201 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.208+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fabd002d4f0 con 0x7fabd0101b60 2024-03-27T08:42:50.205 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.212+0000 7fabc6a00640 1 -- 172.21.15.164:0/393553189 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7fabc00beda0 con 0x7fabd0101b60 2024-03-27T08:42:50.205 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:42:50.206 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.214+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 msgr2=0x7fabb40a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.214+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 0x7fabb40a5ad0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fabb8005fd0 tx=0x7fabb8005850 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.214+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 msgr2=0x7fabd0075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.214+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fabc0005ab0 tx=0x7fabc0004e90 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 shutdown_connections 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fabb40a3610 0x7fabb40a5ad0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fabd0103710 0x7fabd0074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fabd0102d50 0x7fabd0073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 --2- 172.21.15.164:0/393553189 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fabd0101b60 0x7fabd0075900 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.208 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 >> 172.21.15.164:0/393553189 conn(0x7fabd00fd0f0 msgr2=0x7fabd0106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:50.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 shutdown_connections 2024-03-27T08:42:50.209 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.215+0000 7fabd5000640 1 -- 172.21.15.164:0/393553189 wait complete. 2024-03-27T08:42:50.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:42:50.229 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:42:50.445 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 -- 172.21.15.164:0/1814160852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8100440 msgr2=0x7fd8a8100860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 --2- 172.21.15.164:0/1814160852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8100440 0x7fd8a8100860 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7fd898009900 tx=0x7fd89802bcd0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 -- 172.21.15.164:0/1814160852 shutdown_connections 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 --2- 172.21.15.164:0/1814160852 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8101740 0x7fd8a8101bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 --2- 172.21.15.164:0/1814160852 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100da0 0x7fd8a8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 --2- 172.21.15.164:0/1814160852 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8100440 0x7fd8a8100860 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 -- 172.21.15.164:0/1814160852 >> 172.21.15.164:0/1814160852 conn(0x7fd8a80fbfe0 msgr2=0x7fd8a80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 -- 172.21.15.164:0/1814160852 shutdown_connections 2024-03-27T08:42:50.446 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.452+0000 7fd8ae000640 1 -- 172.21.15.164:0/1814160852 wait complete. 2024-03-27T08:42:50.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 Processor -- start 2024-03-27T08:42:50.449 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 -- start start 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100440 0x7fd8a819a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 0x7fd8a819a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810fa00 con 0x7fd8a8101740 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810f880 con 0x7fd8a8100da0 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8ae000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a810fb80 con 0x7fd8a8100440 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.453+0000 7fd8a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60884/0 (socket says 172.21.15.164:60884) 2024-03-27T08:42:50.450 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 -- 172.21.15.164:0/3243991988 learned_addr learned my addr 172.21.15.164:0/3243991988 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a6a00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 0x7fd8a819a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7400640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100440 0x7fd8a819a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 -- 172.21.15.164:0/3243991988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100440 msgr2=0x7fd8a819a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100440 0x7fd8a819a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 -- 172.21.15.164:0/3243991988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 msgr2=0x7fd8a819a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 0x7fd8a819a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 -- 172.21.15.164:0/3243991988 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a81a1cc0 con 0x7fd8a8101740 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a6a00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 0x7fd8a819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd8a7e00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000eb10 tx=0x7fd8a000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.454+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0004b20 con 0x7fd8a8101740 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.455+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8a0004cc0 con 0x7fd8a8101740 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.455+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a81a1fb0 con 0x7fd8a8101740 2024-03-27T08:42:50.451 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.455+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0010700 con 0x7fd8a8101740 2024-03-27T08:42:50.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.455+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a81a2470 con 0x7fd8a8101740 2024-03-27T08:42:50.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.456+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a810b380 con 0x7fd8a8101740 2024-03-27T08:42:50.452 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.458+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fd8a0004e70 con 0x7fd8a8101740 2024-03-27T08:42:50.453 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.460+0000 7fd89fe00640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 0x7fd88c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.461+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fd8a00d0340 con 0x7fd8a8101740 2024-03-27T08:42:50.454 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.461+0000 7fd8a7400640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 0x7fd88c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.455 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.462+0000 7fd8a7400640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 0x7fd88c0a5b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd898006010 tx=0x7fd898000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:50.458 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.465+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fd8a009cf20 con 0x7fd8a8101740 2024-03-27T08:42:50.660 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.667+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd8a80627f0 con 0x7fd8a8101740 2024-03-27T08:42:50.666 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.673+0000 7fd89fe00640 1 -- 172.21.15.164:0/3243991988 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7fd8a009c820 con 0x7fd8a8101740 2024-03-27T08:42:50.666 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:42:50.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 msgr2=0x7fd88c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 0x7fd88c0a5b50 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd898006010 tx=0x7fd898000bc0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 msgr2=0x7fd8a81a1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.669 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000eb10 tx=0x7fd8a000c2d0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 shutdown_connections 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fd88c0a3690 0x7fd88c0a5b50 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fd8a8101740 0x7fd8a81a1650 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd8a8100da0 0x7fd8a819a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 --2- 172.21.15.164:0/3243991988 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fd8a8100440 0x7fd8a819a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 >> 172.21.15.164:0/3243991988 conn(0x7fd8a80fbfe0 msgr2=0x7fd8a80fd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 shutdown_connections 2024-03-27T08:42:50.670 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.676+0000 7fd8ae000640 1 -- 172.21.15.164:0/3243991988 wait complete. 2024-03-27T08:42:50.690 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 -- 172.21.15.164:0/2954753138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d8109a20 msgr2=0x7f24d810beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 --2- 172.21.15.164:0/2954753138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d8109a20 0x7f24d810beb0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009ca0 tx=0x7f24d002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 -- 172.21.15.164:0/2954753138 shutdown_connections 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 --2- 172.21.15.164:0/2954753138 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d8109a20 0x7f24d810beb0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 --2- 172.21.15.164:0/2954753138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d80745b0 0x7f24d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 --2- 172.21.15.164:0/2954753138 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 0x7f24d8073fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 -- 172.21.15.164:0/2954753138 >> 172.21.15.164:0/2954753138 conn(0x7f24d80fd0f0 msgr2=0x7f24d80ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 -- 172.21.15.164:0/2954753138 shutdown_connections 2024-03-27T08:42:50.907 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.913+0000 7f24dde00640 1 -- 172.21.15.164:0/2954753138 wait complete. 2024-03-27T08:42:50.909 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.914+0000 7f24dde00640 1 Processor -- start 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.914+0000 7f24dde00640 1 -- start start 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 0x7f24d819a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 0x7f24d81a15a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f24d810f9b0 con 0x7f24d80745b0 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24d810f830 con 0x7f24d8109a20 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24dde00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f24d810fb30 con 0x7f24d8075b90 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60898/0 (socket says 172.21.15.164:60898) 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 -- 172.21.15.164:0/1145933641 learned_addr learned my addr 172.21.15.164:0/1145933641 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d7400640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 0x7f24d81a15a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 -- 172.21.15.164:0/1145933641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 msgr2=0x7f24d819a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.910 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6000640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 0x7f24d819a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 0x7f24d819a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 -- 172.21.15.164:0/1145933641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 msgr2=0x7f24d81a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 0x7f24d81a15a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d6a00640 1 -- 172.21.15.164:0/1145933641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d81a1c10 con 0x7f24d80745b0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.915+0000 7f24d7400640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 0x7f24d81a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24d6a00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f24c800e9f0 tx=0x7f24c800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c800ccc0 con 0x7f24d80745b0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f24c800ce60 con 0x7f24d80745b0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24d81a1f00 con 0x7f24d80745b0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24c8010690 con 0x7f24d80745b0 2024-03-27T08:42:50.911 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.916+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24d81a2310 con 0x7f24d80745b0 2024-03-27T08:42:50.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.917+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24d8108750 con 0x7f24d80745b0 2024-03-27T08:42:50.912 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.919+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f24c8004e40 con 0x7f24d80745b0 2024-03-27T08:42:50.914 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.921+0000 7f24dca00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 0x7f24bc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.922+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f24c80d02d0 con 0x7f24d80745b0 2024-03-27T08:42:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.922+0000 7f24d6000640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 0x7f24bc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:50.915 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.922+0000 7f24d6000640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 0x7f24bc0a5ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f24d819b500 tx=0x7f24c4005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:50.919 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:50.926+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f24c809ce50 con 0x7f24d80745b0 2024-03-27T08:42:51.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:50 smithi164 ceph-mon[31788]: pgmap v666: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T08:42:51.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:50 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/393553189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:51.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:50 smithi167 ceph-mon[34903]: pgmap v666: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T08:42:51.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:50 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/393553189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:51.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:50 smithi173 ceph-mon[35397]: pgmap v666: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-03-27T08:42:51.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:50 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/393553189' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:51.120 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.127+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f24d802d620 con 0x7f24d80745b0 2024-03-27T08:42:51.121 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.128+0000 7f24dca00640 1 -- 172.21.15.164:0/1145933641 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7f24c809c750 con 0x7f24d80745b0 2024-03-27T08:42:51.121 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 msgr2=0x7f24bc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 0x7f24bc0a5ad0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f24d819b500 tx=0x7f24c4005f90 comp rx=0 tx=0).stop 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 msgr2=0x7f24d8199ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f24c800e9f0 tx=0x7f24c800eeb0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 shutdown_connections 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f24bc0a3610 0x7f24bc0a5ad0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.124 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24d8109a20 0x7f24d81a15a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f24d8075b90 0x7f24d819a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 --2- 172.21.15.164:0/1145933641 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f24d80745b0 0x7f24d8199ff0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 >> 172.21.15.164:0/1145933641 conn(0x7f24d80fd0f0 msgr2=0x7f24d8105920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 shutdown_connections 2024-03-27T08:42:51.125 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.131+0000 7f24dde00640 1 -- 172.21.15.164:0/1145933641 wait complete. 2024-03-27T08:42:51.144 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:42:51.360 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 -- 172.21.15.164:0/4213094381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 msgr2=0x7f5fe81072f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 --2- 172.21.15.164:0/4213094381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe81072f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4009900 tx=0x7f5fd402bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 -- 172.21.15.164:0/4213094381 shutdown_connections 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 --2- 172.21.15.164:0/4213094381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe8107830 0x7f5fe8109c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 --2- 172.21.15.164:0/4213094381 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe81072f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 --2- 172.21.15.164:0/4213094381 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe81025d0 0x7f5fe81049c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 -- 172.21.15.164:0/4213094381 >> 172.21.15.164:0/4213094381 conn(0x7f5fe80fbfe0 msgr2=0x7f5fe80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 -- 172.21.15.164:0/4213094381 shutdown_connections 2024-03-27T08:42:51.361 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.367+0000 7f5fee400640 1 -- 172.21.15.164:0/4213094381 wait complete. 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.368+0000 7f5fee400640 1 Processor -- start 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 -- start start 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe81025d0 0x7f5fe819a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8107830 0x7f5fe81a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810d800 con 0x7f5fe8104f00 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810d680 con 0x7f5fe81025d0 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fee400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe810d980 con 0x7f5fe8107830 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fe6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fe6a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60920/0 (socket says 172.21.15.164:60920) 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fe6a00640 1 -- 172.21.15.164:0/4089564408 learned_addr learned my addr 172.21.15.164:0/4089564408 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:51.363 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.369+0000 7f5fe7400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe81025d0 0x7f5fe819a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 -- 172.21.15.164:0/4089564408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8107830 msgr2=0x7f5fe81a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8107830 0x7f5fe81a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 -- 172.21.15.164:0/4089564408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe81025d0 msgr2=0x7f5fe819a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe81025d0 0x7f5fe819a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.364 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 -- 172.21.15.164:0/4089564408 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe81a1cb0 con 0x7f5fe8104f00 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.370+0000 7f5fe6a00640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c00 tx=0x7f5fd4004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.371+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4043020 con 0x7f5fe8104f00 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.371+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5fd40054d0 con 0x7f5fe8104f00 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.371+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe81a1f40 con 0x7f5fe8104f00 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.371+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd4003d40 con 0x7f5fe8104f00 2024-03-27T08:42:51.366 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.371+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe81a2400 con 0x7f5fe8104f00 2024-03-27T08:42:51.367 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.373+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe8109380 con 0x7f5fe8104f00 2024-03-27T08:42:51.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.375+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f5fd4046020 con 0x7f5fe8104f00 2024-03-27T08:42:51.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.377+0000 7f5fdfe00640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 0x7f5fcc0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.377+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f5fd40f2070 con 0x7f5fe8104f00 2024-03-27T08:42:51.370 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.377+0000 7f5fe7400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 0x7f5fcc0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.378+0000 7f5fe7400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 0x7f5fcc0a5ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8005fd0 tx=0x7f5fd800b390 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:51.374 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.381+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5fd404d020 con 0x7f5fe8104f00 2024-03-27T08:42:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.581+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5fe8062750 con 0x7f5fe8104f00 2024-03-27T08:42:51.575 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.582+0000 7f5fdfe00640 1 -- 172.21.15.164:0/4089564408 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7f5fd40bebf0 con 0x7f5fe8104f00 2024-03-27T08:42:51.576 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:42:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 msgr2=0x7f5fcc0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.579 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 0x7f5fcc0a5ad0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8005fd0 tx=0x7f5fd800b390 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 msgr2=0x7f5fe819a5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5fd4000c00 tx=0x7f5fd4004f10 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 shutdown_connections 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5fcc0a3610 0x7f5fcc0a5ad0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fe8107830 0x7f5fe81a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fe8104f00 0x7f5fe819a5d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 --2- 172.21.15.164:0/4089564408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fe81025d0 0x7f5fe819a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 >> 172.21.15.164:0/4089564408 conn(0x7f5fe80fbfe0 msgr2=0x7f5fe8101c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 shutdown_connections 2024-03-27T08:42:51.580 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.586+0000 7f5fee400640 1 -- 172.21.15.164:0/4089564408 wait complete. 2024-03-27T08:42:51.600 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T08:42:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 -- 172.21.15.164:0/638376667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430105940 msgr2=0x7fc43010c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 --2- 172.21.15.164:0/638376667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430105940 0x7fc43010c1d0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fc428009ca0 tx=0x7fc42802c100 comp rx=0 tx=0).stop 2024-03-27T08:42:51.816 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 -- 172.21.15.164:0/638376667 shutdown_connections 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 --2- 172.21.15.164:0/638376667 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430105940 0x7fc43010c1d0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 --2- 172.21.15.164:0/638376667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430104f80 0x7fc430105400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 --2- 172.21.15.164:0/638376667 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc4301041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 -- 172.21.15.164:0/638376667 >> 172.21.15.164:0/638376667 conn(0x7fc4300ff300 msgr2=0x7fc430101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 -- 172.21.15.164:0/638376667 shutdown_connections 2024-03-27T08:42:51.817 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.823+0000 7fc437400640 1 -- 172.21.15.164:0/638376667 wait complete. 2024-03-27T08:42:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 Processor -- start 2024-03-27T08:42:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 -- start start 2024-03-27T08:42:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc43019a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.819 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430105940 0x7fc4301a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010f9f0 con 0x7fc430104f80 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010f870 con 0x7fc430105940 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.824+0000 7fc437400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fc43010fb70 con 0x7fc430103d90 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60926/0 (socket says 172.21.15.164:60926) 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 -- 172.21.15.164:0/3996658592 learned_addr learned my addr 172.21.15.164:0/3996658592 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc435400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430105940 0x7fc4301a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc434a00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc43019a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 -- 172.21.15.164:0/3996658592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 msgr2=0x7fc43019a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc43019a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 -- 172.21.15.164:0/3996658592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430105940 msgr2=0x7fc4301a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430105940 0x7fc4301a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 -- 172.21.15.164:0/3996658592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4301a1c50 con 0x7fc430104f80 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc434a00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc43019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:51.820 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.825+0000 7fc42fe00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00e9f0 tx=0x7fc41c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:51.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.826+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c00cd80 con 0x7fc430104f80 2024-03-27T08:42:51.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.826+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc41c010900 con 0x7fc430104f80 2024-03-27T08:42:51.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.826+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4301a1f40 con 0x7fc430104f80 2024-03-27T08:42:51.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.826+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c0189e0 con 0x7fc430104f80 2024-03-27T08:42:51.821 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.826+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4301a2450 con 0x7fc430104f80 2024-03-27T08:42:51.822 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.827+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc43010b130 con 0x7fc430104f80 2024-03-27T08:42:51.823 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.830+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fc41c010ab0 con 0x7fc430104f80 2024-03-27T08:42:51.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.831+0000 7fc42d600640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 0x7fc4180a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:51.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.831+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fc41c0d0050 con 0x7fc430104f80 2024-03-27T08:42:51.824 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.831+0000 7fc434a00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 0x7fc4180a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:51.825 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.832+0000 7fc434a00640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 0x7fc4180a5b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4240058c0 tx=0x7fc424005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:51.828 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:51.835+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fc41c09cc30 con 0x7fc430104f80 2024-03-27T08:42:52.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3243991988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1145933641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:51 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4089564408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.038 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.045+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc4300627f0 con 0x7fc430104f80 2024-03-27T08:42:52.039 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.046+0000 7fc42d600640 1 -- 172.21.15.164:0/3996658592 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+600 (secure 0 0 0) 0x7fc41c09c530 con 0x7fc430104f80 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2800925555 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2052222492 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6801/3452126215 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/3643701431 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/3871021713 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2354741154 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2219431867 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6800/460797646 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6801/460797646 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:52.040 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6800/3452126215 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:52.041 INFO:teuthology.orchestra.run.smithi164.stderr:listed 10 entries 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 msgr2=0x7fc4180a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 0x7fc4180a5b50 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc4240058c0 tx=0x7fc424005850 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 msgr2=0x7fc43019a570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00e9f0 tx=0x7fc41c00eeb0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 shutdown_connections 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fc4180a3690 0x7fc4180a5b50 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc430105940 0x7fc4301a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fc430104f80 0x7fc43019a570 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 --2- 172.21.15.164:0/3996658592 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fc430103d90 0x7fc43019a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 >> 172.21.15.164:0/3996658592 conn(0x7fc4300ff300 msgr2=0x7fc430108300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 shutdown_connections 2024-03-27T08:42:52.044 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.049+0000 7fc437400640 1 -- 172.21.15.164:0/3996658592 wait complete. 2024-03-27T08:42:52.060 DEBUG:teuthology.orchestra.run.smithi164:> set -ex 2024-03-27T08:42:52.060 DEBUG:teuthology.orchestra.run.smithi164:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-27T08:42:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3243991988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1145933641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:51 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4089564408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3243991988' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1145933641' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:51 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4089564408' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:52.110 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.374+0000 7f154e400640 1 -- 172.21.15.164:0/58229840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548103710 msgr2=0x7f1548109fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.374+0000 7f154e400640 1 --2- 172.21.15.164:0/58229840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548103710 0x7f1548109fa0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f1540009ca0 tx=0x7f154002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 -- 172.21.15.164:0/58229840 shutdown_connections 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 --2- 172.21.15.164:0/58229840 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548103710 0x7f1548109fa0 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 --2- 172.21.15.164:0/58229840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548102d50 0x7f15481031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.368 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 --2- 172.21.15.164:0/58229840 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548101b60 0x7f1548101f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 -- 172.21.15.164:0/58229840 >> 172.21.15.164:0/58229840 conn(0x7f15480fd0f0 msgr2=0x7f15480ff510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:52.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 -- 172.21.15.164:0/58229840 shutdown_connections 2024-03-27T08:42:52.369 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.375+0000 7f154e400640 1 -- 172.21.15.164:0/58229840 wait complete. 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 Processor -- start 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 -- start start 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548102d50 0x7f1548073f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548103710 0x7f1548074480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f154810d7c0 con 0x7f1548101b60 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f154810d640 con 0x7f1548103710 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f154e400640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f154810d940 con 0x7f1548102d50 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f1547400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.371 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f1547400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60942/0 (socket says 172.21.15.164:60942) 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.376+0000 7f1547400640 1 -- 172.21.15.164:0/4136521991 learned_addr learned my addr 172.21.15.164:0/4136521991 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f153ea00640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548102d50 0x7f1548073f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547e00640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548103710 0x7f1548074480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 -- 172.21.15.164:0/4136521991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548102d50 msgr2=0x7f1548073f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548102d50 0x7f1548073f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 -- 172.21.15.164:0/4136521991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548103710 msgr2=0x7f1548074480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548103710 0x7f1548074480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 -- 172.21.15.164:0/4136521991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1548074d10 con 0x7f1548101b60 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1547400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f153800d950 tx=0x7f153800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1538017070 con 0x7f1548101b60 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.377+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1538009c30 con 0x7f1548101b60 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.378+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15481a1f30 con 0x7f1548101b60 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.378+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f153800f620 con 0x7f1548101b60 2024-03-27T08:42:52.372 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.378+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15481a2340 con 0x7f1548101b60 2024-03-27T08:42:52.373 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.379+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1548108e80 con 0x7f1548101b60 2024-03-27T08:42:52.376 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.383+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f153801a070 con 0x7f1548101b60 2024-03-27T08:42:52.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.384+0000 7f1544c00640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 0x7f152c0a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.384+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f15380cf730 con 0x7f1548101b60 2024-03-27T08:42:52.377 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.384+0000 7f153ea00640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 0x7f152c0a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.378 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.385+0000 7f153ea00640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 0x7f152c0a5b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1548075670 tx=0x7f1530005f90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:52.379 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.387+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f1538009de0 con 0x7f1548101b60 2024-03-27T08:42:52.584 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.590+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f154802d620 con 0x7f1548101b60 2024-03-27T08:42:52.588 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.595+0000 7f1544c00640 1 -- 172.21.15.164:0/4136521991 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+22722 (secure 0 0 0) 0x7f153809c330 con 0x7f1548101b60 2024-03-27T08:42:52.588 INFO:teuthology.orchestra.run.smithi164.stdout: 2024-03-27T08:42:52.588 INFO:teuthology.orchestra.run.smithi164.stdout:{"epoch":90,"fsid":"f2a81f2e-ec12-11ee-95d0-87774f69a715","created":"2024-03-27T08:22:09.434879+0000","modified":"2024-03-27T08:33:18.434606+0000","last_up_change":"2024-03-27T08:31:40.935488+0000","last_in_change":"2024-03-27T08:31:15.926882+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-27T08:26:33.316573+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-27T08:32:43.732526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-27T08:32:45.021561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3ccf9cf4-4550-4d3e-8413-46b4133cb1c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6802","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6803","nonce":3960470757}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6804","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6805","nonce":3960470757}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6808","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6809","nonce":3960470757}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6806","nonce":3960470757},{"type":"v1","addr":"172.21.15.164:6807","nonce":3960470757}]},"public_addr":"172.21.15.164:6803/3960470757","cluster_addr":"172.21.15.164:6805/3960470757","heartbeat_back_addr":"172.21.15.164:6809/3960470757","heartbeat_front_addr":"172.21.15.164:6807/3960470757","state":["exists","up"]},{"osd":1,"uuid":"25fb7622-4173-476f-80d4-897c9b42bf16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6801","nonce":357892090}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6803","nonce":357892090}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6807","nonce":357892090}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":357892090},{"type":"v1","addr":"172.21.15.167:6805","nonce":357892090}]},"public_addr":"172.21.15.167:6801/357892090","cluster_addr":"172.21.15.167:6803/357892090","heartbeat_back_addr":"172.21.15.167:6807/357892090","heartbeat_front_addr":"172.21.15.167:6805/357892090","state":["exists","up"]},{"osd":2,"uuid":"c67b96cb-ba02-41dc-a4f6-6887b490de1a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6800","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6801","nonce":765640001}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6802","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6803","nonce":765640001}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6806","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6807","nonce":765640001}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6804","nonce":765640001},{"type":"v1","addr":"172.21.15.173:6805","nonce":765640001}]},"public_addr":"172.21.15.173:6801/765640001","cluster_addr":"172.21.15.173:6803/765640001","heartbeat_back_addr":"172.21.15.173:6807/765640001","heartbeat_front_addr":"172.21.15.173:6805/765640001","state":["exists","up"]},{"osd":3,"uuid":"1f6c8a44-ad5a-441b-b1b2-126e97ef7cc3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":27,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6810","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6811","nonce":2703443862}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6812","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6813","nonce":2703443862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6816","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6817","nonce":2703443862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6814","nonce":2703443862},{"type":"v1","addr":"172.21.15.164:6815","nonce":2703443862}]},"public_addr":"172.21.15.164:6811/2703443862","cluster_addr":"172.21.15.164:6813/2703443862","heartbeat_back_addr":"172.21.15.164:6817/2703443862","heartbeat_front_addr":"172.21.15.164:6815/2703443862","state":["exists","up"]},{"osd":4,"uuid":"59fc75ef-25b1-4b3b-82c5-78d108babbdb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":35,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6809","nonce":4005700417}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6811","nonce":4005700417}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6815","nonce":4005700417}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":4005700417},{"type":"v1","addr":"172.21.15.167:6813","nonce":4005700417}]},"public_addr":"172.21.15.167:6809/4005700417","cluster_addr":"172.21.15.167:6811/4005700417","heartbeat_back_addr":"172.21.15.167:6815/4005700417","heartbeat_front_addr":"172.21.15.167:6813/4005700417","state":["exists","up"]},{"osd":5,"uuid":"a66118e3-de31-41fb-becc-152bf0fa6bee","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":40,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6808","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6809","nonce":1658864715}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6810","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6811","nonce":1658864715}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6814","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6815","nonce":1658864715}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6812","nonce":1658864715},{"type":"v1","addr":"172.21.15.173:6813","nonce":1658864715}]},"public_addr":"172.21.15.173:6809/1658864715","cluster_addr":"172.21.15.173:6811/1658864715","heartbeat_back_addr":"172.21.15.173:6815/1658864715","heartbeat_front_addr":"172.21.15.173:6813/1658864715","state":["exists","up"]},{"osd":6,"uuid":"a6ecbda0-55a0-4633-bfd5-18aff3d6318e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6818","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6819","nonce":1951126247}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6820","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6821","nonce":1951126247}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6824","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6825","nonce":1951126247}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6822","nonce":1951126247},{"type":"v1","addr":"172.21.15.164:6823","nonce":1951126247}]},"public_addr":"172.21.15.164:6819/1951126247","cluster_addr":"172.21.15.164:6821/1951126247","heartbeat_back_addr":"172.21.15.164:6825/1951126247","heartbeat_front_addr":"172.21.15.164:6823/1951126247","state":["exists","up"]},{"osd":7,"uuid":"3a89c0f2-57ca-4e2c-a00d-aa9e42ebb8e1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":54,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6817","nonce":3522297748}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6819","nonce":3522297748}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6823","nonce":3522297748}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":3522297748},{"type":"v1","addr":"172.21.15.167:6821","nonce":3522297748}]},"public_addr":"172.21.15.167:6817/3522297748","cluster_addr":"172.21.15.167:6819/3522297748","heartbeat_back_addr":"172.21.15.167:6823/3522297748","heartbeat_front_addr":"172.21.15.167:6821/3522297748","state":["exists","up"]},{"osd":8,"uuid":"8b5e5331-70d7-48c7-921a-9ee5e820651b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6816","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6817","nonce":4192455767}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6818","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6819","nonce":4192455767}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6822","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6823","nonce":4192455767}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6820","nonce":4192455767},{"type":"v1","addr":"172.21.15.173:6821","nonce":4192455767}]},"public_addr":"172.21.15.173:6817/4192455767","cluster_addr":"172.21.15.173:6819/4192455767","heartbeat_back_addr":"172.21.15.173:6823/4192455767","heartbeat_front_addr":"172.21.15.173:6821/4192455767","state":["exists","up"]},{"osd":9,"uuid":"654dec9e-fa4b-4083-8f5a-770d7c0c96e6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":70,"up_thru":86,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6826","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6827","nonce":1825702850}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6828","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6829","nonce":1825702850}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6832","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6833","nonce":1825702850}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.164:6830","nonce":1825702850},{"type":"v1","addr":"172.21.15.164:6831","nonce":1825702850}]},"public_addr":"172.21.15.164:6827/1825702850","cluster_addr":"172.21.15.164:6829/1825702850","heartbeat_back_addr":"172.21.15.164:6833/1825702850","heartbeat_front_addr":"172.21.15.164:6831/1825702850","state":["exists","up"]},{"osd":10,"uuid":"4083fbc0-a61b-4fbc-b8a4-9ec80308a49c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6825","nonce":1703441209}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6827","nonce":1703441209}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6831","nonce":1703441209}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":1703441209},{"type":"v1","addr":"172.21.15.167:6829","nonce":1703441209}]},"public_addr":"172.21.15.167:6825/1703441209","cluster_addr":"172.21.15.167:6827/1703441209","heartbeat_back_addr":"172.21.15.167:6831/1703441209","heartbeat_front_addr":"172.21.15.167:6829/1703441209","state":["exists","up"]},{"osd":11,"uuid":"5e276690-d955-4f55-958c-de42c3d3915e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":83,"up_thru":89,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6824","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6825","nonce":2517065128}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6826","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6827","nonce":2517065128}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6830","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6831","nonce":2517065128}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.173:6828","nonce":2517065128},{"type":"v1","addr":"172.21.15.173:6829","nonce":2517065128}]},"public_addr":"172.21.15.173:6825/2517065128","cluster_addr":"172.21.15.173:6827/2517065128","heartbeat_back_addr":"172.21.15.173:6831/2517065128","heartbeat_front_addr":"172.21.15.173:6829/2517065128","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:24.164202+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:25:56.948064+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:26:30.316382+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:05.463516+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:27:38.555350+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:12.190219+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:28:47.544018+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:21.326449+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:29:55.697703+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:30:30.847043+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:04.571086+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-27T08:31:38.985725+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.a","mappings":[{"from":2,"to":11}]},{"pgid":"2.10","mappings":[{"from":8,"to":11}]},{"pgid":"2.1d","mappings":[{"from":2,"to":4}]},{"pgid":"3.3","mappings":[{"from":4,"to":9}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1a","mappings":[{"from":5,"to":7}]},{"pgid":"3.22","mappings":[{"from":3,"to":9}]},{"pgid":"3.36","mappings":[{"from":4,"to":9}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.164:0/2800925555":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2052222492":"2024-03-28T08:23:17.136317+0000","172.21.15.164:6801/3452126215":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/3643701431":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/3871021713":"2024-03-28T08:22:42.672679+0000","172.21.15.164:0/2354741154":"2024-03-28T08:23:17.136317+0000","172.21.15.164:0/2219431867":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6801/460797646":"2024-03-28T08:22:42.672679+0000","172.21.15.164:6800/3452126215":"2024-03-28T08:23:17.136317+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-27T08:42:52.590 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 msgr2=0x7f152c0a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 0x7f152c0a5b50 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f1548075670 tx=0x7f1530005f90 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 msgr2=0x7f1548075900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f153800d950 tx=0x7f153800de10 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 shutdown_connections 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f152c0a3690 0x7f152c0a5b50 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1548103710 0x7f1548074480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f1548102d50 0x7f1548073f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 --2- 172.21.15.164:0/4136521991 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f1548101b60 0x7f1548075900 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 >> 172.21.15.164:0/4136521991 conn(0x7f15480fd0f0 msgr2=0x7f1548106050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.597+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 shutdown_connections 2024-03-27T08:42:52.591 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.598+0000 7f154e400640 1 -- 172.21.15.164:0/4136521991 wait complete. 2024-03-27T08:42:52.610 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-27T08:26:33.316573+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-27T08:32:43.732526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-27T08:32:45.021561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-27T08:42:52.611 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-27T08:42:52.833 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.839+0000 7fb2f5000640 1 -- 172.21.15.164:0/1341045072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 msgr2=0x7fb2f0108590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.839+0000 7fb2f5000640 1 --2- 172.21.15.164:0/1341045072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f0108590 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0009900 tx=0x7fb2e002bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 -- 172.21.15.164:0/1341045072 shutdown_connections 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 --2- 172.21.15.164:0/1341045072 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01105b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 --2- 172.21.15.164:0/1341045072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 0x7fb2f01097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 --2- 172.21.15.164:0/1341045072 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f0108590 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 -- 172.21.15.164:0/1341045072 >> 172.21.15.164:0/1341045072 conn(0x7fb2f0077110 msgr2=0x7fb2f0079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 -- 172.21.15.164:0/1341045072 shutdown_connections 2024-03-27T08:42:52.834 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.840+0000 7fb2f5000640 1 -- 172.21.15.164:0/1341045072 wait complete. 2024-03-27T08:42:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 Processor -- start 2024-03-27T08:42:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 -- start start 2024-03-27T08:42:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 0x7fb2f019e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.836 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113dd0 con 0x7fb2f0108170 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113c50 con 0x7fb2f0109360 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2f5000640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb2f0113f50 con 0x7fb2f0109d20 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2ede00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2ede00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60962/0 (socket says 172.21.15.164:60962) 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.841+0000 7fb2ede00640 1 -- 172.21.15.164:0/323342985 learned_addr learned my addr 172.21.15.164:0/323342985 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2e7e00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 0x7fb2f019e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ee800640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 -- 172.21.15.164:0/323342985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 msgr2=0x7fb2f01a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 -- 172.21.15.164:0/323342985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 msgr2=0x7fb2f019e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 0x7fb2f019e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 -- 172.21.15.164:0/323342985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2f01a60d0 con 0x7fb2f0108170 2024-03-27T08:42:52.837 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ee800640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2ede00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0005ab0 tx=0x7fb2e0004e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0043020 con 0x7fb2f0108170 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb2e00054f0 con 0x7fb2f0108170 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.842+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2f01a6360 con 0x7fb2f0108170 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.843+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2e0003d10 con 0x7fb2f0108170 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.843+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2f01a6900 con 0x7fb2f0108170 2024-03-27T08:42:52.838 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.844+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2f010f560 con 0x7fb2f0108170 2024-03-27T08:42:52.839 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.846+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb2e0046020 con 0x7fb2f0108170 2024-03-27T08:42:52.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.848+0000 7fb2e6a00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 0x7fb2d40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:52.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.848+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb2e00f1ae0 con 0x7fb2f0108170 2024-03-27T08:42:52.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.848+0000 7fb2e7e00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 0x7fb2d40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:52.842 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.849+0000 7fb2e7e00640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 0x7fb2d40a5b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8005d00 tx=0x7fb2d8005c50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:52.845 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:52.852+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb2e004d070 con 0x7fb2f0108170 2024-03-27T08:42:53.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:52 smithi164 ceph-mon[31788]: pgmap v667: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-27T08:42:53.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:52 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3996658592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:53.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:52 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/4136521991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:53.030 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:52 smithi167 ceph-mon[34903]: pgmap v667: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-27T08:42:53.030 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:52 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3996658592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:53.030 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:52 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/4136521991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:53.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.049+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2f0062750 con 0x7fb2f0108170 2024-03-27T08:42:53.043 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.049+0000 7fb2e6a00640 1 -- 172.21.15.164:0/323342985 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v90) ==== 93+0+10 (secure 0 0 0) 0x7fb2e00be660 con 0x7fb2f0108170 2024-03-27T08:42:53.044 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 1 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 msgr2=0x7fb2d40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 0x7fb2d40a5b50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fb2d8005d00 tx=0x7fb2d8005c50 comp rx=0 tx=0).stop 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 msgr2=0x7fb2f019e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fb2e0005ab0 tx=0x7fb2e0004e90 comp rx=0 tx=0).stop 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 shutdown_connections 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb2d40a3690 0x7fb2d40a5b50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2f0109d20 0x7fb2f01a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.046 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2f0109360 0x7fb2f019e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 --2- 172.21.15.164:0/323342985 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2f0108170 0x7fb2f019e4b0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 >> 172.21.15.164:0/323342985 conn(0x7fb2f0077110 msgr2=0x7fb2f010c730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:53.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 shutdown_connections 2024-03-27T08:42:53.047 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.052+0000 7fb2f5000640 1 -- 172.21.15.164:0/323342985 wait complete. 2024-03-27T08:42:53.066 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-27T08:42:53.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:52 smithi173 ceph-mon[35397]: pgmap v667: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-03-27T08:42:53.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:52 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3996658592' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:53.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:52 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/4136521991' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-27T08:42:53.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3336443422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109d20 msgr2=0x7fb4e01105b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.278 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3336443422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109d20 0x7fb4e01105b0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fb4d8009900 tx=0x7fb4d802bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3336443422 shutdown_connections 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3336443422 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109d20 0x7fb4e01105b0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3336443422 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0109360 0x7fb4e01097e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3336443422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0108170 0x7fb4e0108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3336443422 >> 172.21.15.164:0/3336443422 conn(0x7fb4e0077110 msgr2=0x7fb4e0079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3336443422 shutdown_connections 2024-03-27T08:42:53.279 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.284+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3336443422 wait complete. 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 Processor -- start 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 -- start start 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0108170 0x7fb4e019e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 0x7fb4e01a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.285+0000 7fb4e4a00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0113e20 con 0x7fb4e0109360 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4e4a00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0113ca0 con 0x7fb4e0109d20 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4e4a00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0113fa0 con 0x7fb4e0108170 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60978/0 (socket says 172.21.15.164:60978) 2024-03-27T08:42:53.282 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 -- 172.21.15.164:0/3814197382 learned_addr learned my addr 172.21.15.164:0/3814197382 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4de800640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 0x7fb4e01a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dde00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0108170 0x7fb4e019e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 -- 172.21.15.164:0/3814197382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0108170 msgr2=0x7fb4e019e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0108170 0x7fb4e019e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 -- 172.21.15.164:0/3814197382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 msgr2=0x7fb4e01a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 0x7fb4e01a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4dd400640 1 -- 172.21.15.164:0/3814197382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e01a6020 con 0x7fb4e0109360 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.286+0000 7fb4de800640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 0x7fb4e01a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4dd400640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00d770 tx=0x7fb4cc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc017070 con 0x7fb4e0109360 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb4cc0054f0 con 0x7fb4e0109360 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4cc004d60 con 0x7fb4e0109360 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e01a6310 con 0x7fb4e0109360 2024-03-27T08:42:53.283 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.287+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e01a6810 con 0x7fb4e0109360 2024-03-27T08:42:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.288+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e010f430 con 0x7fb4e0109360 2024-03-27T08:42:53.284 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.291+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb4cc004f00 con 0x7fb4e0109360 2024-03-27T08:42:53.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.292+0000 7fb4d6a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 0x7fb4c40a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.292+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb4cc0cf810 con 0x7fb4e0109360 2024-03-27T08:42:53.286 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.292+0000 7fb4dde00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 0x7fb4c40a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.287 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.293+0000 7fb4dde00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 0x7fb4c40a5b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4e01091c0 tx=0x7fb4d0009500 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:53.290 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.296+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb4cc09c390 con 0x7fb4e0109360 2024-03-27T08:42:53.488 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.494+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb4e0062780 con 0x7fb4e0109360 2024-03-27T08:42:53.489 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.495+0000 7fb4d6a00640 1 -- 172.21.15.164:0/3814197382 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v90) ==== 104+0+11 (secure 0 0 0) 0x7fb4cc09bc90 con 0x7fb4e0109360 2024-03-27T08:42:53.489 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 32 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.497+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 msgr2=0x7fb4c40a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.497+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 0x7fb4c40a5b50 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb4e01091c0 tx=0x7fb4d0009500 comp rx=0 tx=0).stop 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.497+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 msgr2=0x7fb4e019e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.497+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fb4cc00d770 tx=0x7fb4cc00dc30 comp rx=0 tx=0).stop 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 shutdown_connections 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb4c40a3690 0x7fb4c40a5b50 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.492 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4e0109d20 0x7fb4e01a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb4e0109360 0x7fb4e019e940 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 --2- 172.21.15.164:0/3814197382 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb4e0108170 0x7fb4e019e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 >> 172.21.15.164:0/3814197382 conn(0x7fb4e0077110 msgr2=0x7fb4e010c600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 shutdown_connections 2024-03-27T08:42:53.493 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.498+0000 7fb4e4a00640 1 -- 172.21.15.164:0/3814197382 wait complete. 2024-03-27T08:42:53.511 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-27T08:42:53.725 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 -- 172.21.15.164:0/3619503184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 msgr2=0x7fb2a8076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 --2- 172.21.15.164:0/3619503184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a8076930 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fb298009900 tx=0x7fb29802bc30 comp rx=0 tx=0).stop 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 -- 172.21.15.164:0/3619503184 shutdown_connections 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 --2- 172.21.15.164:0/3619503184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a80780f0 0x7fb2a8078990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 --2- 172.21.15.164:0/3619503184 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a8077750 0x7fb2a8077bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 --2- 172.21.15.164:0/3619503184 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a8076930 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 -- 172.21.15.164:0/3619503184 >> 172.21.15.164:0/3619503184 conn(0x7fb2a80ff300 msgr2=0x7fb2a8101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 -- 172.21.15.164:0/3619503184 shutdown_connections 2024-03-27T08:42:53.726 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.731+0000 7fb2af200640 1 -- 172.21.15.164:0/3619503184 wait complete. 2024-03-27T08:42:53.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 Processor -- start 2024-03-27T08:42:53.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 -- start start 2024-03-27T08:42:53.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.728 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8077750 0x7fb2a819ea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a80780f0 0x7fb2a81a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.732+0000 7fb2af200640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8113df0 con 0x7fb2a8076510 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2af200640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8113c70 con 0x7fb2a8077750 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2af200640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7fb2a8113f70 con 0x7fb2a80780f0 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:60992/0 (socket says 172.21.15.164:60992) 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 -- 172.21.15.164:0/425607220 learned_addr learned my addr 172.21.15.164:0/425607220 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7400640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8077750 0x7fb2a819ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 -- 172.21.15.164:0/425607220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a80780f0 msgr2=0x7fb2a81a5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2ad200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a80780f0 0x7fb2a81a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a80780f0 0x7fb2a81a5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 -- 172.21.15.164:0/425607220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8077750 msgr2=0x7fb2a819ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8077750 0x7fb2a819ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.729 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 -- 172.21.15.164:0/425607220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2a81a6110 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.733+0000 7fb2a7e00640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb298009230 tx=0x7fb298004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.734+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298043020 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.734+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2a81a63a0 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.734+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb298004350 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.734+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2a81a6940 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.734+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb298003c60 con 0x7fb2a8076510 2024-03-27T08:42:53.730 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.735+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2a8110700 con 0x7fb2a8076510 2024-03-27T08:42:53.731 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.737+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7fb298046020 con 0x7fb2a8076510 2024-03-27T08:42:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.738+0000 7fb2a4c00640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 0x7fb28c0a5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:53.732 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.738+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7fb2980f1b10 con 0x7fb2a8076510 2024-03-27T08:42:53.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.739+0000 7fb2a7400640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 0x7fb28c0a5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:53.733 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.739+0000 7fb2a7400640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 0x7fb28c0a5ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb290005fd0 tx=0x7fb290005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:53.737 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.743+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7fb29804d070 con 0x7fb2a8076510 2024-03-27T08:42:53.937 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.943+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fb2a8062750 con 0x7fb2a8076510 2024-03-27T08:42:53.938 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.943+0000 7fb2a4c00640 1 -- 172.21.15.164:0/425607220 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v90) ==== 100+0+11 (secure 0 0 0) 0x7fb2980be6f0 con 0x7fb2a8076510 2024-03-27T08:42:53.938 INFO:teuthology.orchestra.run.smithi164.stdout:pg_num: 64 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 msgr2=0x7fb28c0a5ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 0x7fb28c0a5ad0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb290005fd0 tx=0x7fb290005850 comp rx=0 tx=0).stop 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 msgr2=0x7fb2a819e4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7fb298009230 tx=0x7fb298004ea0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 shutdown_connections 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7fb28c0a3610 0x7fb28c0a5ad0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7fb2a80780f0 0x7fb2a81a5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2a8077750 0x7fb2a819ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.941 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 --2- 172.21.15.164:0/425607220 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7fb2a8076510 0x7fb2a819e4f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:53.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 >> 172.21.15.164:0/425607220 conn(0x7fb2a80ff300 msgr2=0x7fb2a8100e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:53.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 shutdown_connections 2024-03-27T08:42:53.942 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:53.946+0000 7fb2af200640 1 -- 172.21.15.164:0/425607220 wait complete. 2024-03-27T08:42:53.956 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:53 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/323342985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:53.956 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:53 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/3814197382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:53.960 DEBUG:teuthology.orchestra.run.smithi164:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-27T08:42:54.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:53 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/323342985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:54.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:53 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/3814197382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:54.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:53 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/323342985' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-27T08:42:54.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:53 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/3814197382' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-03-27T08:42:54.166 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 -- 172.21.15.164:0/3314355826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01001c0 msgr2=0x7f5fa01025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/3314355826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01001c0 0x7f5fa01025f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f5f90009ca0 tx=0x7f5f9002c0f0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 -- 172.21.15.164:0/3314355826 shutdown_connections 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/3314355826 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa01054e0 0x7f5fa0105960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/3314355826 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa0102b30 0x7f5fa0104fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/3314355826 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01001c0 0x7f5fa01025f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 -- 172.21.15.164:0/3314355826 >> 172.21.15.164:0/3314355826 conn(0x7f5fa00fbd80 msgr2=0x7f5fa00fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 -- 172.21.15.164:0/3314355826 shutdown_connections 2024-03-27T08:42:54.167 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.172+0000 7f5f9fe00640 1 -- 172.21.15.164:0/3314355826 wait complete. 2024-03-27T08:42:54.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 Processor -- start 2024-03-27T08:42:54.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 -- start start 2024-03-27T08:42:54.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 --2- >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa01001c0 0x7f5fa019e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:54.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa0102b30 0x7f5fa019e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:54.169 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 -- --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa0113bc0 con 0x7f5fa01054e0 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa0113a40 con 0x7f5fa0102b30 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.173+0000 7f5f9fe00640 1 -- --> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] -- mon_getmap magic: 0 -- 0x7f5fa0113d40 con 0x7f5fa01001c0 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 --2- >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.164:3300/0 says I am v2:172.21.15.164:32772/0 (socket says 172.21.15.164:32772) 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 -- 172.21.15.164:0/1517093299 learned_addr learned my addr 172.21.15.164:0/1517093299 (peer_addr_for_me v2:172.21.15.164:0/0) 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9e000640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa0102b30 0x7f5fa019e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9ea00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa01001c0 0x7f5fa019e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 -- 172.21.15.164:0/1517093299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa01001c0 msgr2=0x7f5fa019e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa01001c0 0x7f5fa019e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 -- 172.21.15.164:0/1517093299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa0102b30 msgr2=0x7f5fa019e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa0102b30 0x7f5fa019e780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.170 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 -- 172.21.15.164:0/1517093299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fa01a5e60 con 0x7f5fa01054e0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.174+0000 7f5f9f400640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800e970 tx=0x7f5f9800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.175+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f9800ccc0 con 0x7f5fa01054e0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.175+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5f9800ce60 con 0x7f5fa01054e0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.175+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f98010430 con 0x7f5fa01054e0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.175+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fa01a6150 con 0x7f5fa01054e0 2024-03-27T08:42:54.171 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.175+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fa01a6650 con 0x7f5fa01054e0 2024-03-27T08:42:54.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.176+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fa00fd870 con 0x7f5fa01054e0 2024-03-27T08:42:54.172 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.178+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 4 ==== mgrmap(e 18) ==== 138371+0+0 (secure 0 0 0) 0x7f5f98005000 con 0x7f5fa01054e0 2024-03-27T08:42:54.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.180+0000 7f5f97400640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 0x7f5f840a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-27T08:42:54.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.180+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8211+0+0 (secure 0 0 0) 0x7f5f980d00d0 con 0x7f5fa01054e0 2024-03-27T08:42:54.174 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.180+0000 7f5f9ea00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 0x7f5f840a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-27T08:42:54.175 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.181+0000 7f5f9ea00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 0x7f5f840a5b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f9002c630 tx=0x7f5f90009360 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-27T08:42:54.179 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.185+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187541 (secure 0 0 0) 0x7f5f9809cc50 con 0x7f5fa01054e0 2024-03-27T08:42:54.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.398+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 --> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5fa002d370 con 0x7f5fa01054e0 2024-03-27T08:42:54.393 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.399+0000 7f5f97400640 1 -- 172.21.15.164:0/1517093299 <== mon.0 v2:172.21.15.164:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v90) ==== 81+0+600 (secure 0 0 0) 0x7f5f9809c550 con 0x7f5fa01054e0 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2800925555 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2052222492 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6801/3452126215 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/3643701431 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/3871021713 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2354741154 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:0/2219431867 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6800/460797646 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6801/460797646 2024-03-28T08:22:42.672679+0000 2024-03-27T08:42:54.394 INFO:teuthology.orchestra.run.smithi164.stdout:172.21.15.164:6800/3452126215 2024-03-28T08:23:17.136317+0000 2024-03-27T08:42:54.395 INFO:teuthology.orchestra.run.smithi164.stderr:listed 10 entries 2024-03-27T08:42:54.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 msgr2=0x7f5f840a5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:54.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 0x7f5f840a5b50 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5f9002c630 tx=0x7f5f90009360 comp rx=0 tx=0).stop 2024-03-27T08:42:54.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 msgr2=0x7f5fa01a57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-27T08:42:54.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f5f9800e970 tx=0x7f5f9800ed70 comp rx=0 tx=0).stop 2024-03-27T08:42:54.396 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 shutdown_connections 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:6800/2033158356,v1:172.21.15.164:6801/2033158356] conn(0x7f5f840a3690 0x7f5f840a5b50 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.164:3300/0,v1:172.21.15.164:6789/0] conn(0x7f5fa01054e0 0x7f5fa01a57f0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5fa0102b30 0x7f5fa019e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 --2- 172.21.15.164:0/1517093299 >> [v2:172.21.15.173:3300/0,v1:172.21.15.173:6789/0] conn(0x7f5fa01001c0 0x7f5fa019e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 >> 172.21.15.164:0/1517093299 conn(0x7f5fa00fbd80 msgr2=0x7f5fa0100c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 shutdown_connections 2024-03-27T08:42:54.397 INFO:teuthology.orchestra.run.smithi164.stderr:2024-03-27T08:42:54.402+0000 7f5f9fe00640 1 -- 172.21.15.164:0/1517093299 wait complete. 2024-03-27T08:42:54.415 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi164.front.sepia.ceph.com... 2024-03-27T08:42:54.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:42:54.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-27T08:42:54.506 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi164.stderr:ceph-fuse[84909]: fuse finished with error 0 and tester_r 0 2024-03-27T08:42:54.514 INFO:teuthology.orchestra.run:waiting for 300 2024-03-27T08:42:55.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:54 smithi164 ceph-mon[31788]: pgmap v668: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:55.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:54 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/425607220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:55.006 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:54 smithi164 ceph-mon[31788]: from='client.? 172.21.15.164:0/1517093299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:55.069 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:54 smithi167 ceph-mon[34903]: pgmap v668: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:55.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:54 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/425607220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:55.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:54 smithi167 ceph-mon[34903]: from='client.? 172.21.15.164:0/1517093299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:55.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:54 smithi173 ceph-mon[35397]: pgmap v668: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-03-27T08:42:55.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:54 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/425607220' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-03-27T08:42:55.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:54 smithi173 ceph-mon[35397]: from='client.? 172.21.15.164:0/1517093299' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-27T08:42:56.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:55 smithi164 ceph-mon[31788]: pgmap v669: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:42:56.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:55 smithi167 ceph-mon[34903]: pgmap v669: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:42:56.075 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:55 smithi173 ceph-mon[35397]: pgmap v669: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 426 B/s wr, 6 op/s 2024-03-27T08:42:59.005 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:42:58 smithi164 ceph-mon[31788]: pgmap v670: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:42:59.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:42:58 smithi167 ceph-mon[34903]: pgmap v670: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:42:59.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:42:58 smithi173 ceph-mon[35397]: pgmap v670: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 767 B/s wr, 7 op/s 2024-03-27T08:43:00.615 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:43:00.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:43:00.616 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-27T08:43:00.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:43:00.679 DEBUG:teuthology.orchestra.run.smithi164:> ip netns list 2024-03-27T08:43:00.729 INFO:teuthology.orchestra.run.smithi164.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-27T08:43:00.730 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:43:00.730 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-27T08:43:00.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-27T08:43:00.829 DEBUG:teuthology.orchestra.run.smithi164:> sudo ip link delete ceph-brx 2024-03-27T08:43:00.905 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:00 smithi164 ceph-mon[31788]: pgmap v671: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-27T08:43:00.959 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-27T08:43:00.977 INFO:tasks.cephadm:Teardown begin 2024-03-27T08:43:00.977 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/cephadm.py", line 2230, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-27T08:43:00.979 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:43:01.053 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:43:01.070 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:00 smithi167 ceph-mon[34903]: pgmap v671: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-27T08:43:01.076 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:00 smithi173 ceph-mon[35397]: pgmap v671: 97 pgs: 97 active+clean; 66 MiB data, 728 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-03-27T08:43:01.156 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:43:01.258 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-27T08:43:01.259 DEBUG:teuthology.orchestra.run.smithi164:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T08:43:01.314 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T08:43:01.361 DEBUG:teuthology.orchestra.run.smithi173:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-27T08:43:01.416 INFO:tasks.cephadm:Stopping all daemons... 2024-03-27T08:43:01.416 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-03-27T08:43:01.416 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a 2024-03-27T08:43:01.755 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:01 smithi164 systemd[1]: Stopping Ceph mon.a for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:02.425 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:43:02.013+0000 7fdafd400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:02.425 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a[31783]: 2024-03-27T08:43:02.014+0000 7fdafd400700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-03-27T08:43:02.425 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 podman[92444]: 2024-03-27 08:43:02.106832926 +0000 UTC m=+0.246024761 container died 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-03-27T08:43:02.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 podman[92444]: 2024-03-27 08:43:02.574581183 +0000 UTC m=+0.713773019 container cleanup 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-27T08:43:02.756 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 bash[92444]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a 2024-03-27T08:43:03.255 INFO:journalctl@ceph.mon.a.smithi164.stdout:Mar 27 08:43:02 smithi164 podman[92457]: 2024-03-27 08:43:02.834194788 +0000 UTC m=+0.712989528 container remove 34f399d1d9b8a1a8202061cd6af3a539a8b3c0139c5bed5451ce933d2c85e357 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-a, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:43:03.303 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.a.service' 2024-03-27T08:43:03.443 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:03.444 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-03-27T08:43:03.444 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-03-27T08:43:03.444 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.b 2024-03-27T08:43:03.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:03 smithi167 systemd[1]: Stopping Ceph mon.b for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:04.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b[34899]: 2024-03-27T08:43:03.975+0000 7f1403600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:04.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b[34899]: 2024-03-27T08:43:03.975+0000 7f1403600700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-03-27T08:43:04.320 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:04 smithi167 podman[68868]: 2024-03-27 08:43:04.149641171 +0000 UTC m=+0.320674308 container died 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-27T08:43:04.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:04 smithi167 podman[68868]: 2024-03-27 08:43:04.577111686 +0000 UTC m=+0.748144851 container cleanup 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-27T08:43:04.820 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:04 smithi167 bash[68868]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b 2024-03-27T08:43:05.210 INFO:journalctl@ceph.mon.b.smithi167.stdout:Mar 27 08:43:04 smithi167 podman[68881]: 2024-03-27 08:43:04.84472638 +0000 UTC m=+0.682040710 container remove 9da23267b64f7f8d362c8dad44e3b117613b8612d17474707f9b92bcced2cabc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True) 2024-03-27T08:43:05.233 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.b.service' 2024-03-27T08:43:05.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:05.349 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-03-27T08:43:05.349 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-03-27T08:43:05.349 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.c 2024-03-27T08:43:05.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:05 smithi173 systemd[1]: Stopping Ceph mon.c for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:06.179 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c[35371]: 2024-03-27T08:43:05.937+0000 7f7091e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:06.179 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c[35371]: 2024-03-27T08:43:05.937+0000 7f7091e00700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-03-27T08:43:06.179 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:05 smithi173 podman[70065]: 2024-03-27 08:43:05.998713742 +0000 UTC m=+0.213983463 container died 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T08:43:06.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:06 smithi173 podman[70065]: 2024-03-27 08:43:06.405686061 +0000 UTC m=+0.620955785 container cleanup 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:43:06.543 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:06 smithi173 bash[70065]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c 2024-03-27T08:43:06.826 INFO:journalctl@ceph.mon.c.smithi173.stdout:Mar 27 08:43:06 smithi173 podman[70078]: 2024-03-27 08:43:06.632570746 +0000 UTC m=+0.621914167 container remove 3ece645cc3d44b9aa5195d58d5870759a4aa3ea0de2364876aa0cad6f15a2335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mon-c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-03-27T08:43:06.977 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mon.c.service' 2024-03-27T08:43:07.099 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:07.099 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-03-27T08:43:07.099 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-03-27T08:43:07.100 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x 2024-03-27T08:43:07.506 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:07 smithi164 systemd[1]: Stopping Ceph mgr.x for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:08.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:43:07.676+0000 7fc595e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:08.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x[32027]: 2024-03-27T08:43:07.676+0000 7fc595e00700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-03-27T08:43:08.006 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:07 smithi164 podman[92564]: 2024-03-27 08:43:07.770535745 +0000 UTC m=+0.237519343 container died 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:43:08.506 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:08 smithi164 podman[92564]: 2024-03-27 08:43:08.295552427 +0000 UTC m=+0.762536001 container cleanup 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-27T08:43:08.506 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:08 smithi164 bash[92564]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x 2024-03-27T08:43:08.906 INFO:journalctl@ceph.mgr.x.smithi164.stdout:Mar 27 08:43:08 smithi164 podman[92578]: 2024-03-27 08:43:08.530345754 +0000 UTC m=+0.746153222 container remove 972155b18fc2abf976cd99cb70c95fa47fec8f0e0025462f33632da6f52ebc4f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:155268c4e432a12433aa833f174f9fe3b1016ae0, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-x, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, io.buildah.version=1.33.5) 2024-03-27T08:43:08.946 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.x.service' 2024-03-27T08:43:09.059 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:09.059 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-03-27T08:43:09.059 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-03-27T08:43:09.060 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.y 2024-03-27T08:43:09.570 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:09 smithi167 systemd[1]: Stopping Ceph mgr.y for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:10.048 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:09 smithi167 podman[68985]: 2024-03-27 08:43:09.72877066 +0000 UTC m=+0.277833638 container died 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-27T08:43:10.320 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:10 smithi167 podman[68985]: 2024-03-27 08:43:10.189779012 +0000 UTC m=+0.738841997 container cleanup 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:43:10.320 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:10 smithi167 bash[68985]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y 2024-03-27T08:43:10.751 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:10 smithi167 podman[68999]: 2024-03-27 08:43:10.433449657 +0000 UTC m=+0.687477916 container remove 366f3fad6f5d4d2c3ba2b3499e10859ad672a5b968bf480e41e610bfb3f3490e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-y, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:43:10.751 INFO:journalctl@ceph.mgr.y.smithi167.stdout:Mar 27 08:43:10 smithi167 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-03-27T08:43:10.773 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.y.service' 2024-03-27T08:43:10.869 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:10.869 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-03-27T08:43:10.869 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-03-27T08:43:10.869 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.z 2024-03-27T08:43:11.326 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:10 smithi173 systemd[1]: Stopping Ceph mgr.z for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:11.826 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:11 smithi173 podman[70197]: 2024-03-27 08:43:11.515657163 +0000 UTC m=+0.221571398 container died 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True) 2024-03-27T08:43:12.240 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:12 smithi173 podman[70197]: 2024-03-27 08:43:12.045138508 +0000 UTC m=+0.751052759 container cleanup 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326) 2024-03-27T08:43:12.240 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:12 smithi173 bash[70197]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z 2024-03-27T08:43:12.576 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:12 smithi173 podman[70209]: 2024-03-27 08:43:12.246274636 +0000 UTC m=+0.723828503 container remove 7c90d10337de0e08913d217d38d96deb6235a2680cdfb62abd2050ff1a6d1cb1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mgr-z, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-03-27T08:43:12.576 INFO:journalctl@ceph.mgr.z.smithi173.stdout:Mar 27 08:43:12 smithi173 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-03-27T08:43:12.762 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mgr.z.service' 2024-03-27T08:43:12.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:12.883 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-03-27T08:43:12.883 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-27T08:43:12.883 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.0 2024-03-27T08:43:13.256 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:13 smithi164 systemd[1]: Stopping Ceph osd.0 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:13.756 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0[46796]: 2024-03-27T08:43:13.448+0000 7f987f200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:13.756 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0[46796]: 2024-03-27T08:43:13.448+0000 7f987f200700 -1 osd.0 90 *** Got signal Terminated *** 2024-03-27T08:43:13.756 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0[46796]: 2024-03-27T08:43:13.448+0000 7f987f200700 -1 osd.0 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:19.198 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:18 smithi164 podman[92686]: 2024-03-27 08:43:18.920355869 +0000 UTC m=+5.622019436 container died 232404ccaf0c3833cc2411b115b60fff8408621ce82ed4b1387269a3cf6dad52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD) 2024-03-27T08:43:19.506 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:19 smithi164 podman[92686]: 2024-03-27 08:43:19.34056589 +0000 UTC m=+6.042229489 container cleanup 232404ccaf0c3833cc2411b115b60fff8408621ce82ed4b1387269a3cf6dad52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T08:43:19.506 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:19 smithi164 bash[92686]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0 2024-03-27T08:43:20.006 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:19 smithi164 podman[92706]: 2024-03-27 08:43:19.575197912 +0000 UTC m=+0.639535128 container remove 232404ccaf0c3833cc2411b115b60fff8408621ce82ed4b1387269a3cf6dad52 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-03-27T08:43:20.756 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:20 smithi164 podman[92793]: 2024-03-27 08:43:20.352541929 +0000 UTC m=+0.033849254 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:43:20.757 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:20 smithi164 podman[92793]: 2024-03-27 08:43:20.459315619 +0000 UTC m=+0.140622977 container create 2d4f103cc1c34883b3f5b6d18ba2e26ecc86b15a0be70e6982640163cc14ad1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5) 2024-03-27T08:43:21.217 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:20 smithi164 podman[92793]: 2024-03-27 08:43:20.780076559 +0000 UTC m=+0.461383924 container init 2d4f103cc1c34883b3f5b6d18ba2e26ecc86b15a0be70e6982640163cc14ad1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-27T08:43:21.217 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:20 smithi164 podman[92793]: 2024-03-27 08:43:20.791538838 +0000 UTC m=+0.472846226 container start 2d4f103cc1c34883b3f5b6d18ba2e26ecc86b15a0be70e6982640163cc14ad1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-03-27T08:43:21.217 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:20 smithi164 podman[92793]: 2024-03-27 08:43:20.870304232 +0000 UTC m=+0.551611593 container attach 2d4f103cc1c34883b3f5b6d18ba2e26ecc86b15a0be70e6982640163cc14ad1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0-deactivate, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-03-27T08:43:21.506 INFO:journalctl@ceph.osd.0.smithi164.stdout:Mar 27 08:43:21 smithi164 podman[92819]: 2024-03-27 08:43:21.277662997 +0000 UTC m=+0.035319877 container died 2d4f103cc1c34883b3f5b6d18ba2e26ecc86b15a0be70e6982640163cc14ad1c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-0-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-03-27T08:43:21.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.0.service' 2024-03-27T08:43:22.088 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:22.088 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-27T08:43:22.088 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-27T08:43:22.088 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.1 2024-03-27T08:43:22.570 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:22 smithi167 systemd[1]: Stopping Ceph osd.1 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:22.957 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1[39514]: 2024-03-27T08:43:22.604+0000 7facfc400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:22.957 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1[39514]: 2024-03-27T08:43:22.604+0000 7facfc400700 -1 osd.1 90 *** Got signal Terminated *** 2024-03-27T08:43:22.958 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1[39514]: 2024-03-27T08:43:22.604+0000 7facfc400700 -1 osd.1 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:28.519 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:28 smithi167 podman[69120]: 2024-03-27 08:43:28.183574258 +0000 UTC m=+5.708735676 container died 396ce6346d2ad556cfbf455fea342dc991222d3cc936fb18e12e1bd845c38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-27T08:43:28.820 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:28 smithi167 podman[69120]: 2024-03-27 08:43:28.653006247 +0000 UTC m=+6.178167679 container cleanup 396ce6346d2ad556cfbf455fea342dc991222d3cc936fb18e12e1bd845c38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:43:28.820 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:28 smithi167 bash[69120]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1 2024-03-27T08:43:29.320 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:28 smithi167 podman[69140]: 2024-03-27 08:43:28.870977341 +0000 UTC m=+0.679309596 container remove 396ce6346d2ad556cfbf455fea342dc991222d3cc936fb18e12e1bd845c38202 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-27T08:43:29.970 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:29 smithi167 podman[69223]: 2024-03-27 08:43:29.560461695 +0000 UTC m=+0.039464809 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:43:29.970 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:29 smithi167 podman[69223]: 2024-03-27 08:43:29.680710079 +0000 UTC m=+0.159713192 container create 5d05430affd8f4798e6829848606faba862b5927da05da6d5f023cf89cd5e5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2) 2024-03-27T08:43:29.970 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:29 smithi167 podman[69223]: 2024-03-27 08:43:29.976558026 +0000 UTC m=+0.455561169 container init 5d05430affd8f4798e6829848606faba862b5927da05da6d5f023cf89cd5e5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:43:30.320 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:29 smithi167 podman[69223]: 2024-03-27 08:43:29.988823689 +0000 UTC m=+0.467826799 container start 5d05430affd8f4798e6829848606faba862b5927da05da6d5f023cf89cd5e5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0) 2024-03-27T08:43:30.320 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:30 smithi167 podman[69223]: 2024-03-27 08:43:30.083567809 +0000 UTC m=+0.562571016 container attach 5d05430affd8f4798e6829848606faba862b5927da05da6d5f023cf89cd5e5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0) 2024-03-27T08:43:30.820 INFO:journalctl@ceph.osd.1.smithi167.stdout:Mar 27 08:43:30 smithi167 podman[69223]: 2024-03-27 08:43:30.467081948 +0000 UTC m=+0.946085079 container died 5d05430affd8f4798e6829848606faba862b5927da05da6d5f023cf89cd5e5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-1-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-27T08:43:31.231 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.1.service' 2024-03-27T08:43:31.332 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:31.332 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-27T08:43:31.332 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-27T08:43:31.332 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.2 2024-03-27T08:43:31.827 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:31 smithi173 systemd[1]: Stopping Ceph osd.2 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:32.327 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2[40521]: 2024-03-27T08:43:31.982+0000 7f5f5be00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:32.327 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2[40521]: 2024-03-27T08:43:31.982+0000 7f5f5be00700 -1 osd.2 90 *** Got signal Terminated *** 2024-03-27T08:43:32.327 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2[40521]: 2024-03-27T08:43:31.982+0000 7f5f5be00700 -1 osd.2 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:37.827 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:37 smithi173 podman[70319]: 2024-03-27 08:43:37.504868665 +0000 UTC m=+5.714507409 container died e1de87b41e3795470ef1ba3435efcae3073212728498c5f431d549d87a6a3231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:43:38.237 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:37 smithi173 podman[70319]: 2024-03-27 08:43:37.95740044 +0000 UTC m=+6.167039234 container cleanup e1de87b41e3795470ef1ba3435efcae3073212728498c5f431d549d87a6a3231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326) 2024-03-27T08:43:38.237 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:37 smithi173 bash[70319]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2 2024-03-27T08:43:38.576 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:38 smithi173 podman[70338]: 2024-03-27 08:43:38.242157878 +0000 UTC m=+0.725264065 container remove e1de87b41e3795470ef1ba3435efcae3073212728498c5f431d549d87a6a3231 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-03-27T08:43:39.327 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:38.939931391 +0000 UTC m=+0.035368136 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:43:39.327 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:39.068333336 +0000 UTC m=+0.163770112 container create c46d249eb3b9270e60833dd0faeb3c6a1afda2b3a790b249d8ce1414831426c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-03-27T08:43:39.646 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:39.347200646 +0000 UTC m=+0.442637428 container init c46d249eb3b9270e60833dd0faeb3c6a1afda2b3a790b249d8ce1414831426c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240326) 2024-03-27T08:43:39.646 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:39.358853813 +0000 UTC m=+0.454290570 container start c46d249eb3b9270e60833dd0faeb3c6a1afda2b3a790b249d8ce1414831426c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-03-27T08:43:39.646 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:39.454306737 +0000 UTC m=+0.549743502 container attach c46d249eb3b9270e60833dd0faeb3c6a1afda2b3a790b249d8ce1414831426c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-03-27T08:43:40.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:39.652+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:40.076 INFO:journalctl@ceph.osd.2.smithi173.stdout:Mar 27 08:43:39 smithi173 podman[70425]: 2024-03-27 08:43:39.792044719 +0000 UTC m=+0.887481485 container died c46d249eb3b9270e60833dd0faeb3c6a1afda2b3a790b249d8ce1414831426c2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:43:40.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:39.651+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:40.499 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.2.service' 2024-03-27T08:43:40.605 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:40.605 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-27T08:43:40.605 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-27T08:43:40.606 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.3 2024-03-27T08:43:40.614 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:40.618+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:40.614 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:40.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:40.758 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:40.639+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:41.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:40 smithi164 systemd[1]: Stopping Ceph osd.3 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:41.485 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:41.329+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:41.485 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:41.155+0000 7f81be800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:41.485 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:41.155+0000 7f81be800700 -1 osd.3 90 *** Got signal Terminated *** 2024-03-27T08:43:41.485 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:41.155+0000 7f81be800700 -1 osd.3 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:41.757 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:41.637+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:41.762 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:41 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:41.490+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:42.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:41.626+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:42.577 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:42.240+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:42.615 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:42.532+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:42.616 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:42.299+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:43.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:42 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:42.621+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:43.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:42.638+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:43.282 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:42.857+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:43.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:43.211+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:43.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:43.454+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:43.627 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:43 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:43.510+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:43.627 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:43 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:43.294+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:44.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:43 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:43.633+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:44.070 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:43.824+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:44.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:43.602+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:44.488 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:44.192+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:44.584 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:44 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:44.494+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:44.585 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:44 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:44.304+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:44.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:44.631+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:44.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:44.494+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:45.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:44 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:44.591+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:45.070 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:44.830+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:45.443 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:45.185+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:45.559 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:45 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:45.467+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:45.560 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:45 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:45.273+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:45.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:45.582+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:45.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:45.449+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:46.006 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:45 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3[53764]: 2024-03-27T08:43:45.565+0000 7f81b5000700 -1 osd.3 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.103434+0000 front 2024-03-27T08:43:16.102930+0000 (oldest deadline 2024-03-27T08:43:39.603102+0000) 2024-03-27T08:43:46.243 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:45.847+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:46.441 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:46.153+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:46.674 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:46 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:46.438+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:46.674 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:46 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:46.304+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:46.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:46.557+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:46.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:46.447+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:46.999 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:46 smithi164 podman[92908]: 2024-03-27 08:43:46.679432767 +0000 UTC m=+5.681960555 container died a86ce28a72352a8bbbfdf06ffabf0703530dccdafe40a65d4b5aceee280b7d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-03-27T08:43:47.256 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:47 smithi164 podman[92908]: 2024-03-27 08:43:47.158493924 +0000 UTC m=+6.161021739 container cleanup a86ce28a72352a8bbbfdf06ffabf0703530dccdafe40a65d4b5aceee280b7d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-27T08:43:47.256 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:47 smithi164 bash[92908]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3 2024-03-27T08:43:47.320 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:46.877+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:47.576 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:47.409+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:47.577 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:47.179+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:47.756 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:47 smithi164 podman[92927]: 2024-03-27 08:43:47.468003319 +0000 UTC m=+0.772743892 container remove a86ce28a72352a8bbbfdf06ffabf0703530dccdafe40a65d4b5aceee280b7d48 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:43:47.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:47 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:47.431+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:47.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:47 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:47.353+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:48.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:47.603+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:48.320 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:47.863+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:48.332 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:47.977452496 +0000 UTC m=+0.037143119 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:43:48.332 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:48.0770111 +0000 UTC m=+0.136701756 container create 69ff94cf57f1f3b599d9e15ebfffbcf16293b4bcef830da83e5f1c180e4ac895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3-deactivate, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326) 2024-03-27T08:43:48.332 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:48.338673682 +0000 UTC m=+0.398364345 container init 69ff94cf57f1f3b599d9e15ebfffbcf16293b4bcef830da83e5f1c180e4ac895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True) 2024-03-27T08:43:48.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:48.228+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:48.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:48.420+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:48.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:48.473+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:48.756 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:48.350054496 +0000 UTC m=+0.409745159 container start 69ff94cf57f1f3b599d9e15ebfffbcf16293b4bcef830da83e5f1c180e4ac895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-03-27T08:43:48.757 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:48.454271128 +0000 UTC m=+0.513961791 container attach 69ff94cf57f1f3b599d9e15ebfffbcf16293b4bcef830da83e5f1c180e4ac895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-27T08:43:48.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:48 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:48.375+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:49.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:48.622+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:49.158 INFO:journalctl@ceph.osd.3.smithi164.stdout:Mar 27 08:43:48 smithi164 podman[93017]: 2024-03-27 08:43:48.779627283 +0000 UTC m=+0.839317946 container died 69ff94cf57f1f3b599d9e15ebfffbcf16293b4bcef830da83e5f1c180e4ac895 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-3-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-03-27T08:43:49.205 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:48.893+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:49.506 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:49 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:49.394+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:49.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:49 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:49.210+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:49.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:49 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:49.275+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:49.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:49.275+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:49.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:49.275+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:49.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:49.402+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:49.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:49.402+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:49.591 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.3.service' 2024-03-27T08:43:49.707 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:49.707 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-27T08:43:49.707 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-27T08:43:49.707 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.4 2024-03-27T08:43:50.006 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:49 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:49.521+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:50.070 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:49 smithi167 systemd[1]: Stopping Ceph osd.4 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:50.070 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:49 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:49.907+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:50.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:49 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:49.907+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:50.076 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:49.603+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:50.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:50.219+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:50.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:50.277+0000 7f42bbc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:50.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:50.277+0000 7f42bbc00700 -1 osd.4 90 *** Got signal Terminated *** 2024-03-27T08:43:50.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:50.277+0000 7f42bbc00700 -1 osd.4 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:50.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:50.319+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:50.576 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:50.423+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:50.576 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:50.423+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:50.577 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:50.294+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:50.577 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:50.294+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:50.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:50 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:50.520+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:50.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:50 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:50.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:50.874 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:50.602+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:51.221 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:50.953+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:51.221 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:50 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:50.953+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:51.570 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:51.347+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:51.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:51.226+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:51.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:51.248+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:51.576 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:51.248+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:51.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:51.450+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:51.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:51.450+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:51.664 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:51 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:51.503+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:51.664 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:51 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:51.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:52.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:51.593+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:52.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:51.593+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:52.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:51.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:52.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:51 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:51.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:52.471 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:52.201+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:52.471 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:52.201+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:52.570 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:52 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:52.328+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:52.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:52 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:52.246+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:52.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:52 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:52.391+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:52.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:52 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:52.546+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:52.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:52 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:52.546+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:52.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:52.626+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:52.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:52.626+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:52.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:52.476+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:52.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:52.476+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:53.233 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:52 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:52.962+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:53.233 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:52 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:52.962+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:53.482 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:53.180+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:53.483 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:53.180+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:53.570 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:53 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:53.357+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:53.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:53 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:53.239+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:53.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:53.564+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:53.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:53.564+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:53.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:53.410+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:53.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:53 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:53.410+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:53.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:53.583+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:53.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:53.583+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:53.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:53.487+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:53.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:53.487+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:54.238 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:53 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:53.932+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:54.238 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:53 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:53.932+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:54.508 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:54.135+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:54.508 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:54.135+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:54.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:54 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4[46005]: 2024-03-27T08:43:54.320+0000 7f42b7400700 -1 osd.4 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.853326+0000 front 2024-03-27T08:43:26.852820+0000 (oldest deadline 2024-03-27T08:43:49.152902+0000) 2024-03-27T08:43:54.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:54 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:54.243+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:54.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:54 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:54.534+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:54.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:54 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:54.534+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:54.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:54 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:54.414+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:54.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:54 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:54.414+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:54.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:54.632+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:54.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:54.632+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:54.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:54.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:54.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:54.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:55.282 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:54 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:54.910+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:55.283 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:54 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:54.910+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:55.497 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:55.127+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:55.497 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:55.127+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:55.551 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:55 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:55.288+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:55.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:55 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:55.364+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:55.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:55 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:55.364+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:55.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:55 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:55.532+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:55.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:55 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:55.532+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:55.820 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:55 smithi167 podman[69336]: 2024-03-27 08:43:55.750981489 +0000 UTC m=+5.621069684 container died fc99783e60327f0a83924a666b3354fd6ef2ad45e76a22cc566c11a05936d050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:43:55.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:55.678+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:55.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:55.678+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:55.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:55.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:55.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:55.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:56.281 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:56 smithi167 podman[69336]: 2024-03-27 08:43:56.157545634 +0000 UTC m=+6.027633826 container cleanup fc99783e60327f0a83924a666b3354fd6ef2ad45e76a22cc566c11a05936d050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-03-27T08:43:56.281 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:56 smithi167 bash[69336]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4 2024-03-27T08:43:56.281 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:55 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:55.937+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:56.281 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:55 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:55.937+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:56.510 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:56.156+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:56.510 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:56.156+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:56.570 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:56 smithi167 podman[69353]: 2024-03-27 08:43:56.332527326 +0000 UTC m=+0.569704151 container remove fc99783e60327f0a83924a666b3354fd6ef2ad45e76a22cc566c11a05936d050 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=) 2024-03-27T08:43:56.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:56 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:56.287+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:56.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:56 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:56.354+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:56.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:56 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:56.354+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:56.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:56 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:56.504+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:56.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:56 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:56.504+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:56.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:56.681+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:56.826 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:56.681+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:56.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:56.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:56.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:56.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:57.321 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:56.92804046 +0000 UTC m=+0.039541545 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:43:57.321 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:57.02484304 +0000 UTC m=+0.136344119 container create b4203688f955b8b7c358644a09d7d2295b40885e537d3b4fb8bcf90c1e54668b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4-deactivate, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-27T08:43:57.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:57 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:57.325+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:57.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:56 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:56.981+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:57.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:56 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:56.981+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:57.516 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:57.135+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:57.516 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:57.135+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:57.570 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:57.329512318 +0000 UTC m=+0.441013402 container init b4203688f955b8b7c358644a09d7d2295b40885e537d3b4fb8bcf90c1e54668b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-27T08:43:57.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:57.34073121 +0000 UTC m=+0.452232285 container start b4203688f955b8b7c358644a09d7d2295b40885e537d3b4fb8bcf90c1e54668b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-03-27T08:43:57.571 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:57.428090938 +0000 UTC m=+0.539592064 container attach b4203688f955b8b7c358644a09d7d2295b40885e537d3b4fb8bcf90c1e54668b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2) 2024-03-27T08:43:57.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:57 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:57.550+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:57.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:57 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:57.550+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:57.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:57 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:57.354+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:57.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:57 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:57.354+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:57.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:57.639+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:57.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:57.639+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:57.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:57.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:57.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:57.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:57.911 INFO:journalctl@ceph.osd.4.smithi167.stdout:Mar 27 08:43:57 smithi167 podman[69436]: 2024-03-27 08:43:57.917119081 +0000 UTC m=+1.028620170 container died b4203688f955b8b7c358644a09d7d2295b40885e537d3b4fb8bcf90c1e54668b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:43:58.270 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:57 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:57.934+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:58.270 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:57 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:57.934+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:58.525 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:58.106+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:58.525 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:58.106+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:58.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:58.346+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:58.662 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.4.service' 2024-03-27T08:43:58.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:58 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:58.549+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:58.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:58 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:58.549+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:58.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:58 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:58.319+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:58.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:58 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:58.319+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:58.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:58 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:58.319+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:43:58.768 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:43:58.769 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-27T08:43:58.769 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-27T08:43:58.769 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.5 2024-03-27T08:43:58.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:58.529+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:58.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:58.529+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:58.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:58.648+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:58.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:58.648+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:58.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:58.648+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:43:59.200 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:58.940+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:43:59.200 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:58 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:58.940+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:43:59.327 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:58 smithi173 systemd[1]: Stopping Ceph osd.5 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:43:59.327 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.105+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:43:59.327 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.105+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:43:59.327 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.105+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:43:59.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:43:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:43:59.325+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:43:59.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:59 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:59.525+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:43:59.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:43:59 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:43:59.525+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:43:59.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:59 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:59.289+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:43:59.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:59 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:59.289+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:43:59.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:43:59 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:43:59.289+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:43:59.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:59.542+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:43:59.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:43:59.542+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:43:59.827 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.384+0000 7ff9de200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:43:59.827 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.384+0000 7ff9de200700 -1 osd.5 90 *** Got signal Terminated *** 2024-03-27T08:43:59.828 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:43:59.384+0000 7ff9de200700 -1 osd.5 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:43:59.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:59.603+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:43:59.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:59.603+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:43:59.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:43:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:43:59.603+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:00.320 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:59.939+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:00.320 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:43:59 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:43:59.939+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:00.545 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:00.127+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:44:00.546 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:00.127+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:44:00.546 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:00.127+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:44:00.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:00 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:00.325+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:00.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:00 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:00.325+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:00.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:00.504+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:00.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:00.504+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:00.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:00.284+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:00.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:00.284+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:00.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:00 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:00.284+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:00.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:00.550+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:00.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:00.550+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:00.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:00.566+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:00.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:00.566+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:00.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:00 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:00.566+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:01.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:00 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:00.986+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:01.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:00 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:00.986+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:01.509 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:01.132+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:44:01.509 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:01.132+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:44:01.510 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:01.132+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:44:01.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:01.281+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:01.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:01.281+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:01.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:01.327+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:01.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:01.327+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:01.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:01.327+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:01.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:01.505+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:01.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:01.505+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:01.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:01 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:01.505+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:01.567+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:01.567+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:01.567+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:01.514+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:01.514+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:01.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:01 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:01.514+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:02.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:01.982+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:02.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:01.982+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:02.239 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:01 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:01.982+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:02.495 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:02.107+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:44:02.496 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:02.107+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:44:02.496 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:02.107+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:44:02.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:02 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:02.244+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:02.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:02 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:02.244+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:02.525+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:02.525+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:02.525+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:02.374+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:02.374+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:02.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:02 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:02.374+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:02.565+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:02.565+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:02.565+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:02.500+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:02.500+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:02.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:02 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:02.500+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:03.282 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:03.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:03.282 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:03.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:03.282 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:03.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:03.517 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:03.103+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:44:03.517 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:03.103+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:44:03.517 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:03.103+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:44:03.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:03.287+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:03.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:03 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:03.287+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:03.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:03.386+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:03.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:03.386+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:03.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:03.386+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:03.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:03.508+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:03.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:03.508+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:03.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:03.508+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:03.522+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:03.522+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:03.522+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:03.526+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:03.526+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:03.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:03 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:03.526+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:04.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:04.069+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:04.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:04.069+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:04.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:04.069+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:04.488 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:04.128+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:15.569825+0000 front 2024-03-27T08:43:15.569407+0000 (oldest deadline 2024-03-27T08:43:41.970404+0000) 2024-03-27T08:44:04.488 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:04.128+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.773321+0000 front 2024-03-27T08:43:24.773156+0000 (oldest deadline 2024-03-27T08:43:48.273337+0000) 2024-03-27T08:44:04.489 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5[47288]: 2024-03-27T08:44:04.128+0000 7ff9d9a00700 -1 osd.5 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.975131+0000 front 2024-03-27T08:43:32.975412+0000 (oldest deadline 2024-03-27T08:43:58.275312+0000) 2024-03-27T08:44:04.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:04.492+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:04.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:04.492+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:04.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:04.492+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:04.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:04.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:04.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:04.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:04.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:04 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:04.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:04.493+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:04.493+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:04.493+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:04.512+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:04.512+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:04.792 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:04 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:04.512+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:04.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:04.337+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:04.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:04 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:04.337+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:05.077 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:04 smithi173 podman[70541]: 2024-03-27 08:44:04.797666496 +0000 UTC m=+5.567844987 container died afefa272e14881ced36f8d1f4b0d37d19298d31246336c32c3f75e156ca97c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, ceph=True) 2024-03-27T08:44:05.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:05.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:05.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:05.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:05.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:05.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:05.529 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:05 smithi173 podman[70541]: 2024-03-27 08:44:05.228919743 +0000 UTC m=+5.999098269 container cleanup afefa272e14881ced36f8d1f4b0d37d19298d31246336c32c3f75e156ca97c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-27T08:44:05.529 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:05 smithi173 bash[70541]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5 2024-03-27T08:44:05.529 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:05 smithi173 podman[70560]: 2024-03-27 08:44:05.371716726 +0000 UTC m=+0.559009934 container remove afefa272e14881ced36f8d1f4b0d37d19298d31246336c32c3f75e156ca97c9b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-03-27T08:44:05.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:05.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:05.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:05.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:05.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:05.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:05.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:05.320+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:05.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:05.320+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:05.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:05 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:05.320+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:05.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:05.365+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:05.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:05 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:05.365+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:05.533+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:05.533+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:05.533+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:05.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:05.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:05.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:05 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:05.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:06.320 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:06 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:06.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:06.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:06 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:06.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:06.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:06 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:06.053+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:06.495 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.11746509 +0000 UTC m=+0.034341820 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:06.495 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.281163668 +0000 UTC m=+0.198027890 container create 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-03-27T08:44:06.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:06.481+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:06.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:06.481+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:06.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:06.481+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:06.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:06.337+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:06.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:06.337+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:06.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:06 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:06.337+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:06.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:06 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:06.346+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:06.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:06 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:06.346+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:06.594+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:06.594+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:06.594+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:06.564+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:06.564+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:06.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:06 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:06.564+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:06.828 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.501496599 +0000 UTC m=+0.418360838 container init 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-03-27T08:44:06.828 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.512453234 +0000 UTC m=+0.429317426 container start 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T08:44:06.828 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.642034306 +0000 UTC m=+0.558898535 container attach 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T08:44:07.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.004+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:07.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.004+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:07.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.004+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:07.327 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:06 smithi173 podman[70647]: 2024-03-27 08:44:06.944159913 +0000 UTC m=+0.861024135 container died 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T08:44:07.608 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:07.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:07.608 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:07.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:07.608 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:07.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:07.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:07.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:07.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:07.483+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:07.356+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:07.356+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:07.356+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:07.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:07.356+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:07.778 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.5.service' 2024-03-27T08:44:07.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:07.332+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:07.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:07.332+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:07.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:07.612+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:07.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:07.612+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:07.862 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:07 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:07.613+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:07.863 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:07 smithi173 podman[70673]: 2024-03-27 08:44:07.746598786 +0000 UTC m=+0.784751775 container remove 5da5cc1dda057a169bd874a064ea6d26468c89c01fa9c003b26c0f1d3f47c3e2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-5-deactivate, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:44:07.863 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:07 smithi173 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.5.service: Deactivated successfully. 2024-03-27T08:44:07.863 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:07 smithi173 systemd[1]: Stopped Ceph osd.5 for f2a81f2e-ec12-11ee-95d0-87774f69a715. 2024-03-27T08:44:07.863 INFO:journalctl@ceph.osd.5.smithi173.stdout:Mar 27 08:44:07 smithi173 systemd[1]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.5.service: Consumed 56.030s CPU time. 2024-03-27T08:44:07.896 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:07.896 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-27T08:44:07.896 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-03-27T08:44:07.896 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.6 2024-03-27T08:44:08.256 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 systemd[1]: Stopping Ceph osd.6 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:08.316 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.974+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:08.317 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.974+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:08.317 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:07 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:07.974+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:08.317 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:08 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:08.322+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:08.317 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:08 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:08.322+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:08.317 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:08 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:08.322+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:08.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:08.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:08.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:08.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.481+0000 7fb5bde00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.481+0000 7fb5bde00700 -1 osd.6 90 *** Got signal Terminated *** 2024-03-27T08:44:08.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.481+0000 7fb5bde00700 -1 osd.6 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:08.758 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.530+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:08.758 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.530+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:08.758 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:08 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:08.530+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:08.525+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:08.525+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:08.525+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:08.578+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:08.578+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:08.578+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:08.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:08 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:08.578+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:09.292 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:09.292 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:09.292 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:09.292 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:09.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:09.360+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:09.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:09.360+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:09.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:09.360+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:09.512+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:09.512+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:09.512+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:09.307+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:09.307+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:09.308+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:09.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:09 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:09.308+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:09.529+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:09.529+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:09.529+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:09.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:09.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:09.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:09.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:09 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:09.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:10.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.992+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:10.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.992+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:10.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.992+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:10.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:09 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:09.992+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:10.658 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:10.556+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:10.556+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:10.556+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:10.342+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:10.342+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:10.342+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:10.659 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:10 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:10.342+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:10.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:10 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:10.339+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:10.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:10 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:10.339+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:10.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:10 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:10.339+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:10.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:10.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:10.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:10.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:10.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:10.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:10.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:10.627+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:10.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:10.537+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:10.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:10.537+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:10.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:10.537+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:10.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:10 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:10.537+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:11.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:11.000+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:11.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:11.000+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:11.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:11.000+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:11.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:11.000+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:11.372+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:11.372+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:11.372+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:11.372+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:11.568+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:11.568+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:11.757 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:11.568+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:11.758 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:11.568+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.275429+0000 front 2024-03-27T08:43:45.275595+0000 (oldest deadline 2024-03-27T08:44:10.575427+0000) 2024-03-27T08:44:11.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:11.328+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:11.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:11.328+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:11.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:11 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:11.328+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:11.609+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:11.609+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:11.609+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:11.609+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:11.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:11.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:11.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:11.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:11.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:11.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:11 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:11.532+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:12.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:12.010+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:12.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:12.010+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:12.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:12.010+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:12.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:12.010+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:12.507 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:12.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:12.507 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:12.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:12.507 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:12.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:12.507 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:12.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:12.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:12.378+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:12.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:12.378+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:12.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:12 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:12.378+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:12.618+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:12.618+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:12.618+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:12.618+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:12.572+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:12.572+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:12.572+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:12.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:12 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:12.572+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:13.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:12.611+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.668705+0000 front 2024-03-27T08:43:16.668835+0000 (oldest deadline 2024-03-27T08:43:40.769030+0000) 2024-03-27T08:44:13.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:12.611+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:26.670394+0000 front 2024-03-27T08:43:26.670477+0000 (oldest deadline 2024-03-27T08:43:51.970494+0000) 2024-03-27T08:44:13.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:12.611+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.573429+0000 front 2024-03-27T08:43:36.573505+0000 (oldest deadline 2024-03-27T08:44:00.673449+0000) 2024-03-27T08:44:13.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:12 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6[60862]: 2024-03-27T08:44:12.611+0000 7fb5b9600700 -1 osd.6 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.275429+0000 front 2024-03-27T08:43:45.275595+0000 (oldest deadline 2024-03-27T08:44:10.575427+0000) 2024-03-27T08:44:13.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:13.047+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:13.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:13.047+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:13.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:13.047+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:13.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:13.047+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:13.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:13.402+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:13.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:13.402+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:13.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:13.402+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:13.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:13 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:13.402+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:13.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:13.392+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:13.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:13.392+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:13.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:13 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:13.392+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:13.570+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:13.570+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:13.570+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:13.570+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:13.530+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:13.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:13.530+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:13.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:13.530+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:13.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:13 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:13.530+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:14.116 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:13 smithi164 podman[93122]: 2024-03-27 08:44:13.829419586 +0000 UTC m=+5.493453532 container died e4573497484910f92a757913fbc3abd8040fb0f6d9ffe24d00a075624dcbe74c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-03-27T08:44:14.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:14.058+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:14.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:14.058+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:14.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:14.058+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:14.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:14.058+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:14.419 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:14 smithi164 podman[93122]: 2024-03-27 08:44:14.250347901 +0000 UTC m=+5.914381878 container cleanup e4573497484910f92a757913fbc3abd8040fb0f6d9ffe24d00a075624dcbe74c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS) 2024-03-27T08:44:14.420 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:14 smithi164 bash[93122]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6 2024-03-27T08:44:14.756 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:14 smithi164 podman[93153]: 2024-03-27 08:44:14.526439527 +0000 UTC m=+0.681163598 container remove e4573497484910f92a757913fbc3abd8040fb0f6d9ffe24d00a075624dcbe74c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0) 2024-03-27T08:44:14.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:14.424+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:14.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:14.424+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:14.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:14.424+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:14.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:14 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:14.424+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:14.820 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:14.404+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:14.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:14.404+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:14.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:14 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:14.404+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:14.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:14.579+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:14.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:14.579+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:14.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:14.579+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:14.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:14.579+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:14.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:14.483+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:14.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:14.483+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:14.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:14.483+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:14.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:14 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:14.483+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:15.183 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:15.183 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:15.183 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:15.183 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:15.566 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:15 smithi164 podman[93239]: 2024-03-27 08:44:15.221316534 +0000 UTC m=+0.036178643 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:15.567 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:15 smithi164 podman[93239]: 2024-03-27 08:44:15.385585711 +0000 UTC m=+0.200447835 container create dc14f53e66d9b61d47157680f96c0a4b62ec7b0f9221f21025d3d5692e89786f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-27T08:44:15.567 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:15.408+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:15.567 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:15.408+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:15.567 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:15.408+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:15.567 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:15.408+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:15.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:15.362+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:15.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:15.362+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:15.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:15.362+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:15.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:15.584+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:15.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:15.584+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:15.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:15.584+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:15.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:15.584+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:15.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:15.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:15.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:15.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:15.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:15.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:15.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:15 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:15.513+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:16.006 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:15 smithi164 podman[93239]: 2024-03-27 08:44:15.655981845 +0000 UTC m=+0.470843979 container init dc14f53e66d9b61d47157680f96c0a4b62ec7b0f9221f21025d3d5692e89786f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326) 2024-03-27T08:44:16.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:15 smithi164 podman[93239]: 2024-03-27 08:44:15.667495581 +0000 UTC m=+0.482357722 container start dc14f53e66d9b61d47157680f96c0a4b62ec7b0f9221f21025d3d5692e89786f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6-deactivate, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-27T08:44:16.007 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:15 smithi164 podman[93239]: 2024-03-27 08:44:15.762970872 +0000 UTC m=+0.577833026 container attach dc14f53e66d9b61d47157680f96c0a4b62ec7b0f9221f21025d3d5692e89786f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6-deactivate, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.license=GPLv2) 2024-03-27T08:44:16.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.990+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:16.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.990+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:16.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.990+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:16.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:15 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:15.990+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:16.393 INFO:journalctl@ceph.osd.6.smithi164.stdout:Mar 27 08:44:16 smithi164 podman[93239]: 2024-03-27 08:44:16.103086362 +0000 UTC m=+0.917948529 container died dc14f53e66d9b61d47157680f96c0a4b62ec7b0f9221f21025d3d5692e89786f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-6-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True) 2024-03-27T08:44:16.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:16.398+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:16.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:16.398+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:16.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:16.398+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:16.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:16 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:16.398+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:16.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:16 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:16.353+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:16.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:16 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:16.353+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:16.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:16 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:16.354+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:16.610+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:16.610+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:16.610+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:16.610+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:16.544+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:16.544+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:16.544+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:16.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:16.544+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:16.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:16 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:16.544+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:16.844 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.6.service' 2024-03-27T08:44:16.967 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:16.967 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-03-27T08:44:16.967 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-03-27T08:44:16.967 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.7 2024-03-27T08:44:17.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 systemd[1]: Stopping Ceph osd.7 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:17.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:17.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:17.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:17.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:17.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:17.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:17.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:17.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:17.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:17 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:17.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:17.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:17 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:17.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:17.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:17 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:17.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:17.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:17 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:17.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.367+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.367+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.367+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.367+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.564+0000 7f3182200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.564+0000 7f3182200700 -1 osd.7 90 *** Got signal Terminated *** 2024-03-27T08:44:17.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:17 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:17.564+0000 7f3182200700 -1 osd.7 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:18.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:17.614+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:18.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:17.614+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:18.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:17.614+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:18.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:17.614+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:17.614+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:17.590+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:17.590+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:17.590+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:17.590+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:18.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:17 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:17.590+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:18.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:18.042+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:18.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:18.042+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:18.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:18.042+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:18.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:18.042+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:18.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:18 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:18.385+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:18.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:18 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:18.385+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:18.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:18 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:18.385+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:18.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:18 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:18.385+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:18.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:18.357+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:18.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:18.357+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:18.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:18.357+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:18.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:18 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:18.357+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:19.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:18.633+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:19.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:18.633+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:19.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:18.633+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:19.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:18.633+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:19.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:18.633+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:19.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:18.589+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:19.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:18.589+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:19.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:18.589+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:19.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:18.589+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:19.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:18 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:18.589+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:19.311 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:19.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:19.311 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:19.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:19.311 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:19.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:19.311 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:19.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:19.311 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:19.034+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:19.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:19.315+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:19.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:19.315+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:19.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:19.315+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:19.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:19.315+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:19.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:19 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:19.378+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:19.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:19 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:19.378+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:19.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:19 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:19.378+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:19.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:19 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:19.378+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:19.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:19.548+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:19.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:19.548+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:19.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:19.548+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:19.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:19.548+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:19.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:19.548+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:19.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:19.586+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:19.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:19.586+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:19.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:19.586+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:19.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:19.586+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:19.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:19 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:19.586+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:20.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:20.282+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:20.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:20.282+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:20.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:20.282+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:20.321 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:20.282+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:20.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:20.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:20.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:20.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:20.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:20.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:20.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:20.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:20.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:20 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:20.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:20.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:20.377+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:20.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:20.377+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:20.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:20.377+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:20.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:20.377+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:20.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:20 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:20.377+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:20.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:20.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:20.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:20.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:20.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:20.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:20.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:20.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:20.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:20.600+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:20.600+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:20.600+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:20.600+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:20.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:20 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:20.600+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:21.299 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:21.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:21.300 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:21.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:21.300 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:21.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:21.300 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:21.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:21.300 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:21.032+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:21.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:21.304+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:21.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:21.304+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:21.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:21.304+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:21.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:21 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:21.304+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:21.720 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:21.336+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:21.720 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:21.336+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:21.721 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:21.336+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:21.721 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:21.336+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:21.721 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:21 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:21.336+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:21.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:21.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:21.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:21.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:21.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:21.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:21.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:21.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:21.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:21.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:21.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:21.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:21.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:21.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:21.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:21.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:21.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:21.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:21.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:21 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:21.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:22.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:22.031+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:22.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:22.031+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:22.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:22.031+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:22.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:22.031+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:22.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:22.031+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:22.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:22.352+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:22.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:22.352+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:22.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:22.352+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:22.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:22.352+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:22.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:22 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:22.352+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:22.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:22.326+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:25.610232+0000 front 2024-03-27T08:43:25.610188+0000 (oldest deadline 2024-03-27T08:43:49.110293+0000) 2024-03-27T08:44:22.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:22.326+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.813137+0000 front 2024-03-27T08:43:34.812855+0000 (oldest deadline 2024-03-27T08:44:00.112608+0000) 2024-03-27T08:44:22.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:22.326+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.315198+0000 front 2024-03-27T08:43:45.315036+0000 (oldest deadline 2024-03-27T08:44:08.215127+0000) 2024-03-27T08:44:22.821 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7[53087]: 2024-03-27T08:44:22.326+0000 7f3178a00700 -1 osd.7 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.918365+0000 front 2024-03-27T08:43:53.918320+0000 (oldest deadline 2024-03-27T08:44:16.818516+0000) 2024-03-27T08:44:22.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:22.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:22.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:22.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:22.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:22.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:22.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:22.556+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:22.557+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:22.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:22.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:22.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:22.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:22.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:22 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:22.521+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 podman[69563]: 2024-03-27 08:44:22.921237063 +0000 UTC m=+5.517271941 container stop 17f12fb77c31fe388f3999f670501f1cd60c1354cfb3d5dcd4b7d8b2bb5ab81f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:22 smithi167 podman[69563]: 2024-03-27 08:44:22.947251175 +0000 UTC m=+5.543286065 container died 17f12fb77c31fe388f3999f670501f1cd60c1354cfb3d5dcd4b7d8b2bb5ab81f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:23.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:23.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:23.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:23.275 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:23.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:23.276 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:23 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:23.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:23.570 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:23 smithi167 podman[69563]: 2024-03-27 08:44:23.410044835 +0000 UTC m=+6.006079756 container cleanup 17f12fb77c31fe388f3999f670501f1cd60c1354cfb3d5dcd4b7d8b2bb5ab81f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-03-27T08:44:23.571 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:23 smithi167 bash[69563]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7 2024-03-27T08:44:23.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:23.371+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:23.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:23.371+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:23.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:23.371+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:23.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:23.371+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:23.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:23 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:23.371+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:23.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:23.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:23.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:23.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:23.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:23.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:23.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:23.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:23.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:23.511+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:23.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:23.598+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:23.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:23.598+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:23.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:23.598+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:23.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:23.598+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:23.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:23 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:23.598+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:24.044 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:23 smithi167 podman[69578]: 2024-03-27 08:44:23.611118663 +0000 UTC m=+0.676981367 container remove 17f12fb77c31fe388f3999f670501f1cd60c1354cfb3d5dcd4b7d8b2bb5ab81f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5) 2024-03-27T08:44:24.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:24 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:24.049+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:24.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:24 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:24.049+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:24.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:24 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:24.049+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:24.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:24 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:24.049+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:24.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:24 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:24.049+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:24.668 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:24 smithi167 podman[69661]: 2024-03-27 08:44:24.27571298 +0000 UTC m=+0.039838654 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:24.668 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:24 smithi167 podman[69661]: 2024-03-27 08:44:24.378900246 +0000 UTC m=+0.143025981 container create 2932ee044061dca19c05c1f12d719a010e5ec6daaf067fd20c8533f350958aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:44:24.668 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:24 smithi167 podman[69661]: 2024-03-27 08:44:24.673751815 +0000 UTC m=+0.437877499 container init 2932ee044061dca19c05c1f12d719a010e5ec6daaf067fd20c8533f350958aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7-deactivate, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326) 2024-03-27T08:44:24.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:24.349+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:24.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:24.349+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:24.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:24.349+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:24.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:24.349+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:24.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:24 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:24.349+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:24.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:24.581+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:24.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:24.581+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:24.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:24.581+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:24.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:24.581+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:24.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:24.581+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:24.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:24.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:24.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:24.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:24.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:24.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:24.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:24.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:24.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:24 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:24.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:25.069 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:24 smithi167 podman[69661]: 2024-03-27 08:44:24.686269138 +0000 UTC m=+0.450394808 container start 2932ee044061dca19c05c1f12d719a010e5ec6daaf067fd20c8533f350958aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-03-27T08:44:25.069 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:24 smithi167 podman[69661]: 2024-03-27 08:44:24.756169665 +0000 UTC m=+0.520295349 container attach 2932ee044061dca19c05c1f12d719a010e5ec6daaf067fd20c8533f350958aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, ceph=True) 2024-03-27T08:44:25.320 INFO:journalctl@ceph.osd.7.smithi167.stdout:Mar 27 08:44:25 smithi167 podman[69661]: 2024-03-27 08:44:25.136286221 +0000 UTC m=+0.900411889 container died 2932ee044061dca19c05c1f12d719a010e5ec6daaf067fd20c8533f350958aef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-27T08:44:25.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:25.073+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:25.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:25.073+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:25.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:25.073+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:25.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:25.073+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:25.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:25 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:25.073+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:25.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:25.324+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:25.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:25.324+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:25.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:25.324+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:25.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:25.324+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:25.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:25 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:25.324+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:25.824 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.7.service' 2024-03-27T08:44:25.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:25.553+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:25.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:25.553+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:25.553+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:25.553+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:25.553+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:25.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:25.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:25.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:25.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:25.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:25 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:25.501+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:25.921 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:25.921 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-03-27T08:44:25.921 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-03-27T08:44:25.922 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.8 2024-03-27T08:44:26.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:26 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:26.037+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:26.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:26 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:26.037+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:26.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:26 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:26.037+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:26.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:26 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:26.037+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:26.071 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:26 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:26.037+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:26.327 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 systemd[1]: Stopping Ceph osd.8 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:26.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:26 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:26.347+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:26.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:26.460+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:26.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:26.460+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:26.460+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:26.460+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:26.460+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.480+0000 7f56bfa00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.480+0000 7f56bfa00700 -1 osd.8 90 *** Got signal Terminated *** 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.480+0000 7f56bfa00700 -1 osd.8 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.523+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.523+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.523+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:26.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.523+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:26.829 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:26 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:26.523+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:27.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:27 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:27.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:27.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:27 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:27.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:27.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:27 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:27.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:27.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:27 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:27.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:27.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:27 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:27.046+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:27.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:27 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:27.359+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:27.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:27.550+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:27.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:27.550+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:27.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:27.550+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:27.550+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:27.550+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:27.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:27 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:27.411+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:28.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:28.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:28.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:28.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:28.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:28.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:28 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:28.033+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:28.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:28 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:28.406+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:28.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:28.543+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:28.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:28.543+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:28.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:28.543+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:28.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:28.543+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:28.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:28.543+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:28.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:28 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:28.397+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:29.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:29.029+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:29.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:29 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:29.365+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:29.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:29.585+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:29.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:29.585+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:29.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:29.585+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:29.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:29.585+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:29.585+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:29.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:29 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:29.421+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:30.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:30.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:30.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:30.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:30.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:30.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:30 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:30.052+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:30.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:30 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:30.373+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:30.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:30.619+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.955252+0000 front 2024-03-27T08:43:17.955182+0000 (oldest deadline 2024-03-27T08:43:39.054695+0000) 2024-03-27T08:44:30.827 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:30.619+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.756875+0000 front 2024-03-27T08:43:23.757114+0000 (oldest deadline 2024-03-27T08:43:50.758419+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:30.619+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.161614+0000 front 2024-03-27T08:43:34.161692+0000 (oldest deadline 2024-03-27T08:43:58.261845+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:30.619+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:42.264705+0000 front 2024-03-27T08:43:42.264902+0000 (oldest deadline 2024-03-27T08:44:08.164461+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8[53834]: 2024-03-27T08:44:30.619+0000 7f56bb200700 -1 osd.8 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.367361+0000 front 2024-03-27T08:43:53.367645+0000 (oldest deadline 2024-03-27T08:44:17.467666+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:30.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:30 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:30.379+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:31.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:31.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:31.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:31.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:31.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:31.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:31 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:31.100+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:31.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:31 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:31.401+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:31.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:31.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:31.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:31.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:31.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:31.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:31 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:31.384+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:32.318 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:31 smithi173 podman[70765]: 2024-03-27 08:44:31.932799298 +0000 UTC m=+5.565149317 container died ab82538cca8a1eb5e07dc2cc2f55a1cc782d9334dd9df33fcadfe6456e9b8638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:32.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:32 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:32.114+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:32.577 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:32 smithi173 podman[70765]: 2024-03-27 08:44:32.491148928 +0000 UTC m=+6.123498984 container cleanup ab82538cca8a1eb5e07dc2cc2f55a1cc782d9334dd9df33fcadfe6456e9b8638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:44:32.577 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:32 smithi173 bash[70765]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8 2024-03-27T08:44:32.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:32.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:32.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:32.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:32.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:32.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:32 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:32.370+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:32.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:32 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:32.392+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:33.077 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:32 smithi173 podman[70783]: 2024-03-27 08:44:32.700958148 +0000 UTC m=+0.753941659 container remove ab82538cca8a1eb5e07dc2cc2f55a1cc782d9334dd9df33fcadfe6456e9b8638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:33.572 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:33.096+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:33.629 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:33 smithi173 podman[70871]: 2024-03-27 08:44:33.459009209 +0000 UTC m=+0.032012427 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:33.629 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:33.630 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:33.630 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:33.630 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:33.630 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:33.630 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:33 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:33.365+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:33.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:33 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:33.442+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:33.939 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:33 smithi173 podman[70871]: 2024-03-27 08:44:33.635149706 +0000 UTC m=+0.208152930 container create c85360d24cbaac138e6dd80b3eee089cd05e6cc4df21154621e14665c67906ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:34.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:34 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:34.064+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:34.328 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:33 smithi173 podman[70871]: 2024-03-27 08:44:33.944223826 +0000 UTC m=+0.517227104 container init c85360d24cbaac138e6dd80b3eee089cd05e6cc4df21154621e14665c67906ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5) 2024-03-27T08:44:34.328 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:33 smithi173 podman[70871]: 2024-03-27 08:44:33.955609796 +0000 UTC m=+0.528613057 container start c85360d24cbaac138e6dd80b3eee089cd05e6cc4df21154621e14665c67906ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-03-27T08:44:34.328 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:34 smithi173 podman[70871]: 2024-03-27 08:44:34.03811134 +0000 UTC m=+0.611114608 container attach c85360d24cbaac138e6dd80b3eee089cd05e6cc4df21154621e14665c67906ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:44:34.743 INFO:journalctl@ceph.osd.8.smithi173.stdout:Mar 27 08:44:34 smithi173 podman[70871]: 2024-03-27 08:44:34.385153255 +0000 UTC m=+0.958156499 container died c85360d24cbaac138e6dd80b3eee089cd05e6cc4df21154621e14665c67906ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-8-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True) 2024-03-27T08:44:34.743 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:34.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:34.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:34.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:34.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:34.744 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:34 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:34.400+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:34.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:34 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:34.467+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:35.197 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.8.service' 2024-03-27T08:44:35.307 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:35.307 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-03-27T08:44:35.307 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-03-27T08:44:35.307 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.9 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:35.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:35 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:35.020+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:35.577 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:35.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:35.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:35.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:35.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:35.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:35 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:35.443+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:35.756 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 systemd[1]: Stopping Ceph osd.9 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:35.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:36.257 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.856+0000 7f9833400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:36.257 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.856+0000 7f9833400700 -1 osd.9 90 *** Got signal Terminated *** 2024-03-27T08:44:36.257 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:35 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:35.856+0000 7f9833400700 -1 osd.9 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:36.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:36.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:36.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:36.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:36.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:36.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:36.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:36 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:36.011+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:36.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:36.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:36.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:36.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:36.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:36.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:36.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:36 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:36.469+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:36.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:36.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:36.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:36.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:36.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:36.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:36 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:36.461+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:37.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:37.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:37 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:37.050+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:37.734 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:37 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:37.488+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:37.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:37 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:37.484+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:38.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:38.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:38.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:38.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:38.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:38.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:38.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:38 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:38.075+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:38.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:38.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:38.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:38.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:38.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:38.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:38.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:38 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:38.460+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:38.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:38.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:38.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:38.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:38.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:38.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:38 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:38.536+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:39.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:39.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:39.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:39.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:39.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:39.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:39.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:39 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:39.067+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:39.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:39.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:39.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:39.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:39.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:39.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:39.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:39 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:39.448+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.551+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.551+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.551+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.552+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.552+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:39.830 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:39 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:39.552+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:40.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:40.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:40.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:40.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:40.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:40.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:40.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.019+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:40.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:13.952227+0000 front 2024-03-27T08:43:13.952562+0000 (oldest deadline 2024-03-27T08:43:39.852274+0000) 2024-03-27T08:44:40.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:27.257265+0000 front 2024-03-27T08:43:27.257117+0000 (oldest deadline 2024-03-27T08:43:52.557126+0000) 2024-03-27T08:44:40.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:32.558078+0000 front 2024-03-27T08:43:32.558472+0000 (oldest deadline 2024-03-27T08:43:57.858306+0000) 2024-03-27T08:44:40.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.262589+0000 front 2024-03-27T08:43:45.262510+0000 (oldest deadline 2024-03-27T08:44:06.962195+0000) 2024-03-27T08:44:40.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:54.465713+0000 front 2024-03-27T08:43:54.465646+0000 (oldest deadline 2024-03-27T08:44:20.365933+0000) 2024-03-27T08:44:40.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:00.367122+0000 front 2024-03-27T08:44:00.367447+0000 (oldest deadline 2024-03-27T08:44:25.666702+0000) 2024-03-27T08:44:40.758 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:40 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9[67786]: 2024-03-27T08:44:40.478+0000 7f982ec00700 -1 osd.9 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:10.968475+0000 front 2024-03-27T08:44:10.968542+0000 (oldest deadline 2024-03-27T08:44:35.068576+0000) 2024-03-27T08:44:41.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:41.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:41.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:41.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:41.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:41.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:40 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:40.586+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:41.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:41.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:40 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:40.971+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:41.582 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:41 smithi164 podman[93343]: 2024-03-27 08:44:41.309613765 +0000 UTC m=+5.576442114 container died a1230e33d1de2045bf9a876344dbe83296418c7808c55fdb228b0ec02fc2b2e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-03-27T08:44:41.912 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:41 smithi164 podman[93343]: 2024-03-27 08:44:41.700052704 +0000 UTC m=+5.966881068 container cleanup a1230e33d1de2045bf9a876344dbe83296418c7808c55fdb228b0ec02fc2b2e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:44:41.912 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:41 smithi164 bash[93343]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9 2024-03-27T08:44:41.912 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:41 smithi164 podman[93366]: 2024-03-27 08:44:41.917447551 +0000 UTC m=+0.595448596 container remove a1230e33d1de2045bf9a876344dbe83296418c7808c55fdb228b0ec02fc2b2e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:44:42.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:42.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:42.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:42.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:42.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:42.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:41 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:41.601+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:42.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:41.991+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:43.007 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:42 smithi164 podman[93459]: 2024-03-27 08:44:42.596444627 +0000 UTC m=+0.033645858 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:43.007 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:42 smithi164 podman[93459]: 2024-03-27 08:44:42.718553622 +0000 UTC m=+0.155754878 container create 3248700cacd18e345061c78dfa5aa1a8c544ac5e48d995f1981660c6400fd36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9-deactivate, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:44:43.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:43.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:43.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:43.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:43.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:43.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:42 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:42.584+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:43.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:43.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:43.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:43.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:43.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:43.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:43.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:42 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:42.997+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:43.457 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:43 smithi164 podman[93459]: 2024-03-27 08:44:43.022247636 +0000 UTC m=+0.459448942 container init 3248700cacd18e345061c78dfa5aa1a8c544ac5e48d995f1981660c6400fd36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:44:43.457 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:43 smithi164 podman[93459]: 2024-03-27 08:44:43.033250328 +0000 UTC m=+0.470451594 container start 3248700cacd18e345061c78dfa5aa1a8c544ac5e48d995f1981660c6400fd36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5) 2024-03-27T08:44:43.458 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:43 smithi164 podman[93459]: 2024-03-27 08:44:43.121008993 +0000 UTC m=+0.558210312 container attach 3248700cacd18e345061c78dfa5aa1a8c544ac5e48d995f1981660c6400fd36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-27T08:44:43.757 INFO:journalctl@ceph.osd.9.smithi164.stdout:Mar 27 08:44:43 smithi164 podman[93459]: 2024-03-27 08:44:43.464361725 +0000 UTC m=+0.901562989 container died 3248700cacd18e345061c78dfa5aa1a8c544ac5e48d995f1981660c6400fd36e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-9-deactivate, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:44:44.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:44.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:44.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:44.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:44.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:44.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:43 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:43.582+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:44.235 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.9.service' 2024-03-27T08:44:44.240 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:44.241 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:43 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:43.976+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:44.343 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:44.344 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-03-27T08:44:44.344 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-03-27T08:44:44.344 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.10 2024-03-27T08:44:44.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 systemd[1]: Stopping Ceph osd.10 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:44.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:44 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:44.561+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:44.940 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.893+0000 7f2a0e000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:44.940 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.893+0000 7f2a0e000700 -1 osd.10 90 *** Got signal Terminated *** 2024-03-27T08:44:44.940 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.893+0000 7f2a0e000700 -1 osd.10 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:45.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:45.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:45.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:45.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:45.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:45.323 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:45.323 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:44 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:44.943+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:45.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:45.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:45.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:45.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:45.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:45.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:45 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:45.576+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:46.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:45 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:45.938+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:46.827 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:46.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:46.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:46.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:46.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:46.828 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:46.546+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:47.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:46 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:46.930+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:47.855 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:47 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:47.591+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:48.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:47 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:47.942+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:49.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:49.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:48 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:48.642+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:49.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:16.723717+0000 front 2024-03-27T08:43:16.723890+0000 (oldest deadline 2024-03-27T08:43:42.023720+0000) 2024-03-27T08:44:49.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:24.924687+0000 front 2024-03-27T08:43:24.925223+0000 (oldest deadline 2024-03-27T08:43:49.624668+0000) 2024-03-27T08:44:49.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:36.627668+0000 front 2024-03-27T08:43:36.627784+0000 (oldest deadline 2024-03-27T08:44:01.327695+0000) 2024-03-27T08:44:49.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:41.328455+0000 front 2024-03-27T08:43:41.328596+0000 (oldest deadline 2024-03-27T08:44:08.328987+0000) 2024-03-27T08:44:49.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:53.531507+0000 front 2024-03-27T08:43:53.531633+0000 (oldest deadline 2024-03-27T08:44:18.831736+0000) 2024-03-27T08:44:49.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:01.733541+0000 front 2024-03-27T08:44:01.733500+0000 (oldest deadline 2024-03-27T08:44:27.633434+0000) 2024-03-27T08:44:49.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:48 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10[59847]: 2024-03-27T08:44:48.972+0000 7f2a09800700 -1 osd.10 90 heartbeat_check: no reply from 172.21.15.164:6822 osd.6 since back 2024-03-27T08:44:09.335032+0000 front 2024-03-27T08:44:09.335167+0000 (oldest deadline 2024-03-27T08:44:34.634838+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:50.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:49 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:49.686+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:50.571 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:50 smithi167 podman[69765]: 2024-03-27 08:44:50.250384197 +0000 UTC m=+5.497588074 container died 4880c0963c161ce1e3bce90a2f3bef986cc3be651aef03c2dd51d80af99db870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-03-27T08:44:50.958 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:50 smithi167 podman[69765]: 2024-03-27 08:44:50.695915853 +0000 UTC m=+5.943119745 container cleanup 4880c0963c161ce1e3bce90a2f3bef986cc3be651aef03c2dd51d80af99db870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-27T08:44:50.958 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:50 smithi167 bash[69765]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:51.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:50 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:50.656+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:51.321 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:50 smithi167 podman[69792]: 2024-03-27 08:44:50.963501949 +0000 UTC m=+0.699657486 container remove 4880c0963c161ce1e3bce90a2f3bef986cc3be651aef03c2dd51d80af99db870 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:44:52.054 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:51 smithi167 podman[69870]: 2024-03-27 08:44:51.653414639 +0000 UTC m=+0.037793374 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:44:52.054 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:51 smithi167 podman[69870]: 2024-03-27 08:44:51.772972504 +0000 UTC m=+0.157351227 container create 535a7dcf52f2d0d7a93cb243abbb1b5e05a8806cc5c754e8b1bc87460fe5262e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS) 2024-03-27T08:44:52.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:52.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:52.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:52.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:52.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:52.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:52.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:51.693+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:52.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:52 smithi167 podman[69870]: 2024-03-27 08:44:52.059642442 +0000 UTC m=+0.444021181 container init 535a7dcf52f2d0d7a93cb243abbb1b5e05a8806cc5c754e8b1bc87460fe5262e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10-deactivate, org.label-schema.build-date=20240326, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:44:52.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:52 smithi167 podman[69870]: 2024-03-27 08:44:52.070004756 +0000 UTC m=+0.454383487 container start 535a7dcf52f2d0d7a93cb243abbb1b5e05a8806cc5c754e8b1bc87460fe5262e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-03-27T08:44:52.322 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:52 smithi167 podman[69870]: 2024-03-27 08:44:52.150536789 +0000 UTC m=+0.534915575 container attach 535a7dcf52f2d0d7a93cb243abbb1b5e05a8806cc5c754e8b1bc87460fe5262e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD) 2024-03-27T08:44:52.821 INFO:journalctl@ceph.osd.10.smithi167.stdout:Mar 27 08:44:52 smithi167 podman[69870]: 2024-03-27 08:44:52.496224173 +0000 UTC m=+0.880602910 container died 535a7dcf52f2d0d7a93cb243abbb1b5e05a8806cc5c754e8b1bc87460fe5262e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-10-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-03-27T08:44:53.077 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:53.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:52 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:52.723+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:53.151 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.10.service' 2024-03-27T08:44:53.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:44:53.242 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-03-27T08:44:53.243 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-03-27T08:44:53.243 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.11 2024-03-27T08:44:53.766 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 systemd[1]: Stopping Ceph osd.11 for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:44:54.039 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:54.039 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:53 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:53.771+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.043+0000 7f872a000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.043+0000 7f872a000700 -1 osd.11 90 *** Got signal Terminated *** 2024-03-27T08:44:54.040 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.043+0000 7f872a000700 -1 osd.11 90 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-27T08:44:55.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:55.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:55.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:55.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:55.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:55.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:55.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:54 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:54.787+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:56.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:55.741+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:57.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:56 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:56.730+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-03-27T08:44:28.997366+0000 front 2024-03-27T08:44:28.997581+0000 (oldest deadline 2024-03-27T08:44:55.997936+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:58.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:57 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:57.761+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-03-27T08:44:28.997366+0000 front 2024-03-27T08:44:28.997581+0000 (oldest deadline 2024-03-27T08:44:55.997936+0000) 2024-03-27T08:44:59.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6806 osd.0 since back 2024-03-27T08:43:17.277018+0000 front 2024-03-27T08:43:17.276805+0000 (oldest deadline 2024-03-27T08:43:43.176924+0000) 2024-03-27T08:44:59.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6804 osd.1 since back 2024-03-27T08:43:23.177887+0000 front 2024-03-27T08:43:23.178047+0000 (oldest deadline 2024-03-27T08:43:48.979652+0000) 2024-03-27T08:44:59.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6804 osd.2 since back 2024-03-27T08:43:34.782413+0000 front 2024-03-27T08:43:34.782449+0000 (oldest deadline 2024-03-27T08:44:00.583255+0000) 2024-03-27T08:44:59.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.164:6814 osd.3 since back 2024-03-27T08:43:45.186576+0000 front 2024-03-27T08:43:45.186427+0000 (oldest deadline 2024-03-27T08:44:09.886314+0000) 2024-03-27T08:44:59.078 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6812 osd.4 since back 2024-03-27T08:43:49.887105+0000 front 2024-03-27T08:43:49.887166+0000 (oldest deadline 2024-03-27T08:44:15.787338+0000) 2024-03-27T08:44:59.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6812 osd.5 since back 2024-03-27T08:44:03.291744+0000 front 2024-03-27T08:44:03.291947+0000 (oldest deadline 2024-03-27T08:44:27.391418+0000) 2024-03-27T08:44:59.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.167:6820 osd.7 since back 2024-03-27T08:44:21.995778+0000 front 2024-03-27T08:44:21.996160+0000 (oldest deadline 2024-03-27T08:44:46.695638+0000) 2024-03-27T08:44:59.079 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:58 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11[60944]: 2024-03-27T08:44:58.756+0000 7f8725800700 -1 osd.11 90 heartbeat_check: no reply from 172.21.15.173:6820 osd.8 since back 2024-03-27T08:44:28.997366+0000 front 2024-03-27T08:44:28.997581+0000 (oldest deadline 2024-03-27T08:44:55.997936+0000) 2024-03-27T08:44:59.752 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:59 smithi173 podman[70988]: 2024-03-27 08:44:59.490261387 +0000 UTC m=+5.770233494 container died b39e8807733c002f3b359994ef8d07e813b24fc88b77af866520c70daf3d2dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326) 2024-03-27T08:45:00.057 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:59 smithi173 podman[70988]: 2024-03-27 08:44:59.883144524 +0000 UTC m=+6.163116625 container cleanup b39e8807733c002f3b359994ef8d07e813b24fc88b77af866520c70daf3d2dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:45:00.058 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:44:59 smithi173 bash[70988]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11 2024-03-27T08:45:00.327 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:00 smithi173 podman[71008]: 2024-03-27 08:45:00.062539177 +0000 UTC m=+0.557343522 container remove b39e8807733c002f3b359994ef8d07e813b24fc88b77af866520c70daf3d2dc5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.license=GPLv2) 2024-03-27T08:45:01.170 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:00 smithi173 podman[71096]: 2024-03-27 08:45:00.772297531 +0000 UTC m=+0.031167085 image pull b379bbd8da6b5d0fa9a3523941efac213b6815e1cbf05c6507954f0a3fe7a801 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772 2024-03-27T08:45:01.171 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:00 smithi173 podman[71096]: 2024-03-27 08:45:00.87172495 +0000 UTC m=+0.130594538 container create d8cba3b82a7ef96163e9f1229ed3e92348e1d6fb6980de5b0f2ad36c0e2b521a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, maintainer=Guillaume Abrioux ) 2024-03-27T08:45:01.171 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:01 smithi173 podman[71096]: 2024-03-27 08:45:01.175813123 +0000 UTC m=+0.434682724 container init d8cba3b82a7ef96163e9f1229ed3e92348e1d6fb6980de5b0f2ad36c0e2b521a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11-deactivate, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD) 2024-03-27T08:45:01.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:01 smithi173 podman[71096]: 2024-03-27 08:45:01.186597718 +0000 UTC m=+0.445467316 container start d8cba3b82a7ef96163e9f1229ed3e92348e1d6fb6980de5b0f2ad36c0e2b521a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-03-27T08:45:01.578 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:01 smithi173 podman[71096]: 2024-03-27 08:45:01.266162067 +0000 UTC m=+0.525031671 container attach d8cba3b82a7ef96163e9f1229ed3e92348e1d6fb6980de5b0f2ad36c0e2b521a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-03-27T08:45:01.996 INFO:journalctl@ceph.osd.11.smithi173.stdout:Mar 27 08:45:01 smithi173 podman[71096]: 2024-03-27 08:45:01.610913515 +0000 UTC m=+0.869783069 container died d8cba3b82a7ef96163e9f1229ed3e92348e1d6fb6980de5b0f2ad36c0e2b521a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-osd-11-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True) 2024-03-27T08:45:02.407 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@osd.11.service' 2024-03-27T08:45:02.528 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:02.528 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-03-27T08:45:02.528 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-03-27T08:45:02.528 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.a 2024-03-27T08:45:03.007 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:02 smithi164 systemd[1]: Stopping Ceph mds.a for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:03.507 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a[74694]: 2024-03-27T08:45:03.173+0000 7f6beb400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:03.507 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:03 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a[74694]: 2024-03-27T08:45:03.173+0000 7f6beb400700 -1 mds.a *** got signal Terminated *** 2024-03-27T08:45:05.699 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:05 smithi164 podman[93565]: 2024-03-27 08:45:05.3927326 +0000 UTC m=+2.400307840 container died a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-03-27T08:45:06.007 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:05 smithi164 podman[93565]: 2024-03-27 08:45:05.816147082 +0000 UTC m=+2.823722314 container cleanup a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, ceph=True) 2024-03-27T08:45:06.007 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:05 smithi164 bash[93565]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a 2024-03-27T08:45:06.507 INFO:journalctl@ceph.mds.a.smithi164.stdout:Mar 27 08:45:06 smithi164 podman[93579]: 2024-03-27 08:45:06.052087811 +0000 UTC m=+0.641251598 container remove a3d429724027ae10a12672fca40ff7318b6eea30f1a9949592fee9b1d5eaffaf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-a, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux ) 2024-03-27T08:45:06.588 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.a.service' 2024-03-27T08:45:06.709 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:06.709 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-03-27T08:45:06.710 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-03-27T08:45:06.710 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.d 2024-03-27T08:45:07.257 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:06 smithi164 systemd[1]: Stopping Ceph mds.d for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:07.757 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d[73635]: 2024-03-27T08:45:07.309+0000 7f6eddc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:07.757 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:07 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d[73635]: 2024-03-27T08:45:07.309+0000 7f6eddc00700 -1 mds.d *** got signal Terminated *** 2024-03-27T08:45:09.920 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:09 smithi164 podman[93684]: 2024-03-27 08:45:09.619330474 +0000 UTC m=+2.451747551 container died fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-03-27T08:45:10.257 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:10 smithi164 podman[93684]: 2024-03-27 08:45:10.094222971 +0000 UTC m=+2.926640089 container cleanup fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, ceph=True) 2024-03-27T08:45:10.257 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:10 smithi164 bash[93684]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d 2024-03-27T08:45:10.625 INFO:journalctl@ceph.mds.d.smithi164.stdout:Mar 27 08:45:10 smithi164 podman[93696]: 2024-03-27 08:45:10.412271847 +0000 UTC m=+0.779200776 container remove fc48867834709fb8d7e0004c4d7c8f584ce30a32f246181da261b99e61c6e57f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-d, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:45:10.652 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.d.service' 2024-03-27T08:45:10.765 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:10.766 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-03-27T08:45:10.766 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-03-27T08:45:10.766 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.g 2024-03-27T08:45:11.007 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:10 smithi164 systemd[1]: Stopping Ceph mds.g for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:11.757 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g[74316]: 2024-03-27T08:45:11.296+0000 7efc51600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:11.757 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:11 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g[74316]: 2024-03-27T08:45:11.296+0000 7efc51600700 -1 mds.g *** got signal Terminated *** 2024-03-27T08:45:13.758 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:13 smithi164 podman[93804]: 2024-03-27 08:45:13.447125932 +0000 UTC m=+2.299700398 container died af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-03-27T08:45:14.135 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:13 smithi164 podman[93804]: 2024-03-27 08:45:13.872737494 +0000 UTC m=+2.725311968 container cleanup af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-03-27T08:45:14.135 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:13 smithi164 bash[93804]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g 2024-03-27T08:45:14.507 INFO:journalctl@ceph.mds.g.smithi164.stdout:Mar 27 08:45:14 smithi164 podman[93828]: 2024-03-27 08:45:14.140450573 +0000 UTC m=+0.681184396 container remove af77e2a42797f0c480fda74ff8ae49597db400b67dfa082a8b3773891880b70a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-g, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-03-27T08:45:14.704 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.g.service' 2024-03-27T08:45:14.809 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:14.810 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-03-27T08:45:14.810 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-03-27T08:45:14.810 DEBUG:teuthology.orchestra.run.smithi164:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.j 2024-03-27T08:45:15.257 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:14 smithi164 systemd[1]: Stopping Ceph mds.j for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:15.757 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j[73248]: 2024-03-27T08:45:15.406+0000 7f52ffe00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:15.757 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:15 smithi164 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j[73248]: 2024-03-27T08:45:15.406+0000 7f52ffe00700 -1 mds.j *** got signal Terminated *** 2024-03-27T08:45:18.000 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:17 smithi164 podman[93936]: 2024-03-27 08:45:17.725716678 +0000 UTC m=+2.434907270 container died 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:45:18.257 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:18 smithi164 podman[93936]: 2024-03-27 08:45:18.175817257 +0000 UTC m=+2.885007869 container cleanup 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240326) 2024-03-27T08:45:18.257 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:18 smithi164 bash[93936]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j 2024-03-27T08:45:18.757 INFO:journalctl@ceph.mds.j.smithi164.stdout:Mar 27 08:45:18 smithi164 podman[93950]: 2024-03-27 08:45:18.393350463 +0000 UTC m=+0.652794023 container remove 51d0a7d6c2e20bf4b0517264dca869de855f83f69fc3fcaadd23d32527382c60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-j, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.schema-version=1.0) 2024-03-27T08:45:18.903 DEBUG:teuthology.orchestra.run.smithi164:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.j.service' 2024-03-27T08:45:19.018 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:19.018 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-03-27T08:45:19.018 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-03-27T08:45:19.019 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.b 2024-03-27T08:45:19.566 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:19 smithi167 systemd[1]: Stopping Ceph mds.b for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:19.821 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b[65196]: 2024-03-27T08:45:19.570+0000 7f2457c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:19.821 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:19 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b[65196]: 2024-03-27T08:45:19.570+0000 7f2457c00700 -1 mds.b *** got signal Terminated *** 2024-03-27T08:45:28.528 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:28 smithi167 podman[69971]: 2024-03-27 08:45:28.194505299 +0000 UTC m=+8.779169037 container died ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:45:28.801 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:28 smithi167 podman[69971]: 2024-03-27 08:45:28.638449952 +0000 UTC m=+9.223113714 container cleanup ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-03-27T08:45:28.801 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:28 smithi167 bash[69971]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b 2024-03-27T08:45:29.072 INFO:journalctl@ceph.mds.b.smithi167.stdout:Mar 27 08:45:28 smithi167 podman[69996]: 2024-03-27 08:45:28.805968928 +0000 UTC m=+0.596355776 container remove ed860cc475c30287b4dcc6f907ec9a9fc3f561f8c04fe2eea71b93d8f86d7ec6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-b, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:45:29.193 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.b.service' 2024-03-27T08:45:29.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:29.290 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-03-27T08:45:29.290 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-03-27T08:45:29.290 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.e 2024-03-27T08:45:29.572 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:29 smithi167 systemd[1]: Stopping Ceph mds.e for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:30.322 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e[64578]: 2024-03-27T08:45:29.974+0000 7f3339600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:30.322 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:29 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e[64578]: 2024-03-27T08:45:29.974+0000 7f3339600700 -1 mds.e *** got signal Terminated *** 2024-03-27T08:45:32.185 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:31 smithi167 podman[70100]: 2024-03-27 08:45:31.884733182 +0000 UTC m=+2.205747009 container died d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_BRANCH=HEAD, org.label-schema.build-date=20240326, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e) 2024-03-27T08:45:32.572 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:32 smithi167 podman[70100]: 2024-03-27 08:45:32.325466332 +0000 UTC m=+2.646480161 container cleanup d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS) 2024-03-27T08:45:32.572 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:32 smithi167 bash[70100]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e 2024-03-27T08:45:33.072 INFO:journalctl@ceph.mds.e.smithi167.stdout:Mar 27 08:45:32 smithi167 podman[70114]: 2024-03-27 08:45:32.602510771 +0000 UTC m=+0.701164940 container remove d8b0669bc4d1f8a5bea33ffd25a943d476975f27ffa4f3c876c0cc5db3ceb553 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-e, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True) 2024-03-27T08:45:33.145 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.e.service' 2024-03-27T08:45:33.247 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:33.247 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-03-27T08:45:33.248 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-03-27T08:45:33.248 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.h 2024-03-27T08:45:33.571 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:33 smithi167 systemd[1]: Stopping Ceph mds.h for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:34.072 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:45:33.759+0000 7f371dc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:34.072 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:33 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h[64883]: 2024-03-27T08:45:33.759+0000 7f371dc00700 -1 mds.h *** got signal Terminated *** 2024-03-27T08:45:39.572 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:39 smithi167 podman[70220]: 2024-03-27 08:45:39.305298909 +0000 UTC m=+5.677522830 container died 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0) 2024-03-27T08:45:39.992 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:39 smithi167 podman[70220]: 2024-03-27 08:45:39.743173722 +0000 UTC m=+6.115397650 container cleanup 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240326, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-03-27T08:45:39.993 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:39 smithi167 bash[70220]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h 2024-03-27T08:45:40.322 INFO:journalctl@ceph.mds.h.smithi167.stdout:Mar 27 08:45:39 smithi167 podman[70234]: 2024-03-27 08:45:39.997333743 +0000 UTC m=+0.670244437 container remove 7e95fbb8f20a4e822b9af50cc7e94059f3ba62fa5d058d83d9f4a58b76c9d858 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, ceph=True, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:45:40.410 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.h.service' 2024-03-27T08:45:40.510 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:40.510 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-03-27T08:45:40.510 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-03-27T08:45:40.511 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.k 2024-03-27T08:45:41.072 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:40 smithi167 systemd[1]: Stopping Ceph mds.k for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:41.572 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k[64264]: 2024-03-27T08:45:41.088+0000 7feab5400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:41.572 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:41 smithi167 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k[64264]: 2024-03-27T08:45:41.088+0000 7feab5400700 -1 mds.k *** got signal Terminated *** 2024-03-27T08:45:45.634 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:45 smithi167 podman[70342]: 2024-03-27 08:45:45.358041484 +0000 UTC m=+4.391411878 container died dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:45:46.004 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:45 smithi167 podman[70342]: 2024-03-27 08:45:45.74108006 +0000 UTC m=+4.774450448 container cleanup dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, RELEASE=wip-rishabh-testing-20240326.131558-155268c, io.buildah.version=1.33.5, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-03-27T08:45:46.004 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:45 smithi167 bash[70342]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k 2024-03-27T08:45:46.257 INFO:journalctl@ceph.mds.k.smithi167.stdout:Mar 27 08:45:46 smithi167 podman[70356]: 2024-03-27 08:45:46.008544813 +0000 UTC m=+0.638859975 container remove dd3cffe24a53242568d9a77444c00ec301b4488a2d8457eb164bddea200e2bc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-03-27T08:45:46.273 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.k.service' 2024-03-27T08:45:46.388 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:46.388 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-03-27T08:45:46.388 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-03-27T08:45:46.388 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.c 2024-03-27T08:45:46.828 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:46 smithi173 systemd[1]: Stopping Ceph mds.c for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:47.328 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c[65972]: 2024-03-27T08:45:46.993+0000 7f191f800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:47.328 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:46 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c[65972]: 2024-03-27T08:45:46.993+0000 7f191f800700 -1 mds.c *** got signal Terminated *** 2024-03-27T08:45:50.166 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:49 smithi173 podman[71212]: 2024-03-27 08:45:49.867069884 +0000 UTC m=+3.002057093 container died 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, io.buildah.version=1.33.5) 2024-03-27T08:45:50.574 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:50 smithi173 podman[71212]: 2024-03-27 08:45:50.294464202 +0000 UTC m=+3.429451407 container cleanup 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c) 2024-03-27T08:45:50.575 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:50 smithi173 bash[71212]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c 2024-03-27T08:45:50.828 INFO:journalctl@ceph.mds.c.smithi173.stdout:Mar 27 08:45:50 smithi173 podman[71226]: 2024-03-27 08:45:50.57906951 +0000 UTC m=+0.695317658 container remove 2c5dd4b9c89a7e8a2257c80f99595d8998bb613f32c01af2488422328b6eb5cb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326) 2024-03-27T08:45:51.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.c.service' 2024-03-27T08:45:51.155 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:51.155 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-03-27T08:45:51.155 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-03-27T08:45:51.155 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.f 2024-03-27T08:45:51.578 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:51 smithi173 systemd[1]: Stopping Ceph mds.f for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:52.078 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f[65660]: 2024-03-27T08:45:51.788+0000 7fe7e6200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:52.078 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:51 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f[65660]: 2024-03-27T08:45:51.788+0000 7fe7e6200700 -1 mds.f *** got signal Terminated *** 2024-03-27T08:45:53.791 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:53 smithi173 podman[71332]: 2024-03-27 08:45:53.509778826 +0000 UTC m=+1.843919975 container died 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:45:54.078 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:53 smithi173 podman[71332]: 2024-03-27 08:45:53.958191167 +0000 UTC m=+2.292332316 container cleanup 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-03-27T08:45:54.078 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:53 smithi173 bash[71332]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f 2024-03-27T08:45:54.578 INFO:journalctl@ceph.mds.f.smithi173.stdout:Mar 27 08:45:54 smithi173 podman[71345]: 2024-03-27 08:45:54.17818721 +0000 UTC m=+0.658541593 container remove 4970fb72a7d4a1c53a38276ff15d12dd1e66c059e55552805488bfd6b3a595bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240326, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-03-27T08:45:54.668 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.f.service' 2024-03-27T08:45:54.785 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:54.785 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-03-27T08:45:54.785 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-03-27T08:45:54.785 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.i 2024-03-27T08:45:55.328 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:54 smithi173 systemd[1]: Stopping Ceph mds.i for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:45:55.828 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i[66274]: 2024-03-27T08:45:55.428+0000 7f92b6600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:45:55.828 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:55 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i[66274]: 2024-03-27T08:45:55.428+0000 7f92b6600700 -1 mds.i *** got signal Terminated *** 2024-03-27T08:45:58.078 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:57 smithi173 podman[71452]: 2024-03-27 08:45:57.811110818 +0000 UTC m=+2.534279548 container died 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240326, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_BRANCH=HEAD) 2024-03-27T08:45:58.577 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:58 smithi173 podman[71452]: 2024-03-27 08:45:58.213816097 +0000 UTC m=+2.936984802 container cleanup 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.build-date=20240326) 2024-03-27T08:45:58.577 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:58 smithi173 bash[71452]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i 2024-03-27T08:45:58.828 INFO:journalctl@ceph.mds.i.smithi173.stdout:Mar 27 08:45:58 smithi173 podman[71465]: 2024-03-27 08:45:58.581638862 +0000 UTC m=+0.759975964 container remove 09f51c7aa57cd505b12117de849bff774bfeef1bdb12ffaa6786f66d8301977f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-i, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-03-27T08:45:59.091 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.i.service' 2024-03-27T08:45:59.203 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:45:59.204 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-03-27T08:45:59.204 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-03-27T08:45:59.204 DEBUG:teuthology.orchestra.run.smithi173:> sudo systemctl stop ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.l 2024-03-27T08:45:59.802 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:45:59 smithi173 systemd[1]: Stopping Ceph mds.l for f2a81f2e-ec12-11ee-95d0-87774f69a715... 2024-03-27T08:46:00.078 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:45:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l[65348]: 2024-03-27T08:45:59.805+0000 7f9ed4a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-27T08:46:00.078 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:45:59 smithi173 ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l[65348]: 2024-03-27T08:45:59.805+0000 7f9ed4a00700 -1 mds.l *** got signal Terminated *** 2024-03-27T08:46:02.195 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:46:01 smithi173 podman[71573]: 2024-03-27 08:46:01.8890394 +0000 UTC m=+2.237582029 container died 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , ceph=True) 2024-03-27T08:46:02.530 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:46:02 smithi173 podman[71573]: 2024-03-27 08:46:02.309248922 +0000 UTC m=+2.657791571 container cleanup 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, CEPH_POINT_RELEASE=, RELEASE=wip-rishabh-testing-20240326.131558-155268c, org.label-schema.license=GPLv2, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240326, GIT_BRANCH=HEAD) 2024-03-27T08:46:02.530 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:46:02 smithi173 bash[71573]: ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l 2024-03-27T08:46:02.828 INFO:journalctl@ceph.mds.l.smithi173.stdout:Mar 27 08:46:02 smithi173 podman[71587]: 2024-03-27 08:46:02.534936638 +0000 UTC m=+0.632327187 container remove 2c1d09be8df08df21d11b48a95709322a3588e19d55e0fe7bf05d90a33daec97 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:45ddfdb8dd49eba69c4398decee692ae8ceca4f9925f375b2be751a8dea8d772, name=ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715-mds-l, org.label-schema.schema-version=1.0, GIT_COMMIT=d7c7095173c3793ef2ed0fc814eebfb88de11a2e, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240326, RELEASE=wip-rishabh-testing-20240326.131558-155268c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-03-27T08:46:03.038 DEBUG:teuthology.orchestra.run.smithi173:> sudo pkill -f 'journalctl -f -n 0 -u ceph-f2a81f2e-ec12-11ee-95d0-87774f69a715@mds.l.service' 2024-03-27T08:46:03.146 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-27T08:46:03.147 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-03-27T08:46:03.147 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T08:46:03.478 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:08.153 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T08:46:08.476 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:13.179 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force --keep-logs 2024-03-27T08:46:13.500 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:18.333 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:46:18.433 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:46:18.535 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-27T08:46:18.624 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-27T08:46:18.627 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi164/crash 2024-03-27T08:46:18.628 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash -- . 2024-03-27T08:46:18.719 INFO:teuthology.orchestra.run.smithi164.stderr:tar: /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T08:46:18.719 INFO:teuthology.orchestra.run.smithi164.stderr:tar: Error is not recoverable: exiting now 2024-03-27T08:46:18.724 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi167/crash 2024-03-27T08:46:18.725 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash -- . 2024-03-27T08:46:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T08:46:18.851 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-03-27T08:46:18.857 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi173/crash 2024-03-27T08:46:18.858 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash -- . 2024-03-27T08:46:18.959 INFO:teuthology.orchestra.run.smithi173.stderr:tar: /var/lib/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/crash: Cannot open: No such file or directory 2024-03-27T08:46:18.959 INFO:teuthology.orchestra.run.smithi173.stderr:tar: Error is not recoverable: exiting now 2024-03-27T08:46:18.963 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-27T08:46:18.963 DEBUG:teuthology.orchestra.run.smithi164:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-03-27T08:46:19.070 INFO:teuthology.orchestra.run.smithi164.stdout:2024-03-27T08:37:33.565570+0000 mds.h (mds.1) 2 : cluster [WRN] Scrub error on inode 0x10000000312 (/volumes/qa/sv_0/2307b18f-bec2-4dc2-a83d-85672cd4f253/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.h log and `damage ls` output for details 2024-03-27T08:46:19.075 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-03-27T08:46:19.075 INFO:tasks.cephadm:Compressing logs... 2024-03-27T08:46:19.076 DEBUG:teuthology.orchestra.run.smithi164:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T08:46:19.079 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T08:46:19.087 DEBUG:teuthology.orchestra.run.smithi173:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-27T08:46:19.144 INFO:teuthology.orchestra.run.smithi164.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-27T08:46:19.144 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T08:46:19.144 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-03-27T08:46:19.145 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.6.log 2024-03-27T08:46:19.146 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.a.log 2024-03-27T08:46:19.148 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T08:46:19.149 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.g.log 2024-03-27T08:46:19.151 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.j.log 2024-03-27T08:46:19.152 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.3.log 2024-03-27T08:46:19.154 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.j.log: 93.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T08:46:19.155 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.3.log: 90.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T08:46:19.155 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.x.log 2024-03-27T08:46:19.157 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.0.log 2024-03-27T08:46:19.158 INFO:teuthology.orchestra.run.smithi164.stderr: 94.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.g.log.gz 2024-03-27T08:46:19.158 INFO:teuthology.orchestra.run.smithi164.stderr: 94.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.j.log.gz 2024-03-27T08:46:19.158 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T08:46:19.160 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log 2024-03-27T08:46:19.162 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log: 82.9% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T08:46:19.164 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T08:46:19.166 INFO:teuthology.orchestra.run.smithi164.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.9.log 2024-03-27T08:46:19.168 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.d.log 2024-03-27T08:46:19.171 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-27T08:46:19.172 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T08:46:19.173 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.10.log 2024-03-27T08:46:19.174 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.9.log: /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.a.log 2024-03-27T08:46:19.175 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T08:46:19.175 INFO:teuthology.orchestra.run.smithi164.stderr: 89.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T08:46:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.10.log: 92.1% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T08:46:19.176 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.b.log 2024-03-27T08:46:19.177 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.4.log 2024-03-27T08:46:19.178 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.1.log 2024-03-27T08:46:19.179 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.k.log 2024-03-27T08:46:19.179 INFO:teuthology.orchestra.run.smithi167.stderr: 90.4% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T08:46:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-27T08:46:19.180 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-03-27T08:46:19.181 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.h.log 2024-03-27T08:46:19.182 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.l.log 2024-03-27T08:46:19.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.7.log 2024-03-27T08:46:19.183 INFO:teuthology.orchestra.run.smithi164.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.a.log: 94.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.d.log.gz 2024-03-27T08:46:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/cephadm.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log 2024-03-27T08:46:19.184 INFO:teuthology.orchestra.run.smithi173.stderr: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-03-27T08:46:19.184 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.i.log 2024-03-27T08:46:19.185 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.e.log 2024-03-27T08:46:19.186 INFO:teuthology.orchestra.run.smithi164.stderr: 90.8% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T08:46:19.186 INFO:teuthology.orchestra.run.smithi164.stderr: 94.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.a.log.gz 2024-03-27T08:46:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.l.log: /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.11.log 2024-03-27T08:46:19.186 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.z.log 2024-03-27T08:46:19.187 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.11.log: 90.4% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.audit.log.gz 2024-03-27T08:46:19.188 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.7.log: /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.y.log 2024-03-27T08:46:19.188 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.8.log 2024-03-27T08:46:19.189 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.5.log 2024-03-27T08:46:19.191 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.z.log: /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.f.log 2024-03-27T08:46:19.192 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T08:46:19.193 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log 2024-03-27T08:46:19.193 INFO:teuthology.orchestra.run.smithi173.stderr: 94.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.l.log.gz 2024-03-27T08:46:19.195 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log 2024-03-27T08:46:19.197 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log: 82.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T08:46:19.197 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.2.log 2024-03-27T08:46:19.198 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log: 92.8% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.z.log.gz 2024-03-27T08:46:19.199 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log: 82.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.cephadm.log.gz 2024-03-27T08:46:19.199 INFO:teuthology.orchestra.run.smithi173.stderr: 94.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.f.log.gz 2024-03-27T08:46:19.199 INFO:teuthology.orchestra.run.smithi173.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.c.log 2024-03-27T08:46:19.201 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log 2024-03-27T08:46:19.201 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T08:46:19.203 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log 2024-03-27T08:46:19.205 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.c.log 2024-03-27T08:46:19.206 INFO:teuthology.orchestra.run.smithi173.stderr: 89.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T08:46:19.207 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log: 92.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.y.log.gz 2024-03-27T08:46:19.209 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.b.log 2024-03-27T08:46:19.218 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log: 89.7%/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.b.log: -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph.log.gz 2024-03-27T08:46:19.220 INFO:teuthology.orchestra.run.smithi173.stderr:/var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log: /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.c.log: 90.8% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T08:46:19.241 INFO:teuthology.orchestra.run.smithi167.stderr: 90.8% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-volume.log.gz 2024-03-27T08:46:19.356 INFO:teuthology.orchestra.run.smithi164.stderr: 90.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mgr.x.log.gz 2024-03-27T08:46:19.457 INFO:teuthology.orchestra.run.smithi173.stderr: 92.0% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.c.log.gz 2024-03-27T08:46:19.707 INFO:teuthology.orchestra.run.smithi167.stderr: 91.8% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.b.log.gz 2024-03-27T08:46:20.342 INFO:teuthology.orchestra.run.smithi164.stderr: 90.5% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mon.a.log.gz 2024-03-27T08:46:20.358 INFO:teuthology.orchestra.run.smithi173.stderr: 95.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.i.log.gz 2024-03-27T08:46:20.848 INFO:teuthology.orchestra.run.smithi173.stderr: 95.4% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.c.log.gz 2024-03-27T08:46:20.856 INFO:teuthology.orchestra.run.smithi173.stderr: 93.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.2.log.gz 2024-03-27T08:46:20.933 INFO:teuthology.orchestra.run.smithi164.stderr: 93.1% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.9.log.gz 2024-03-27T08:46:20.966 INFO:teuthology.orchestra.run.smithi173.stderr: 93.5% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.11.log.gz 2024-03-27T08:46:21.010 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.6.log.gz 2024-03-27T08:46:21.216 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.3.log.gz 2024-03-27T08:46:21.310 INFO:teuthology.orchestra.run.smithi167.stderr: 93.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.4.log.gz 2024-03-27T08:46:21.338 INFO:teuthology.orchestra.run.smithi164.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.0.log.gz 2024-03-27T08:46:21.353 INFO:teuthology.orchestra.run.smithi173.stderr: 93.2% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.8.log.gz 2024-03-27T08:46:21.360 INFO:teuthology.orchestra.run.smithi167.stderr: 95.1% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.k.log.gz 2024-03-27T08:46:21.506 INFO:teuthology.orchestra.run.smithi173.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.5.log.gz 2024-03-27T08:46:21.512 INFO:teuthology.orchestra.run.smithi173.stderr: 2024-03-27T08:46:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:real 0m2.371s 2024-03-27T08:46:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:user 0m10.241s 2024-03-27T08:46:21.512 INFO:teuthology.orchestra.run.smithi173.stderr:sys 0m0.917s 2024-03-27T08:46:21.681 INFO:teuthology.orchestra.run.smithi167.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.10.log.gz 2024-03-27T08:46:21.768 INFO:teuthology.orchestra.run.smithi167.stderr: 93.3% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.1.log.gz 2024-03-27T08:46:21.978 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-osd.7.log.gz 2024-03-27T08:46:31.211 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.h.log.gz 2024-03-27T08:46:32.679 INFO:teuthology.orchestra.run.smithi164.stderr: 93.5% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-03-27T08:46:32.683 INFO:teuthology.orchestra.run.smithi164.stderr: 2024-03-27T08:46:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:real 0m13.572s 2024-03-27T08:46:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:user 0m21.106s 2024-03-27T08:46:32.683 INFO:teuthology.orchestra.run.smithi164.stderr:sys 0m1.790s 2024-03-27T08:46:35.495 INFO:teuthology.orchestra.run.smithi167.stderr: 93.6% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.e.log.gz 2024-03-27T08:46:39.580 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/f2a81f2e-ec12-11ee-95d0-87774f69a715/ceph-mds.b.log.gz 2024-03-27T08:46:39.584 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-03-27T08:46:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m20.451s 2024-03-27T08:46:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m56.528s 2024-03-27T08:46:39.585 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m4.324s 2024-03-27T08:46:39.586 INFO:tasks.cephadm:Archiving logs... 2024-03-27T08:46:39.586 DEBUG:teuthology.misc:Transferring archived files from smithi164:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi164/log 2024-03-27T08:46:39.587 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:46:42.679 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi167/log 2024-03-27T08:46:42.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:46:49.985 DEBUG:teuthology.misc:Transferring archived files from smithi173:/var/log/ceph to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi173/log 2024-03-27T08:46:49.986 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-27T08:46:51.222 INFO:tasks.cephadm:Removing cluster... 2024-03-27T08:46:51.222 DEBUG:teuthology.orchestra.run.smithi164:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force 2024-03-27T08:46:51.548 INFO:teuthology.orchestra.run.smithi164.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:52.107 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force 2024-03-27T08:46:52.436 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:53.177 DEBUG:teuthology.orchestra.run.smithi173:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid f2a81f2e-ec12-11ee-95d0-87774f69a715 --force 2024-03-27T08:46:53.493 INFO:teuthology.orchestra.run.smithi173.stdout:Deleting cluster with fsid: f2a81f2e-ec12-11ee-95d0-87774f69a715 2024-03-27T08:46:54.073 INFO:tasks.cephadm:Removing cephadm ... 2024-03-27T08:46:54.073 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:46:54.130 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:46:54.187 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-27T08:46:54.243 INFO:tasks.cephadm:Teardown complete 2024-03-27T08:46:54.243 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-27T08:46:54.257 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 164, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_155268c4e432a12433aa833f174f9fe3b1016ae0/qa/tasks/fwd_scrub.py", line 99, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-27T08:46:54.258 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-27T08:46:54.259 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:46:54.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:46:54.274 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-27T08:46:54.450 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-27T08:46:54.461 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-27T08:46:54.461 DEBUG:teuthology.orchestra.run.smithi164:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:46:54.469 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:46:54.478 DEBUG:teuthology.orchestra.run.smithi173:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-27T08:46:54.517 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:46:54.526 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:=============================================================================== 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 +250us[ +204us] +/- 72ms 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:^* hv02.front.sepia.ceph.com 3 6 377 10 -302us[ -348us] +/- 49ms 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +270us[ +224us] +/- 83ms 2024-03-27T08:46:54.527 INFO:teuthology.orchestra.run.smithi164.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:46:54.534 INFO:teuthology.orchestra.run.smithi173.stderr:bash: line 1: ntpq: command not found 2024-03-27T08:46:54.536 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:46:54.536 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-03-27T08:46:54.536 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 9 +242us[ +183us] +/- 72ms 2024-03-27T08:46:54.536 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv02.front.sepia.ceph.com 3 6 377 8 -315us[ -374us] +/- 49ms 2024-03-27T08:46:54.537 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 6 +261us[ +261us] +/- 83ms 2024-03-27T08:46:54.537 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:46:54.543 INFO:teuthology.orchestra.run.smithi173.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-27T08:46:54.543 INFO:teuthology.orchestra.run.smithi173.stdout:=============================================================================== 2024-03-27T08:46:54.544 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 10 +239us[ +191us] +/- 72ms 2024-03-27T08:46:54.544 INFO:teuthology.orchestra.run.smithi173.stdout:^* hv02.front.sepia.ceph.com 3 6 377 7 -307us[ -356us] +/- 49ms 2024-03-27T08:46:54.544 INFO:teuthology.orchestra.run.smithi173.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 +239us[ +191us] +/- 83ms 2024-03-27T08:46:54.544 INFO:teuthology.orchestra.run.smithi173.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-27T08:46:54.545 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-27T08:46:54.555 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-27T08:46:54.556 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-27T08:46:54.566 DEBUG:teuthology.orchestra.run.smithi164:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:46:54.800 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:46:55.023 DEBUG:teuthology.orchestra.run.smithi173:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-27T08:46:55.250 DEBUG:teuthology.orchestra.run.smithi164:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:46:55.348 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:55.348 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:46:55.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:55.445 DEBUG:teuthology.orchestra.run.smithi173:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-27T08:46:55.546 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:55.546 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-27T08:46:55.557 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-27T08:46:55.568 INFO:teuthology.task.internal:Duration was 2084.898635 seconds 2024-03-27T08:46:55.568 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-27T08:46:55.579 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-27T08:46:55.579 DEBUG:teuthology.orchestra.run.smithi164:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:46:55.587 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:46:55.595 DEBUG:teuthology.orchestra.run.smithi173:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-27T08:46:55.750 INFO:teuthology.orchestra.run.smithi164.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:46:55.755 INFO:teuthology.orchestra.run.smithi173.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:46:55.757 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-27T08:46:56.282 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-27T08:46:56.282 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi164.front.sepia.ceph.com 2024-03-27T08:46:56.283 DEBUG:teuthology.orchestra.run.smithi164:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:46:56.357 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-03-27T08:46:56.357 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:46:56.414 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi173.front.sepia.ceph.com 2024-03-27T08:46:56.414 DEBUG:teuthology.orchestra.run.smithi173:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-27T08:46:56.492 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-27T08:46:56.492 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:46:56.500 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:46:56.504 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-27T08:46:56.595 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-27T08:46:56.595 DEBUG:teuthology.orchestra.run.smithi164:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:46:56.600 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:46:56.604 DEBUG:teuthology.orchestra.run.smithi173:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-27T08:46:57.095 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-27T08:46:57.108 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-27T08:46:57.109 DEBUG:teuthology.orchestra.run.smithi164:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:46:57.205 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:46:57.300 DEBUG:teuthology.orchestra.run.smithi173:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-27T08:46:57.402 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-27T08:46:57.415 DEBUG:teuthology.orchestra.run.smithi164:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.423 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.431 DEBUG:teuthology.orchestra.run.smithi173:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.528 INFO:teuthology.orchestra.run.smithi164.stdout:kernel.core_pattern = core 2024-03-27T08:46:57.533 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-03-27T08:46:57.538 INFO:teuthology.orchestra.run.smithi173.stdout:kernel.core_pattern = core 2024-03-27T08:46:57.610 DEBUG:teuthology.orchestra.run.smithi164:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:57.663 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.717 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:57.718 DEBUG:teuthology.orchestra.run.smithi173:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-27T08:46:57.772 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-27T08:46:57.773 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-27T08:46:57.785 INFO:teuthology.task.internal:Transferring archived files... 2024-03-27T08:46:57.785 DEBUG:teuthology.misc:Transferring archived files from smithi164:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi164 2024-03-27T08:46:57.786 DEBUG:teuthology.orchestra.run.smithi164:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:46:57.901 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi167 2024-03-27T08:46:57.902 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:46:58.012 DEBUG:teuthology.misc:Transferring archived files from smithi173:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706/remote/smithi173 2024-03-27T08:46:58.012 DEBUG:teuthology.orchestra.run.smithi173:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-27T08:46:58.124 INFO:teuthology.task.internal:Removing archive directory... 2024-03-27T08:46:58.124 DEBUG:teuthology.orchestra.run.smithi164:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:46:58.132 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:46:58.139 DEBUG:teuthology.orchestra.run.smithi173:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-27T08:46:58.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-27T08:46:58.209 INFO:teuthology.task.internal:Not uploading archives. 2024-03-27T08:46:58.209 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-27T08:46:58.220 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-27T08:46:58.221 DEBUG:teuthology.orchestra.run.smithi164:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:46:58.228 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:46:58.235 DEBUG:teuthology.orchestra.run.smithi173:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-27T08:46:58.277 INFO:teuthology.orchestra.run.smithi164.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:46 /home/ubuntu/cephtest 2024-03-27T08:46:58.285 INFO:teuthology.orchestra.run.smithi167.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:46 /home/ubuntu/cephtest 2024-03-27T08:46:58.291 INFO:teuthology.orchestra.run.smithi173.stdout: 394501 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 27 08:46 /home/ubuntu/cephtest 2024-03-27T08:46:58.294 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-27T08:46:58.306 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-27T08:46:58.319 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-03-27T08:46:58.319 INFO:teuthology.nuke:Checking targets against current locks 2024-03-27T08:46:58.343 DEBUG:teuthology.nuke:shortname: smithi164 2024-03-27T08:46:58.344 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:46:58.361 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi164.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.546988', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPFHxk/686kWc8nSjJ/jw0+u1G8h2gVjiuIitZBQyO3nlZDiPoKrQzcChFkFrEXGHDVHT3dhUZks7XJoWBTtWJo='} 2024-03-27T08:46:58.365 DEBUG:teuthology.nuke:shortname: smithi167 2024-03-27T08:46:58.365 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:46:58.388 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.544731', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD2KjcoRtPDIsq/FV0jcma9Ur+ZkIk9tt3Y+yt+CZ4FEwFEeDo9FfKAuplxQNI80RgNbPiedurHNJ/q4NIjvU/Q='} 2024-03-27T08:46:58.389 DEBUG:teuthology.nuke:shortname: smithi173 2024-03-27T08:46:58.389 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-27T08:46:58.419 INFO:teuthology.orchestra.console.smithi164:Power off 2024-03-27T08:46:58.419 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:46:58.428 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi173.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2024-03-27_05:27:11-fs-wip-rishabh-testing-20240326.131558-testing-default-smithi/7625706', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-27 08:02:11.546025', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCDET7FpT/zOyGXaKpHQXGWRwGH02BZOUZfIL38eBuoXcdblRvQtmV1av2Fy3GdKPT6ZJggNhReoMMXFyVHumi4='} 2024-03-27T08:46:58.449 DEBUG:teuthology.orchestra.console.smithi164:power off output: Chassis Power Control: Down/Off 2024-03-27T08:46:58.450 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:46:58.466 INFO:teuthology.orchestra.console.smithi167:Power off 2024-03-27T08:46:58.467 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:46:58.483 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-27T08:46:58.490 DEBUG:teuthology.orchestra.console.smithi167:power off output: Chassis Power Control: Down/Off 2024-03-27T08:46:58.490 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:46:58.504 INFO:teuthology.orchestra.console.smithi173:Power off 2024-03-27T08:46:58.505 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-27T08:46:58.516 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-03-27T08:46:58.528 DEBUG:teuthology.orchestra.console.smithi173:power off output: Chassis Power Control: Down/Off 2024-03-27T08:46:58.528 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:46:58.551 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-27T08:47:02.485 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:02.517 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:02.552 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:02.598 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is on 2024-03-27T08:47:02.627 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-03-27T08:47:02.662 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is on 2024-03-27T08:47:06.602 DEBUG:teuthology.orchestra.console.smithi164:pexpect command: ipmitool -H smithi164.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:06.627 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:06.663 DEBUG:teuthology.orchestra.console.smithi173:pexpect command: ipmitool -H smithi173.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:06.716 DEBUG:teuthology.orchestra.console.smithi164:check power output: Chassis Power is off 2024-03-27T08:47:06.738 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is on 2024-03-27T08:47:06.774 DEBUG:teuthology.orchestra.console.smithi173:check power output: Chassis Power is off 2024-03-27T08:47:06.817 INFO:teuthology.orchestra.console.smithi164:Power off completed 2024-03-27T08:47:06.875 INFO:teuthology.orchestra.console.smithi173:Power off completed 2024-03-27T08:47:10.742 DEBUG:teuthology.orchestra.console.smithi167:pexpect command: ipmitool -H smithi167.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-27T08:47:10.853 DEBUG:teuthology.orchestra.console.smithi167:check power output: Chassis Power is off 2024-03-27T08:47:10.954 INFO:teuthology.orchestra.console.smithi167:Power off completed 2024-03-27T08:47:11.059 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated-and-quota} 1-check-counter 2-scrub/yes 3-snaps/no 4-flush/yes 5-workunit/fs/norstats}} duration: 2084.8986349105835 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.b-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 mon.c-kernel-sha1: 1df0c7e8a2354c42d738e5454ba83ea7332deac2 owner: scheduled_rishabh@teuthology status: fail success: false 2024-03-27T08:47:11.060 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-27T08:47:11.152 INFO:teuthology.run:FAIL